2025-12-02 19:00:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-02 19:00:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-02 19:00:05 [astonbarclay.gb] INFO: Starting spider astonbarclay.gb
2025-12-02 19:00:05 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-02 19:00:05 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-02 19:00:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-02 19:00:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-02 19:00:05 [scrapy.extensions.telnet] INFO: Telnet Password: 0104bc9b7d7aec3d
2025-12-02 19:00:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-02 19:00:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/astonbarclay.gb/task_36_2025-12-02T19_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-02 19:00:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-02 19:00:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-02 19:00:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-02 19:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-02 19:00:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-02 19:00:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-02 19:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:00:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-02 19:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-02 19:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-02 19:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-02 19:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-02 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-02 19:00:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-02 19:00:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-02 19:00:05 [scrapy.core.engine] INFO: Spider opened
2025-12-02 19:00:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-02 19:00:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-12-02 19:00:05 [scrapy-playwright] INFO: Starting download handler
2025-12-02 19:00:05 [scrapy-playwright] INFO: Starting download handler
2025-12-02 19:00:10 [scrapy-playwright] INFO: Launching browser firefox
2025-12-02 19:00:11 [scrapy-playwright] INFO: Browser firefox launched
2025-12-02 19:00:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-02 19:00:11 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-02 19:00:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2025-12-02 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://catalogue.astonbarclay.net/vehicle-search>
2025-12-02 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2025-12-02 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/vehicle-search>
2025-12-02 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.googleapis.com/css?family=Lexend> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js>
2025-12-02 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css>
2025-12-02 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js>
2025-12-02 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.googleapis.com/css?family=Lexend>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://sessions.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/profileconfig> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf> (resource type: font, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/profileconfig>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/user> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/navigation> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/user>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/navigation>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/facebook.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/facebook.png>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/twitter.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/sprite2.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/twitter.png>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/sprite2.png>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/vehicle/all> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2> (resource type: font, referrer: https://fonts.googleapis.com/)
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json>
2025-12-02 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/vehicle/all>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <202 https://sessions.bugsnag.com/>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/c0e38e93-2aa8-4b73-bd43-c1132b1048cf/en.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-engine.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-engine.svg>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-reg.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-reg.svg>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-v5.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-v5.svg>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mot.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mot.svg>
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-vat.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-vat.svg>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-non-runner.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-non-runner.svg>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/YB72AVY/2025-11-28/image/fa1d6258-90ad-42ac-b0db-ca1a98e115eb_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/YB72AVY/2025-11-28/image/fa1d6258-90ad-42ac-b0db-ca1a98e115eb_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/98418ba1-09b5-4bb0-849a-2f1bf4445b82_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/OE68XXJ/2025-11-24/image/98418ba1-09b5-4bb0-849a-2f1bf4445b82_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/SL19WJM/2025-08-20/image/684269b4-9565-48c8-9e5b-b9692f40dbdf_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/SL19WJM/2025-08-20/image/684269b4-9565-48c8-9e5b-b9692f40dbdf_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/MK65DVH/2025-11-11/image/449aa447-57d5-4727-b44e-e5a9e7ed6685_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/MK65DVH/2025-11-11/image/449aa447-57d5-4727-b44e-e5a9e7ed6685_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/NL15HGX/2025-11-03/image/4bd6d3b5-e915-4eb8-97b9-de52d2da2cbd_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/NL15HGX/2025-11-03/image/4bd6d3b5-e915-4eb8-97b9-de52d2da2cbd_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/MT17EHG/2025-11-19/image/d6ce6e6b-28e9-4247-a275-6775d39dee48_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/MT17EHG/2025-11-19/image/d6ce6e6b-28e9-4247-a275-6775d39dee48_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/WO17CYW/2025-11-19/image/827d4323-939e-4640-8096-c18a3df9a1d1_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/WO17CYW/2025-11-19/image/827d4323-939e-4640-8096-c18a3df9a1d1_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/a39f1560-0961-4b25-9dbb-e7c2995a4632_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/a39f1560-0961-4b25-9dbb-e7c2995a4632_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/ML54OOJ/2025-11-28/image/65669969-c3ea-4d31-9d32-84cffb645039_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/ML54OOJ/2025-11-28/image/65669969-c3ea-4d31-9d32-84cffb645039_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/BV17UHF/2025-11-26/image/7d77ebbe-afc8-4bbf-8736-432f390a5a19_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/BV17UHF/2025-11-26/image/7d77ebbe-afc8-4bbf-8736-432f390a5a19_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/WA66TVP/2025-11-04/image/9949787c-74e7-4cee-b733-3ca3e7602149_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/WA66TVP/2025-11-04/image/9949787c-74e7-4cee-b733-3ca3e7602149_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/340fb64d-8701-402f-83b2-40a5d33e0d3d_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/MJ66DKK/2025-11-26/image/340fb64d-8701-402f-83b2-40a5d33e0d3d_removebg.jpg?w=600>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/c0e38e93-2aa8-4b73-bd43-c1132b1048cf/en.json>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/image-unavailable.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/image-unavailable.png>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcCenter.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/vehicle-search> (referer: None) ['playwright']
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCenterRounded.json>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcCenter.json>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_company_logo.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/ot_company_logo.png>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-02 19:00:17 [astonbarclay.gb] INFO: Cookies from Playwright: [{'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Tue+Dec+02+2025+19%3A00%3A17+GMT%2B0000+(Coordinated+Universal+Time)&version=202405.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&landingPath=https%3A%2F%2Fcatalogue.astonbarclay.net%2Fvehicle-search&groups=C0001%3A1%2CC0002%3A0%2CC0004%3A0', 'domain': '.astonbarclay.net', 'path': '/', 'expires': 1796238017, 'httpOnly': False, 'secure': False, 'sameSite': 'Lax'}]
2025-12-02 19:00:17 [astonbarclay.gb] INFO: Scrapy-formatted cookies: [{'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Tue+Dec+02+2025+19%3A00%3A17+GMT%2B0000+(Coordinated+Universal+Time)&version=202405.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&landingPath=https%3A%2F%2Fcatalogue.astonbarclay.net%2Fvehicle-search&groups=C0001%3A1%2CC0002%3A0%2CC0004%3A0', 'domain': '.astonbarclay.net', 'path': '/'}]
2025-12-02 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Adesa',RowKey='cookies') HTTP/1.1" 204 0
2025-12-02 19:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-02 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-02 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-02 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-02 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-02 19:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/search?nonrunner=false&vehicletype=Car&agemax=9&mileagemax=320000> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117457472
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457472%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117457472: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117419626
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117419626%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117419626: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117213849
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213849%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117213849: 2
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116419349
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116419349%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116419349: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117433885
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433885%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117433885: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116800442
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116800442%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116800442: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117488530
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488530%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117488530: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117144960
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144960%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117144960: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117479539
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117479539%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117479539: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117459952
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459952%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117459952: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117144969
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144969%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117144969: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116804294
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116804294%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116804294: 2
2025-12-02 19:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117101013
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101013%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117101013: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116788960
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116788960%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116788960: 2
2025-12-02 19:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117238218
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117238218%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117238218: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116988436
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988436%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116988436: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117049908
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117049908%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117049908: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116831329
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831329%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116831329: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117188762
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188762%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117188762: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117544347
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544347%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117544347: 2
2025-12-02 19:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117447500
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447500%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117447500: 2
2025-12-02 19:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117405887
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405887%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117405887: 2
2025-12-02 19:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117422764
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422764%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117422764: 2
2025-12-02 19:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117581980
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581980%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117581980: 2
2025-12-02 19:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117553459
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553459%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117553459: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117496386
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117496386%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117496386: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117070544
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117070544%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117070544: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117517475
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517475%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117517475: 0
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117459104
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459104%27 HTTP/1.1" 200 None
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117459104: 2
2025-12-02 19:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117507922
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507922%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117507922: 2
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117267875
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267875%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117267875: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117550109
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550109%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117550109: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117507292
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507292%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117507292: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117374304
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374304%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117374304: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117374356
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374356%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117374356: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117374439
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374439%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117374439: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117323884
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117323884%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117323884: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117551950
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551950%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117551950: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117425969
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425969%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117425969: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117573049
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573049%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117573049: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117293082
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117293082%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117293082: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117164114
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117164114%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117164114: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117475684
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117475684%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117475684: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117444914
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444914%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117444914: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117442908
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442908%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117442908: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117418653
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418653%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117418653: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117443109
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117443109%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117443109: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117247051
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117247051%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117247051: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116807925
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116807925%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116807925: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117572022
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572022%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117572022: 2
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117571999
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571999%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117571999: 2
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117492135
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492135%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117492135: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117253439
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253439%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117253439: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116891404
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891404%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116891404: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116891417
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891417%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116891417: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117458552
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458552%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117458552: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117216157
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117216157%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117216157: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116895357
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116895357%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116895357: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116981133
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116981133%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116981133: 2
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117444372
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444372%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117444372: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117348473
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117348473%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117348473: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117551156
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551156%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117551156: 2
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117441244
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441244%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117441244: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117415492
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415492%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117415492: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117441140
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441140%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117441140: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117441120
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441120%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117441120: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117441149
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441149%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117441149: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117441190
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441190%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117441190: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117441346
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441346%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117441346: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117497624
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117497624%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117497624: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117599013
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599013%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117599013: 2
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117441537
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441537%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117441537: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117366912
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366912%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117366912: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117585302
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585302%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117585302: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117585284
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585284%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117585284: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117506668
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506668%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117506668: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117121214
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121214%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117121214: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117400496
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400496%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117400496: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117433630
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433630%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117433630: 2
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117331639
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117331639%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117331639: 2
2025-12-02 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117213849?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117400527
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400527%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117400527: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117553638
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553638%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117553638: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117635994
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635994%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117635994: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117440690
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440690%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117440690: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117024353
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024353%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117024353: 0
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117662118
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662118%27 HTTP/1.1" 200 None
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117662118: 1
2025-12-02 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117288542
2025-12-02 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288542%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117288542: 0
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117289360
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289360%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117289360: 0
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117635092
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635092%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117635092: 0
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117288965
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288965%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117288965: 0
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117024415
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024415%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117024415: 0
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117031158
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117031158%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117031158: 0
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117440649
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440649%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117440649: 0
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117024058
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024058%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117024058: 0
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117662079
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662079%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117662079: 1
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117662383
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662383%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117662383: 1
2025-12-02 19:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117544347?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116788960?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117213849, 'registration': 'WO17CYW', 'account': 'THE109', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Lounge 3dr', 'mileage': 73050, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-02T10:00Z', 'lot': 22, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-05-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-25', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WO17CYW/2025-11-19/image/827d4323-939e-4640-8096-c18a3df9a1d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/225ffae3-8282-40f2-a69f-3f267aaadd38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/0e7aa2bd-cf12-45e8-af41-6cb3218d99e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/40543e69-5a9a-474b-97a9-a42561a16a8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/75c9eaea-2366-45b5-b4af-774940e104a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/28b99b7a-3b2f-45d3-a081-82cf9801cb37_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/5e158c1a-47cc-4690-a526-ecad035654b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/9e1086a9-1719-4e9d-999d-106679161d5d_removebg.jpg?w=600'], 'colour': 'PINK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/18 14k 05/20 31k', 'remarks': 'SPARE KEY VOSA STATES 34K 41K 51K 66K 72K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a643c060-ef89-408e-b55f-c089cd19c6ac.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117213849, 'registration': 'WO17CYW', 'account': 'THE109', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Lounge 3dr', 'mileage': 73050, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-02T10:00Z', 'lot': 22, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-05-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-25', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WO17CYW/2025-11-19/image/827d4323-939e-4640-8096-c18a3df9a1d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/225ffae3-8282-40f2-a69f-3f267aaadd38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/0e7aa2bd-cf12-45e8-af41-6cb3218d99e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/40543e69-5a9a-474b-97a9-a42561a16a8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/75c9eaea-2366-45b5-b4af-774940e104a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/28b99b7a-3b2f-45d3-a081-82cf9801cb37_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/5e158c1a-47cc-4690-a526-ecad035654b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WO17CYW/2025-11-19/image/9e1086a9-1719-4e9d-999d-106679161d5d_removebg.jpg?w=600'], 'colour': 'PINK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/18 14k 05/20 31k', 'remarks': 'SPARE KEY VOSA STATES 34K 41K 51K 66K 72K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a643c060-ef89-408e-b55f-c089cd19c6ac.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e918acf-6531-571b-9318-820d9979e399 with identifier: 117213849
2025-12-02 19:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e918acf-6531-571b-9318-820d9979e399 with scrape type 2
2025-12-02 19:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e918acf-6531-571b-9318-820d9979e399 with scrape type 2
2025-12-02 19:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4e918acf-6531-571b-9318-820d9979e399, identifier: 117213849
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117661923
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661923%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117661923: 1
2025-12-02 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4e918acf-6531-571b-9318-820d9979e399 with identifier: 117213849
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=PINK HTTP/1.1" 200 None
2025-12-02 19:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-02 19:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4e918acf-6531-571b-9318-820d9979e399 with identifier: 117213849
2025-12-02 19:00:21 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 4e918acf-6531-571b-9318-820d9979e399 with expiration date: 2025-12-02T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'PINK',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4e918acf-6531-571b-9318-820d9979e399',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WO17CYW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117213849',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FIAT',
 'model': '500 HATCHBACK',
 'odometer': 73050,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'FIAT 500 HATCHBACK 1.2 Lounge 3dr',
 'transmission': 'manual',
 'trim': '1.2 Lounge 3dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213849%27 HTTP/1.1" 200 None
2025-12-02 19:00:21 [astonbarclay.gb] INFO: Saving data for 117213849: {'auction_closing_time': 1764669600.0, 'created_time': 1763406059.419004, 'last_price_update_time': 1764702021.88767}
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117213849') HTTP/1.1" 204 0
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117662353
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662353%27 HTTP/1.1" 200 None
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117662353: 1
2025-12-02 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117581980?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117447500?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117405887?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117422764?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116804294?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117544347, 'registration': 'KP23PXT', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V3 58kWh 5dr Auto', 'mileage': 36615, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 141, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-03-29', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KP23PXT/2025-11-27/image/47cb73a4-4062-45aa-848b-857ebc10bea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/e08124cf-1b4a-41bd-bb86-4db623dbb9cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/a9f0e7dc-1eb2-443f-b0e5-2b1164572f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/8b9b6d7c-9f90-445e-83be-74932678e911_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/83e125da-5cba-44a2-9698-0080e1f563bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/fa198d6d-3968-4293-bd6f-3e1134ed9683_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/86168a3b-5b08-40c2-9196-1d9a163d95d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/bca09a0e-a1e5-4420-a48f-b35c2025e74a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/801757b8-9d06-47f8-ae08-97e97a527446_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/44989f7d-97a8-4d55-95b0-831f028f5e63_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ee37453-ce84-4122-acc2-d2f453301b3a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117544347, 'registration': 'KP23PXT', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V3 58kWh 5dr Auto', 'mileage': 36615, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 141, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-03-29', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KP23PXT/2025-11-27/image/47cb73a4-4062-45aa-848b-857ebc10bea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/e08124cf-1b4a-41bd-bb86-4db623dbb9cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/a9f0e7dc-1eb2-443f-b0e5-2b1164572f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/8b9b6d7c-9f90-445e-83be-74932678e911_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/83e125da-5cba-44a2-9698-0080e1f563bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/fa198d6d-3968-4293-bd6f-3e1134ed9683_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/86168a3b-5b08-40c2-9196-1d9a163d95d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/bca09a0e-a1e5-4420-a48f-b35c2025e74a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/801757b8-9d06-47f8-ae08-97e97a527446_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP23PXT/2025-11-27/image/44989f7d-97a8-4d55-95b0-831f028f5e63_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ee37453-ce84-4122-acc2-d2f453301b3a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb with identifier: 117544347
2025-12-02 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb with scrape type 2
2025-12-02 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb with scrape type 2
2025-12-02 19:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb, identifier: 117544347
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116788960, 'registration': 'VK70ENO', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Style 5dr', 'mileage': 96174, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 117, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-17', 'fuel': 'Petrol', 'motExpiry': '2025-11-16', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK70ENO/2025-11-25/image/ff0f706b-530e-4c0b-b7d9-19711a503131_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/48a35505-c711-495f-b868-0293a68000f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/0473a4e2-6de0-46ac-a661-3023fd31c916_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/0ef0fc9e-dceb-43e9-9e7a-f3ac721710d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/37f569f2-bf66-4924-8cd1-9e2a147c4ebb_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/65f2e00e-6c3e-4e66-92ae-9db6533e0bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/2b2a97c0-c1ba-4afd-aa27-0f697da9be92_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/1f4d8e88-7489-45e0-bc80-2947c384ada8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/b38579c5-0790-4bcb-91f6-99bb576f16b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/a68991ce-0ea0-4fa9-b13c-949fd0d919b5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/21 17K, 12/21 19K, 11/22 37K, 2/24 61K, 6/24 69K, 6/25 88K,', 'remarks': 'S/KEY (Cover Missing)', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8204f173-e894-419f-a0d5-b14bec49b89f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116788960, 'registration': 'VK70ENO', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Style 5dr', 'mileage': 96174, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 117, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-17', 'fuel': 'Petrol', 'motExpiry': '2025-11-16', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK70ENO/2025-11-25/image/ff0f706b-530e-4c0b-b7d9-19711a503131_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/48a35505-c711-495f-b868-0293a68000f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/0473a4e2-6de0-46ac-a661-3023fd31c916_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/0ef0fc9e-dceb-43e9-9e7a-f3ac721710d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/37f569f2-bf66-4924-8cd1-9e2a147c4ebb_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/65f2e00e-6c3e-4e66-92ae-9db6533e0bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/2b2a97c0-c1ba-4afd-aa27-0f697da9be92_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/1f4d8e88-7489-45e0-bc80-2947c384ada8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/b38579c5-0790-4bcb-91f6-99bb576f16b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK70ENO/2025-11-25/image/a68991ce-0ea0-4fa9-b13c-949fd0d919b5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/21 17K, 12/21 19K, 11/22 37K, 2/24 61K, 6/24 69K, 6/25 88K,', 'remarks': 'S/KEY (Cover Missing)', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8204f173-e894-419f-a0d5-b14bec49b89f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2250c9ea-d32d-544d-b536-6725b39e76ee with identifier: 116788960
2025-12-02 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2250c9ea-d32d-544d-b536-6725b39e76ee with scrape type 2
2025-12-02 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2250c9ea-d32d-544d-b536-6725b39e76ee with scrape type 2
2025-12-02 19:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2250c9ea-d32d-544d-b536-6725b39e76ee, identifier: 116788960
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117661782
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661782%27 HTTP/1.1" 200 None
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117661782: 1
2025-12-02 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb with identifier: 117544347
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-02 19:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2025-12-02 19:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb with identifier: 117544347
2025-12-02 19:00:22 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb with expiration date: 2025-12-02T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'af1b7b79-1076-5bb8-a5a5-1c9d6b0d11cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KP23PXT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117544347',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'CUPRA',
 'model': 'BORN ELECTRIC HATCHBACK',
 'odometer': 36615,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': 'Zenith',
 'title': 'CUPRA BORN ELECTRIC HATCHBACK 150kW V3 58kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW V3 58kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544347%27 HTTP/1.1" 200 None
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Saving data for 117544347: {'auction_closing_time': 1764669600.0, 'created_time': 1764356704.536813, 'last_price_update_time': 1764702022.651587}
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117544347') HTTP/1.1" 204 0
2025-12-02 19:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2250c9ea-d32d-544d-b536-6725b39e76ee with identifier: 116788960
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-02 19:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2250c9ea-d32d-544d-b536-6725b39e76ee with identifier: 116788960
2025-12-02 19:00:22 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 2250c9ea-d32d-544d-b536-6725b39e76ee with expiration date: 2025-12-02T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2250c9ea-d32d-544d-b536-6725b39e76ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VK70ENO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116788960',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 96174,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI Style 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI Style 5dr',
 'vin': None,
 'year': 2020}
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116788960%27 HTTP/1.1" 200 None
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Saving data for 116788960: {'auction_closing_time': 1764669600.0, 'created_time': 1764356787.282411, 'last_price_update_time': 1764702022.858732}
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116788960') HTTP/1.1" 204 0
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117508089
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508089%27 HTTP/1.1" 200 None
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117508089: 0
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117508080
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508080%27 HTTP/1.1" 200 None
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117508080: 0
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117243027
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243027%27 HTTP/1.1" 200 None
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117243027: 0
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116671419
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116671419%27 HTTP/1.1" 200 None
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116671419: 0
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117131404
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131404%27 HTTP/1.1" 200 None
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117131404: 0
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117660087
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660087%27 HTTP/1.1" 200 None
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117660087: 1
2025-12-02 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117459104?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117581980, 'registration': 'NL16YTF', 'account': 'STA058', 'make': 'FORD', 'model': 'FIESTA HATCHBACK SPECIAL EDITIONS', 'derivative': '1.0 EcoBoost 140 Zetec S Red 3dr', 'mileage': 73671, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-02T10:00Z', 'lot': 191, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-04-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-12', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL16YTF/2025-11-28/image/4e9679e4-bea7-420f-817e-1da5cdccde3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/0f7c056a-7504-47ff-ad99-25c763b9576c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/a237374e-0f5c-4208-909f-26b5978d36dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/e3d37695-b606-4412-8fed-37d0f1a8f129_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/c2d3a6ae-8482-4ba4-918e-63ac41c85b0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/2378f734-2368-4249-be4f-e327e614f84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/0c8d05a4-577c-49be-b3de-9a60be1b02d4_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '05/17-13K, 05/18-19K, 04/19-23K, 06/20-32K, 09/21-48K, 11/22-55K, 04/23-58K, 03/24-64K', 'remarks': 'VOSA STATES 23K 34K 48K 56K 58K 64K 68K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a601dde-279d-43c7-a458-64f4baf3b771.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117581980, 'registration': 'NL16YTF', 'account': 'STA058', 'make': 'FORD', 'model': 'FIESTA HATCHBACK SPECIAL EDITIONS', 'derivative': '1.0 EcoBoost 140 Zetec S Red 3dr', 'mileage': 73671, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-02T10:00Z', 'lot': 191, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-04-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-12', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL16YTF/2025-11-28/image/4e9679e4-bea7-420f-817e-1da5cdccde3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/0f7c056a-7504-47ff-ad99-25c763b9576c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/a237374e-0f5c-4208-909f-26b5978d36dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/e3d37695-b606-4412-8fed-37d0f1a8f129_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/c2d3a6ae-8482-4ba4-918e-63ac41c85b0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/2378f734-2368-4249-be4f-e327e614f84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16YTF/2025-11-28/image/0c8d05a4-577c-49be-b3de-9a60be1b02d4_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '05/17-13K, 05/18-19K, 04/19-23K, 06/20-32K, 09/21-48K, 11/22-55K, 04/23-58K, 03/24-64K', 'remarks': 'VOSA STATES 23K 34K 48K 56K 58K 64K 68K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a601dde-279d-43c7-a458-64f4baf3b771.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with identifier: 117581980
2025-12-02 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with scrape type 2
2025-12-02 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with scrape type 2
2025-12-02 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6a036d9a-b3d7-57e0-af40-e9512ae760d5, identifier: 117581980
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117447500, 'registration': 'LB71HGP', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 63510, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 142, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-29', 'fuel': 'Electric', 'motExpiry': '2026-11-28', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LB71HGP/2025-11-27/image/8bdee490-8106-4677-8904-668ef3984f42_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/55483dac-2cfe-4e8c-8472-f9f242765603_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/be52835a-01ed-41da-bf51-f1535c76287b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/f0512e11-83ee-46b5-a1e8-cbbed40ebbe2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/14409b77-ef04-4c65-a95f-554551d65125_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/7db1a87b-c6fb-4b48-880d-6068f5b73020_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/6d624217-e7d9-40ba-acb5-0119c7430a0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/65289444-72fa-4c04-adc5-6f063fa02396_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/5ee34554-a74e-4e73-a754-44495f3f6314_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/9cbe0d28-bd39-403c-8962-ccc8b29351ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/01dfe1ce-5abc-4747-99e2-be4c283d76d4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4aed4d1a-dd03-46da-8e02-504d010e9121.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117447500, 'registration': 'LB71HGP', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 63510, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 142, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-29', 'fuel': 'Electric', 'motExpiry': '2026-11-28', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LB71HGP/2025-11-27/image/8bdee490-8106-4677-8904-668ef3984f42_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/55483dac-2cfe-4e8c-8472-f9f242765603_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/be52835a-01ed-41da-bf51-f1535c76287b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/f0512e11-83ee-46b5-a1e8-cbbed40ebbe2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/14409b77-ef04-4c65-a95f-554551d65125_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/7db1a87b-c6fb-4b48-880d-6068f5b73020_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/6d624217-e7d9-40ba-acb5-0119c7430a0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/65289444-72fa-4c04-adc5-6f063fa02396_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/5ee34554-a74e-4e73-a754-44495f3f6314_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/9cbe0d28-bd39-403c-8962-ccc8b29351ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71HGP/2025-11-27/image/01dfe1ce-5abc-4747-99e2-be4c283d76d4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4aed4d1a-dd03-46da-8e02-504d010e9121.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ae0022f-4c40-5c88-a00a-b00a791fcf1d with identifier: 117447500
2025-12-02 19:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae0022f-4c40-5c88-a00a-b00a791fcf1d with scrape type 2
2025-12-02 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ae0022f-4c40-5c88-a00a-b00a791fcf1d with scrape type 2
2025-12-02 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1ae0022f-4c40-5c88-a00a-b00a791fcf1d, identifier: 117447500
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117405887, 'registration': 'BK23DJY', 'account': 'ZEN002', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW M Sport Pro 80kWh 5dr Auto', 'mileage': 66762, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 144, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-03-09', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BK23DJY/2025-11-26/image/3b7ac164-9e84-4926-8a1f-febf463175e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/fd664b08-7e4c-42db-b0fe-03cd20cf176d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/8e0a4cdb-5865-4a72-bbd3-0523f39cdef4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/0f80c40d-98f8-4034-88fa-69bf08067aa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/0e6f7f84-d3a4-4797-8755-63fe3539c332_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/3994643a-8bb9-4777-a2a1-a8f3db3fbf8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/36812a72-8697-4075-b730-2727e7852fa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/44c111e2-7eab-47a7-902a-759af7a44cd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/1bd2c547-f9e4-46d1-8830-38f350889713_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/d34d1d46-a7b3-4122-a0de-fe03d164adcd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital iDRIVE @ 2/25 49K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3e0abf01-a0d4-45f8-bf04-3b490417136d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117405887, 'registration': 'BK23DJY', 'account': 'ZEN002', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW M Sport Pro 80kWh 5dr Auto', 'mileage': 66762, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 144, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-03-09', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BK23DJY/2025-11-26/image/3b7ac164-9e84-4926-8a1f-febf463175e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/fd664b08-7e4c-42db-b0fe-03cd20cf176d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/8e0a4cdb-5865-4a72-bbd3-0523f39cdef4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/0f80c40d-98f8-4034-88fa-69bf08067aa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/0e6f7f84-d3a4-4797-8755-63fe3539c332_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/3994643a-8bb9-4777-a2a1-a8f3db3fbf8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/36812a72-8697-4075-b730-2727e7852fa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/44c111e2-7eab-47a7-902a-759af7a44cd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/1bd2c547-f9e4-46d1-8830-38f350889713_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK23DJY/2025-11-26/image/d34d1d46-a7b3-4122-a0de-fe03d164adcd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital iDRIVE @ 2/25 49K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3e0abf01-a0d4-45f8-bf04-3b490417136d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca8f9727-c9b2-5930-b59c-a27038a9f8f4 with identifier: 117405887
2025-12-02 19:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca8f9727-c9b2-5930-b59c-a27038a9f8f4 with scrape type 2
2025-12-02 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca8f9727-c9b2-5930-b59c-a27038a9f8f4 with scrape type 2
2025-12-02 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ca8f9727-c9b2-5930-b59c-a27038a9f8f4, identifier: 117405887
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117422764, 'registration': 'AK72ZSF', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'RWD 4dr Auto', 'mileage': 71853, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 146, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-24', 'fuel': 'Electric', 'motExpiry': '2026-11-23', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/bb9005e7-71ed-469b-8171-5367af0b176b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/2990d2d8-05bb-4ac3-b94e-8597518bf23a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/ec7584b8-d6b0-4ffb-b1ca-0ddb0c7114a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/faf3574c-563a-4cec-9792-51b2281dd8d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/15e74153-ad2d-43e7-8af8-27def7d3c4a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/e2b1b70f-c6c1-4690-9a70-5dca8fbc55b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/537a9fba-7929-46ac-9b73-98d7e5fd4b20_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/144c9084-dd51-4e18-b0b9-f06f1bff45ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/86d36ebc-da08-4260-a7d9-8cff212c2324_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/4d671376-8b65-4d2f-af60-d8b4fa84055b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93eb3436-3486-4082-a755-6fb74e12bfbc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117422764, 'registration': 'AK72ZSF', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'RWD 4dr Auto', 'mileage': 71853, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 146, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-24', 'fuel': 'Electric', 'motExpiry': '2026-11-23', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/bb9005e7-71ed-469b-8171-5367af0b176b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/2990d2d8-05bb-4ac3-b94e-8597518bf23a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/ec7584b8-d6b0-4ffb-b1ca-0ddb0c7114a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/faf3574c-563a-4cec-9792-51b2281dd8d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/15e74153-ad2d-43e7-8af8-27def7d3c4a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/e2b1b70f-c6c1-4690-9a70-5dca8fbc55b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/537a9fba-7929-46ac-9b73-98d7e5fd4b20_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/144c9084-dd51-4e18-b0b9-f06f1bff45ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/86d36ebc-da08-4260-a7d9-8cff212c2324_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK72ZSF/2025-11-26/image/4d671376-8b65-4d2f-af60-d8b4fa84055b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print BLANK PRINT', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93eb3436-3486-4082-a755-6fb74e12bfbc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff812ca-5229-5588-8958-cf0b1796e5b9 with identifier: 117422764
2025-12-02 19:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff812ca-5229-5588-8958-cf0b1796e5b9 with scrape type 2
2025-12-02 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff812ca-5229-5588-8958-cf0b1796e5b9 with scrape type 2
2025-12-02 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dff812ca-5229-5588-8958-cf0b1796e5b9, identifier: 117422764
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116804294, 'registration': 'BD71HGA', 'account': 'ZEN002', 'make': 'VOLVO', 'model': 'XC40 ELECTRIC ESTATE', 'derivative': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto', 'mileage': 86623, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 105, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-24', 'fuel': 'Electric', 'motExpiry': '2026-10-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BD71HGA/2025-11-26/image/0a69ae9e-4be1-47e1-aae8-7453cc54e03e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/3aecbdbc-290e-4c32-90d0-d728e5a53ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/fbfc5eeb-ee4c-4467-963f-fd26dc3ff58d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/7b93aa47-1fdc-48c3-aa9b-b99c18913f3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/a5794141-1917-4c5e-b765-d24e533cf691_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/025a2f13-7aea-47c7-a18b-0787679858ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/711a3cad-5516-439e-a4d8-26cdb3d88d5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/965d70c9-7571-4b59-acf8-4cfd1b15a835_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/e9bf5097-6122-4d21-b8b0-25e7b970edca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/ca98bcc6-a4ab-467f-aefb-93aeaeeabb52_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book BOOK @ 11/22 17K, 10/23 37K, 8/24 57K, PRINT @ 11/22 17K, 10/23 37K, 6/25 77K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f74c933-1611-49b2-91c9-812e0c01505e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116804294, 'registration': 'BD71HGA', 'account': 'ZEN002', 'make': 'VOLVO', 'model': 'XC40 ELECTRIC ESTATE', 'derivative': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto', 'mileage': 86623, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 105, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-24', 'fuel': 'Electric', 'motExpiry': '2026-10-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BD71HGA/2025-11-26/image/0a69ae9e-4be1-47e1-aae8-7453cc54e03e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/3aecbdbc-290e-4c32-90d0-d728e5a53ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/fbfc5eeb-ee4c-4467-963f-fd26dc3ff58d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/7b93aa47-1fdc-48c3-aa9b-b99c18913f3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/a5794141-1917-4c5e-b765-d24e533cf691_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/025a2f13-7aea-47c7-a18b-0787679858ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/711a3cad-5516-439e-a4d8-26cdb3d88d5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/965d70c9-7571-4b59-acf8-4cfd1b15a835_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/e9bf5097-6122-4d21-b8b0-25e7b970edca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD71HGA/2025-11-26/image/ca98bcc6-a4ab-467f-aefb-93aeaeeabb52_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book BOOK @ 11/22 17K, 10/23 37K, 8/24 57K, PRINT @ 11/22 17K, 10/23 37K, 6/25 77K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f74c933-1611-49b2-91c9-812e0c01505e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55b15e98-4607-5d69-9d5f-9fa39d614d31 with identifier: 116804294
2025-12-02 19:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b15e98-4607-5d69-9d5f-9fa39d614d31 with scrape type 2
2025-12-02 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55b15e98-4607-5d69-9d5f-9fa39d614d31 with scrape type 2
2025-12-02 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 55b15e98-4607-5d69-9d5f-9fa39d614d31, identifier: 116804294
2025-12-02 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with identifier: 117581980
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-02 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with identifier: 117581980
2025-12-02 19:00:23 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 6a036d9a-b3d7-57e0-af40-e9512ae760d5 with expiration date: 2025-12-02T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6a036d9a-b3d7-57e0-af40-e9512ae760d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL16YTF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117581980',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK SPECIAL EDITIONS',
 'odometer': 73671,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'FORD FIESTA HATCHBACK SPECIAL EDITIONS 1.0 EcoBoost 140 Zetec S Red '
          '3dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 140 Zetec S Red 3dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581980%27 HTTP/1.1" 200 None
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Saving data for 117581980: {'auction_closing_time': 1764669600.0, 'created_time': 1764356497.124503, 'last_price_update_time': 1764702023.62171}
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117581980') HTTP/1.1" 204 0
2025-12-02 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1ae0022f-4c40-5c88-a00a-b00a791fcf1d with identifier: 117447500
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-02 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1ae0022f-4c40-5c88-a00a-b00a791fcf1d with identifier: 117447500
2025-12-02 19:00:23 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 1ae0022f-4c40-5c88-a00a-b00a791fcf1d with expiration date: 2025-12-02T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '1ae0022f-4c40-5c88-a00a-b00a791fcf1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LB71HGP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117447500',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 63510,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447500%27 HTTP/1.1" 200 None
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Saving data for 117447500: {'auction_closing_time': 1764669600.0, 'created_time': 1764356708.564733, 'last_price_update_time': 1764702023.837974}
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117447500') HTTP/1.1" 204 0
2025-12-02 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ca8f9727-c9b2-5930-b59c-a27038a9f8f4 with identifier: 117405887
2025-12-02 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ca8f9727-c9b2-5930-b59c-a27038a9f8f4 with identifier: 117405887
2025-12-02 19:00:23 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: ca8f9727-c9b2-5930-b59c-a27038a9f8f4 with expiration date: 2025-12-02T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'ca8f9727-c9b2-5930-b59c-a27038a9f8f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BK23DJY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405887',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'BMW',
 'model': 'iX3 ELECTRIC ESTATE',
 'odometer': 66762,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-09',
 'seller_name': 'Zenith',
 'title': 'BMW iX3 ELECTRIC ESTATE 210kW M Sport Pro 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '210kW M Sport Pro 80kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405887%27 HTTP/1.1" 200 None
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Saving data for 117405887: {'auction_closing_time': 1764669600.0, 'created_time': 1764356708.800155, 'last_price_update_time': 1764702023.870524}
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117405887') HTTP/1.1" 204 0
2025-12-02 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dff812ca-5229-5588-8958-cf0b1796e5b9 with identifier: 117422764
2025-12-02 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dff812ca-5229-5588-8958-cf0b1796e5b9 with identifier: 117422764
2025-12-02 19:00:23 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: dff812ca-5229-5588-8958-cf0b1796e5b9 with expiration date: 2025-12-02T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'dff812ca-5229-5588-8958-cf0b1796e5b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AK72ZSF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117422764',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 71853,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-24',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON RWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'RWD 4dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422764%27 HTTP/1.1" 200 None
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Saving data for 117422764: {'auction_closing_time': 1764669600.0, 'created_time': 1764356598.52227, 'last_price_update_time': 1764702023.943045}
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117422764') HTTP/1.1" 204 0
2025-12-02 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 55b15e98-4607-5d69-9d5f-9fa39d614d31 with identifier: 116804294
2025-12-02 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 55b15e98-4607-5d69-9d5f-9fa39d614d31 with identifier: 116804294
2025-12-02 19:00:23 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 55b15e98-4607-5d69-9d5f-9fa39d614d31 with expiration date: 2025-12-02T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '55b15e98-4607-5d69-9d5f-9fa39d614d31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BD71HGA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116804294',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VOLVO',
 'model': 'XC40 ELECTRIC ESTATE',
 'odometer': 86623,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seller_name': 'Zenith',
 'title': 'VOLVO XC40 ELECTRIC ESTATE 300kW Recharge Twin Pro 78kWh 5dr AWD '
          'Auto',
 'transmission': 'automatic',
 'trim': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116804294%27 HTTP/1.1" 200 None
2025-12-02 19:00:23 [astonbarclay.gb] INFO: Saving data for 116804294: {'auction_closing_time': 1764669600.0, 'created_time': 1764356712.259756, 'last_price_update_time': 1764702023.979571}
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116804294') HTTP/1.1" 204 0
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117175645
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175645%27 HTTP/1.1" 200 None
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117175645: 0
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117424383
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424383%27 HTTP/1.1" 200 None
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117424383: 2
2025-12-02 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507922?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117572022?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117131550
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131550%27 HTTP/1.1" 200 None
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117131550: 0
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117424304
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424304%27 HTTP/1.1" 200 None
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117424304: 2
2025-12-02 19:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117459104, 'registration': 'FP72AZF', 'account': 'STE131', 'make': 'CITROEN', 'model': 'C3 AIRCROSS HATCHBACK (RC)', 'derivative': '1.2 PureTech 110 Shine 5dr', 'mileage': 15332, 'mileageWarranty': False, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 301, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-10-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP72AZF/2025-11-26/image/b0748a02-c759-4314-bf14-114f5e7a8689_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/1b30cbf5-aa05-4cd7-a548-43378a927775_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/0371873d-112a-4ee3-a01b-5183f4ba207b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/45d4496e-28d0-498d-aedc-ec50e3ef462f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/74f6d7da-bd6e-4cb6-91d6-00e1a19907e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/d4b9b63f-01a1-4f61-8d53-2555cad3e2fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/ba76cb86-b9db-4408-b816-befaecb6f0c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/99e08403-2712-4078-bb39-6bcb4a8a5e95_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/5ef66942-38b6-434d-aca4-6ab673218ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/9041c30d-8c93-4cef-8bed-80b1c8edb120_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/e1dabc2b-83e6-43de-844c-3ec43b189e16_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/2cc33883-f81b-49bc-955d-3bc6155f44ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/8c13a3b0-6ecd-4341-bf30-a66fa5529136_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 10/23 9K 10/24 10K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d768c999-864a-4910-aa7b-e1ecef71b7fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117459104, 'registration': 'FP72AZF', 'account': 'STE131', 'make': 'CITROEN', 'model': 'C3 AIRCROSS HATCHBACK (RC)', 'derivative': '1.2 PureTech 110 Shine 5dr', 'mileage': 15332, 'mileageWarranty': False, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 301, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-10-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP72AZF/2025-11-26/image/b0748a02-c759-4314-bf14-114f5e7a8689_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/1b30cbf5-aa05-4cd7-a548-43378a927775_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/0371873d-112a-4ee3-a01b-5183f4ba207b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/45d4496e-28d0-498d-aedc-ec50e3ef462f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/74f6d7da-bd6e-4cb6-91d6-00e1a19907e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/d4b9b63f-01a1-4f61-8d53-2555cad3e2fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/ba76cb86-b9db-4408-b816-befaecb6f0c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/99e08403-2712-4078-bb39-6bcb4a8a5e95_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/5ef66942-38b6-434d-aca4-6ab673218ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/9041c30d-8c93-4cef-8bed-80b1c8edb120_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/e1dabc2b-83e6-43de-844c-3ec43b189e16_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/2cc33883-f81b-49bc-955d-3bc6155f44ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP72AZF/2025-11-26/image/8c13a3b0-6ecd-4341-bf30-a66fa5529136_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 10/23 9K 10/24 10K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d768c999-864a-4910-aa7b-e1ecef71b7fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 349c4d6c-f50a-5e6d-bc25-c14445cedeac with identifier: 117459104
2025-12-02 19:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 349c4d6c-f50a-5e6d-bc25-c14445cedeac with scrape type 2
2025-12-02 19:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 349c4d6c-f50a-5e6d-bc25-c14445cedeac with scrape type 2
2025-12-02 19:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 349c4d6c-f50a-5e6d-bc25-c14445cedeac, identifier: 117459104
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117051310
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117051310%27 HTTP/1.1" 200 None
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117051310: 0
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117507998
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507998%27 HTTP/1.1" 200 None
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117507998: 1
2025-12-02 19:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 349c4d6c-f50a-5e6d-bc25-c14445cedeac with identifier: 117459104
2025-12-02 19:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 349c4d6c-f50a-5e6d-bc25-c14445cedeac with identifier: 117459104
2025-12-02 19:00:24 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 349c4d6c-f50a-5e6d-bc25-c14445cedeac with expiration date: 2025-12-02T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '349c4d6c-f50a-5e6d-bc25-c14445cedeac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FP72AZF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117459104',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'CITROEN',
 'model': 'C3 AIRCROSS HATCHBACK (RC)',
 'odometer': 15332,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'CITROEN C3 AIRCROSS HATCHBACK (RC) 1.2 PureTech 110 Shine 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 110 Shine 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459104%27 HTTP/1.1" 200 None
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Saving data for 117459104: {'auction_closing_time': 1764669600.0, 'created_time': 1764356508.652316, 'last_price_update_time': 1764702024.262073}
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117459104') HTTP/1.1" 204 0
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117175584
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175584%27 HTTP/1.1" 200 None
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117175584: 0
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117424411
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424411%27 HTTP/1.1" 200 None
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117424411: 2
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117507922, 'registration': 'LF20YOT', 'account': 'WIL004', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 GDi Premium 5dr 2WD', 'mileage': 39066, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 401, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-03-20', 'fuel': 'Petrol', 'motExpiry': '2026-03-21', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LF20YOT/2025-11-27/image/eb351ef8-5ed1-4df0-9fcb-77dd95370d8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/8811ce2c-4522-4aa8-a3f4-67f8aeed9563_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/a17a3315-f23f-42f4-89a8-ed545a6cb218_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/46f9f763-9b6b-4f6e-b31b-587f3677772f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/49c4caf7-e10e-46d7-8448-cd09575245d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/8a8d4672-5368-4208-b02b-22024545c1eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/785383ee-227e-4b0d-94f8-c6db3582ed68_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/494d2044-6654-40a8-b349-0d8d37eee06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/4946d4c1-65c4-4299-84b6-34345542e6dc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 01/22 3K 01/23 12K 04/25 31K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d3ce837-366c-424b-9885-1ae5139a2f3b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117507922, 'registration': 'LF20YOT', 'account': 'WIL004', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 GDi Premium 5dr 2WD', 'mileage': 39066, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-02T10:00Z', 'lot': 401, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-03-20', 'fuel': 'Petrol', 'motExpiry': '2026-03-21', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LF20YOT/2025-11-27/image/eb351ef8-5ed1-4df0-9fcb-77dd95370d8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/8811ce2c-4522-4aa8-a3f4-67f8aeed9563_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/a17a3315-f23f-42f4-89a8-ed545a6cb218_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/46f9f763-9b6b-4f6e-b31b-587f3677772f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/49c4caf7-e10e-46d7-8448-cd09575245d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/8a8d4672-5368-4208-b02b-22024545c1eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/785383ee-227e-4b0d-94f8-c6db3582ed68_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/494d2044-6654-40a8-b349-0d8d37eee06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF20YOT/2025-11-27/image/4946d4c1-65c4-4299-84b6-34345542e6dc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 01/22 3K 01/23 12K 04/25 31K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d3ce837-366c-424b-9885-1ae5139a2f3b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f136d4-69ee-5979-8eda-f19240210d9e with identifier: 117507922
2025-12-02 19:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f136d4-69ee-5979-8eda-f19240210d9e with scrape type 2
2025-12-02 19:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04f136d4-69ee-5979-8eda-f19240210d9e with scrape type 2
2025-12-02 19:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 04f136d4-69ee-5979-8eda-f19240210d9e, identifier: 117507922
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117572022, 'registration': 'YF21WWL', 'account': 'SPR003', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 EcoBlue 190 ST-Line X Edition 5dr Auto AWD', 'mileage': 54055, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-02T13:00Z', 'lot': 101, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-03-17', 'fuel': 'Diesel', 'motExpiry': '2026-03-16', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF21WWL/2025-11-28/image/6b5ffac8-6c89-4b8c-ab25-6672d9c0c5cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/394afe52-a59a-4307-b5b3-933eac5784b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/77c089eb-1235-4f3b-9030-37affdeb6ad2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/b13cd85f-a106-454a-83d5-c73fdcf5799e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/dcda9db5-a622-4e3b-9322-7abbb397de16_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/7c87de94-a535-424f-a60d-102a2c9bc373_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/3f312796-dc46-45ef-806d-aa14b61bef8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/f282de87-dcb0-4be1-8a00-1c146c898ba5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/8987cbb4-1cb1-42fa-b47c-c5f56e3bc6ba_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/22 - 17K, 11/25 - 53K', 'remarks': '**617**VOSA STATES 32K, 45K', 'virtual': False, 'seller': 'Ford Main Dealer', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a6ec542-62ce-483a-a1a0-0ce92579eb5f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117572022, 'registration': 'YF21WWL', 'account': 'SPR003', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 EcoBlue 190 ST-Line X Edition 5dr Auto AWD', 'mileage': 54055, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-02T13:00Z', 'lot': 101, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-03-17', 'fuel': 'Diesel', 'motExpiry': '2026-03-16', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF21WWL/2025-11-28/image/6b5ffac8-6c89-4b8c-ab25-6672d9c0c5cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/394afe52-a59a-4307-b5b3-933eac5784b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/77c089eb-1235-4f3b-9030-37affdeb6ad2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/b13cd85f-a106-454a-83d5-c73fdcf5799e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/dcda9db5-a622-4e3b-9322-7abbb397de16_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/7c87de94-a535-424f-a60d-102a2c9bc373_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/3f312796-dc46-45ef-806d-aa14b61bef8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/f282de87-dcb0-4be1-8a00-1c146c898ba5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF21WWL/2025-11-28/image/8987cbb4-1cb1-42fa-b47c-c5f56e3bc6ba_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/22 - 17K, 11/25 - 53K', 'remarks': '**617**VOSA STATES 32K, 45K', 'virtual': False, 'seller': 'Ford Main Dealer', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a6ec542-62ce-483a-a1a0-0ce92579eb5f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with identifier: 117572022
2025-12-02 19:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with scrape type 2
2025-12-02 19:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with scrape type 2
2025-12-02 19:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193, identifier: 117572022
2025-12-02 19:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 04f136d4-69ee-5979-8eda-f19240210d9e with identifier: 117507922
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-02 19:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 04f136d4-69ee-5979-8eda-f19240210d9e with identifier: 117507922
2025-12-02 19:00:24 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 04f136d4-69ee-5979-8eda-f19240210d9e with expiration date: 2025-12-02T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '04f136d4-69ee-5979-8eda-f19240210d9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LF20YOT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507922',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 39066,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-20',
 'seller_name': 'Wilsons',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 GDi Premium 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 GDi Premium 5dr 2WD',
 'vin': None,
 'year': 2020}
2025-12-02 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507922%27 HTTP/1.1" 200 None
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Saving data for 117507922: {'auction_closing_time': 1764669600.0, 'created_time': 1764234057.96949, 'last_price_update_time': 1764702025.004263}
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507922') HTTP/1.1" 204 0
2025-12-02 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with identifier: 117572022
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-02 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with identifier: 117572022
2025-12-02 19:00:25 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 0906a1b6-7b1a-50a4-bcd4-6c0591e2d193 with expiration date: 2025-12-02T13:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '0906a1b6-7b1a-50a4-bcd4-6c0591e2d193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YF21WWL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117572022',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 54055,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-17',
 'seller_name': 'Ford Main Dealer',
 'title': 'FORD KUGA DIESEL ESTATE 2.0 EcoBlue 190 ST-Line X Edition 5dr Auto '
          'AWD',
 'transmission': 'automatic',
 'trim': '2.0 EcoBlue 190 ST-Line X Edition 5dr Auto AWD',
 'vin': None,
 'year': 2021}
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572022%27 HTTP/1.1" 200 None
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Saving data for 117572022: {'auction_closing_time': 1764680400.0, 'created_time': 1764356608.714095, 'last_price_update_time': 1764702025.193552}
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117572022') HTTP/1.1" 204 0
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117600033
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600033%27 HTTP/1.1" 200 None
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117600033: 1
2025-12-02 19:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117571999?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116981133?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117242983
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242983%27 HTTP/1.1" 200 None
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117242983: 0
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117507965
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507965%27 HTTP/1.1" 200 None
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117507965: 1
2025-12-02 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117551156?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117599013?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117433630?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117507988
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507988%27 HTTP/1.1" 200 None
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117507988: 1
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117243071
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243071%27 HTTP/1.1" 200 None
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117243071: 0
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117131446
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131446%27 HTTP/1.1" 200 None
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117131446: 0
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117123611
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117123611%27 HTTP/1.1" 200 None
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117123611: 0
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117634478
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634478%27 HTTP/1.1" 200 None
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117634478: 1
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117571999, 'registration': 'AO16UXP', 'account': 'SPR003', 'make': 'SKODA', 'model': 'CITIGO HATCHBACK', 'derivative': '1.0 MPI Monte Carlo 5dr', 'mileage': 44129, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-02T13:00Z', 'lot': 103, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-05-27', 'fuel': 'Petrol', 'motExpiry': '2026-12-04', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO16UXP/2025-11-28/image/02544ac6-c73a-4bd1-96fe-5f75ddc3bb1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/1179c63a-30fc-4328-8e3b-9194a963e16d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/61b1a491-9b65-40b3-8288-cc4a9e4f707d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/9e5780a1-8f8d-45a3-b681-32466292755b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/7fdfd29f-3c1c-4f83-9575-87de6a152b3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/9e79f7a0-a657-4638-9d4e-0721eff5cb44_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/c50dfbd0-3138-4d93-b848-6cfb4a88ca04_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/839b97e5-cd6e-4733-960a-d99a89d412fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/d4dc3b24-51b2-466a-b27c-283cae71b27d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/17 - 3K, 11/23 - 34K,', 'remarks': '**616**VOSA STATES 13K, 20K, 24K, 29K, 34K, 39K, 44K', 'virtual': False, 'seller': 'Ford Main Dealer', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7af16d40-723a-418c-b19b-95047ab6bbcd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117571999, 'registration': 'AO16UXP', 'account': 'SPR003', 'make': 'SKODA', 'model': 'CITIGO HATCHBACK', 'derivative': '1.0 MPI Monte Carlo 5dr', 'mileage': 44129, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-02T13:00Z', 'lot': 103, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-05-27', 'fuel': 'Petrol', 'motExpiry': '2026-12-04', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO16UXP/2025-11-28/image/02544ac6-c73a-4bd1-96fe-5f75ddc3bb1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/1179c63a-30fc-4328-8e3b-9194a963e16d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/61b1a491-9b65-40b3-8288-cc4a9e4f707d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/9e5780a1-8f8d-45a3-b681-32466292755b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/7fdfd29f-3c1c-4f83-9575-87de6a152b3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/9e79f7a0-a657-4638-9d4e-0721eff5cb44_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/c50dfbd0-3138-4d93-b848-6cfb4a88ca04_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/839b97e5-cd6e-4733-960a-d99a89d412fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16UXP/2025-11-28/image/d4dc3b24-51b2-466a-b27c-283cae71b27d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/17 - 3K, 11/23 - 34K,', 'remarks': '**616**VOSA STATES 13K, 20K, 24K, 29K, 34K, 39K, 44K', 'virtual': False, 'seller': 'Ford Main Dealer', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7af16d40-723a-418c-b19b-95047ab6bbcd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 116cf5fe-abf4-52fb-8573-3a03228655a2 with identifier: 117571999
2025-12-02 19:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 116cf5fe-abf4-52fb-8573-3a03228655a2 with scrape type 2
2025-12-02 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 116cf5fe-abf4-52fb-8573-3a03228655a2 with scrape type 2
2025-12-02 19:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 116cf5fe-abf4-52fb-8573-3a03228655a2, identifier: 117571999
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116981133, 'registration': 'MV17ZKO', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'CLA DIESEL COUPE', 'derivative': 'CLA 220d AMG Line 4Matic 4dr Tip Auto', 'mileage': 41219, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-02T13:00Z', 'lot': 125, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-10-13', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/d2deee09-d08f-4400-addf-a173244627ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/b774ea3c-5561-4a53-8de4-f7b7d0e0ca16_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/a773b3d1-7d62-4c2d-b503-087c004f9300_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/44b8ae0a-7f6b-4fa1-bd56-05317a938037_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/3a8c1275-5fd3-4192-a046-38dafcdf57c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/846edb77-1025-45d9-8a50-e417966f8833_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/f8c10ede-0bea-405b-8c2a-1f927945f24b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/afcafba4-b5c5-4a5b-bdbb-054530084338_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/84c1b441-4646-4a68-a81e-b32fd062a8bb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1936**VOSA STATES 23K, 24K, 26K, 34K, 40K, 41K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ed332bc9-9e9f-4b6f-8f9c-b93022f56714.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116981133, 'registration': 'MV17ZKO', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'CLA DIESEL COUPE', 'derivative': 'CLA 220d AMG Line 4Matic 4dr Tip Auto', 'mileage': 41219, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-02T13:00Z', 'lot': 125, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-10-13', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/d2deee09-d08f-4400-addf-a173244627ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/b774ea3c-5561-4a53-8de4-f7b7d0e0ca16_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/a773b3d1-7d62-4c2d-b503-087c004f9300_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/44b8ae0a-7f6b-4fa1-bd56-05317a938037_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/3a8c1275-5fd3-4192-a046-38dafcdf57c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/846edb77-1025-45d9-8a50-e417966f8833_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/f8c10ede-0bea-405b-8c2a-1f927945f24b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/afcafba4-b5c5-4a5b-bdbb-054530084338_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV17ZKO/2025-11-05/image/84c1b441-4646-4a68-a81e-b32fd062a8bb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1936**VOSA STATES 23K, 24K, 26K, 34K, 40K, 41K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ed332bc9-9e9f-4b6f-8f9c-b93022f56714.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bf6aad3-32f3-5310-a1a5-2f52226621a3 with identifier: 116981133
2025-12-02 19:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bf6aad3-32f3-5310-a1a5-2f52226621a3 with scrape type 2
2025-12-02 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bf6aad3-32f3-5310-a1a5-2f52226621a3 with scrape type 2
2025-12-02 19:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0bf6aad3-32f3-5310-a1a5-2f52226621a3, identifier: 116981133
2025-12-02 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 116cf5fe-abf4-52fb-8573-3a03228655a2 with identifier: 117571999
2025-12-02 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 116cf5fe-abf4-52fb-8573-3a03228655a2 with identifier: 117571999
2025-12-02 19:00:25 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 116cf5fe-abf4-52fb-8573-3a03228655a2 with expiration date: 2025-12-02T13:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '116cf5fe-abf4-52fb-8573-3a03228655a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AO16UXP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117571999',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'SKODA',
 'model': 'CITIGO HATCHBACK',
 'odometer': 44129,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-27',
 'seller_name': 'Ford Main Dealer',
 'title': 'SKODA CITIGO HATCHBACK 1.0 MPI Monte Carlo 5dr',
 'transmission': 'manual',
 'trim': '1.0 MPI Monte Carlo 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571999%27 HTTP/1.1" 200 None
2025-12-02 19:00:25 [astonbarclay.gb] INFO: Saving data for 117571999: {'auction_closing_time': 1764680400.0, 'created_time': 1764356519.157809, 'last_price_update_time': 1764702025.643519}
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117571999') HTTP/1.1" 204 0
2025-12-02 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0bf6aad3-32f3-5310-a1a5-2f52226621a3 with identifier: 116981133
2025-12-02 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0bf6aad3-32f3-5310-a1a5-2f52226621a3 with identifier: 116981133
2025-12-02 19:00:25 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 0bf6aad3-32f3-5310-a1a5-2f52226621a3 with expiration date: 2025-12-02T13:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '0bf6aad3-32f3-5310-a1a5-2f52226621a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MV17ZKO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116981133',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA DIESEL COUPE',
 'odometer': 41219,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': 'Mann Island Finance',
 'title': 'MERCEDES-BENZ CLA DIESEL COUPE CLA 220d AMG Line 4Matic 4dr Tip '
          'Auto',
 'transmission': 'automatic',
 'trim': 'CLA 220d AMG Line 4Matic 4dr Tip Auto',
 'vin': None,
 'year': 2017}
2025-12-02 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116981133%27 HTTP/1.1" 200 None
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Saving data for 116981133: {'auction_closing_time': 1764680400.0, 'created_time': 1763406157.484836, 'last_price_update_time': 1764702026.192568}
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116981133') HTTP/1.1" 204 0
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117634427
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634427%27 HTTP/1.1" 200 None
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117634427: 1
2025-12-02 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117331639?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117634437
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634437%27 HTTP/1.1" 200 None
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117634437: 1
2025-12-02 19:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662383?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117551156, 'registration': 'GX17XZH', 'account': 'NUN002', 'make': 'MAZDA', 'model': 'CX-5 ESTATE', 'derivative': '2.0 Sport Nav 5dr', 'mileage': 117064, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-02T13:00Z', 'lot': 133, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-13', 'fuel': 'Petrol', 'motExpiry': '2026-05-26', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX17XZH/2025-12-01/image/a383ae95-4c5e-4c42-992d-a8ab4b3bed16_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/88937c41-4fb4-4b06-9795-6970a40f6911_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/8675d622-bb63-4f28-b011-ac6739897227_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/f76829e6-5f5a-47e9-a06b-5c3d1e7255e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/1723056f-0794-44a9-90ba-470fe83fc19b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/f7d2e8bb-9988-4b98-8796-41b53799c560_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/0ab6ef0d-3447-4a7e-84c6-27ab5df681ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/55567941-35ab-4e6c-9c40-2bae3f0ab217_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/39218fbb-3343-413a-8d6a-392995362903_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/18 - 12K, 03/19 - 25K, 03/20 - 38K', 'remarks': '**1794** VOSA STATES 38K, 46K, 60K, 73K, 87K, 104K SD CARD', 'virtual': False, 'seller': 'Nunns Mazda', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c79456be-a657-4561-bfef-5e5eb09dbc0a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117551156, 'registration': 'GX17XZH', 'account': 'NUN002', 'make': 'MAZDA', 'model': 'CX-5 ESTATE', 'derivative': '2.0 Sport Nav 5dr', 'mileage': 117064, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-02T13:00Z', 'lot': 133, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-13', 'fuel': 'Petrol', 'motExpiry': '2026-05-26', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX17XZH/2025-12-01/image/a383ae95-4c5e-4c42-992d-a8ab4b3bed16_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/88937c41-4fb4-4b06-9795-6970a40f6911_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/8675d622-bb63-4f28-b011-ac6739897227_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/f76829e6-5f5a-47e9-a06b-5c3d1e7255e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/1723056f-0794-44a9-90ba-470fe83fc19b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/f7d2e8bb-9988-4b98-8796-41b53799c560_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/0ab6ef0d-3447-4a7e-84c6-27ab5df681ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/55567941-35ab-4e6c-9c40-2bae3f0ab217_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XZH/2025-12-01/image/39218fbb-3343-413a-8d6a-392995362903_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/18 - 12K, 03/19 - 25K, 03/20 - 38K', 'remarks': '**1794** VOSA STATES 38K, 46K, 60K, 73K, 87K, 104K SD CARD', 'virtual': False, 'seller': 'Nunns Mazda', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c79456be-a657-4561-bfef-5e5eb09dbc0a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e149115-2f07-5da3-88e4-fd336675ec2a with identifier: 117551156
2025-12-02 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e149115-2f07-5da3-88e4-fd336675ec2a with scrape type 2
2025-12-02 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e149115-2f07-5da3-88e4-fd336675ec2a with scrape type 2
2025-12-02 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0e149115-2f07-5da3-88e4-fd336675ec2a, identifier: 117551156
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117599013, 'registration': 'YA17YCB', 'account': 'VAN043', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.4 [75] ecoFLEX Energy 5dr [AC]', 'mileage': 30732, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-02T13:00Z', 'lot': 384, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-05-30', 'fuel': 'Petrol', 'motExpiry': '2025-11-29', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YA17YCB/2025-12-02/image/9206637f-3f9d-4c24-878e-c72dcb4b7a51_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/100ea14a-522c-4845-9b35-08d1d9214640_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/b4805efd-7cc4-4fcf-b25f-8dbf1c25fa84_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/65d26ad2-7411-443c-8c69-9dc37d91dbe9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/ef2bc921-8f90-4835-8701-0808617f208e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/e2883ed0-86cb-4aa4-849f-7811509e85e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/ac0fde47-3644-470a-9568-e80b25e1dc23_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/8ba7b8a9-53cd-40ff-89f9-c7852503d863_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/d518590a-a4b2-4e8b-9ee9-90bb15de0d2f_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18 - 4K, 05/19 - 8K, 06/20 - 13K, 05/21 - 16K, 05/22 - 20K, 22K - NO DATE, 04/24 - 24K, 05/25 - 27K, 11/25 - 30K', 'remarks': '**1348** VOSA STATES 15K, 18K, 21K, 23K, 25K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/83ef46c3-28b4-4b4b-a512-256d360c06f8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117599013, 'registration': 'YA17YCB', 'account': 'VAN043', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.4 [75] ecoFLEX Energy 5dr [AC]', 'mileage': 30732, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-02T13:00Z', 'lot': 384, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-05-30', 'fuel': 'Petrol', 'motExpiry': '2025-11-29', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YA17YCB/2025-12-02/image/9206637f-3f9d-4c24-878e-c72dcb4b7a51_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/100ea14a-522c-4845-9b35-08d1d9214640_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/b4805efd-7cc4-4fcf-b25f-8dbf1c25fa84_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/65d26ad2-7411-443c-8c69-9dc37d91dbe9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/ef2bc921-8f90-4835-8701-0808617f208e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/e2883ed0-86cb-4aa4-849f-7811509e85e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/ac0fde47-3644-470a-9568-e80b25e1dc23_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/8ba7b8a9-53cd-40ff-89f9-c7852503d863_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17YCB/2025-12-02/image/d518590a-a4b2-4e8b-9ee9-90bb15de0d2f_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18 - 4K, 05/19 - 8K, 06/20 - 13K, 05/21 - 16K, 05/22 - 20K, 22K - NO DATE, 04/24 - 24K, 05/25 - 27K, 11/25 - 30K', 'remarks': '**1348** VOSA STATES 15K, 18K, 21K, 23K, 25K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/83ef46c3-28b4-4b4b-a512-256d360c06f8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73be7197-8bd0-516d-a1d1-d2c85bf389be with identifier: 117599013
2025-12-02 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73be7197-8bd0-516d-a1d1-d2c85bf389be with scrape type 2
2025-12-02 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73be7197-8bd0-516d-a1d1-d2c85bf389be with scrape type 2
2025-12-02 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 73be7197-8bd0-516d-a1d1-d2c85bf389be, identifier: 117599013
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117433630, 'registration': 'EX16ZBJ', 'account': 'THE109', 'make': 'FORD', 'model': 'KA HATCHBACK', 'derivative': '1.2 Zetec 3dr [Start Stop]', 'mileage': 53877, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2109, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-25', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/9e74a200-977f-4f66-945d-4e0de0a6ff52_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/637b5fc7-0821-48d6-b176-f030ac0282b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/11f057b3-3939-4a0f-b13c-a9529fe5b816_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/45da5993-bf1d-44ce-8999-d2f0a6601534_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/b3caf4c3-81bf-4b20-8efe-89279195ac61_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/362cceca-a970-42b3-8750-90ed001bec65_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/6c2c7516-8797-4033-a550-de4b68785cb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/d338ca23-38a5-4e58-a85d-50b699471a40_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/c662ca3e-752c-47d9-ba54-a0ae30075d86_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/18 1K 05/19 17K 07/20 33K 09/23 43K', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba062408-5f7b-4796-940a-2f6a96d2f5d7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117433630, 'registration': 'EX16ZBJ', 'account': 'THE109', 'make': 'FORD', 'model': 'KA HATCHBACK', 'derivative': '1.2 Zetec 3dr [Start Stop]', 'mileage': 53877, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2109, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-25', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/9e74a200-977f-4f66-945d-4e0de0a6ff52_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/637b5fc7-0821-48d6-b176-f030ac0282b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/11f057b3-3939-4a0f-b13c-a9529fe5b816_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/45da5993-bf1d-44ce-8999-d2f0a6601534_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/b3caf4c3-81bf-4b20-8efe-89279195ac61_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/362cceca-a970-42b3-8750-90ed001bec65_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/6c2c7516-8797-4033-a550-de4b68785cb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/d338ca23-38a5-4e58-a85d-50b699471a40_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX16ZBJ/2025-12-01/image/c662ca3e-752c-47d9-ba54-a0ae30075d86_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/18 1K 05/19 17K 07/20 33K 09/23 43K', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba062408-5f7b-4796-940a-2f6a96d2f5d7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bee7c4e3-5c69-56d4-977e-a86a9837b0ab with identifier: 117433630
2025-12-02 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee7c4e3-5c69-56d4-977e-a86a9837b0ab with scrape type 2
2025-12-02 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bee7c4e3-5c69-56d4-977e-a86a9837b0ab with scrape type 2
2025-12-02 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bee7c4e3-5c69-56d4-977e-a86a9837b0ab, identifier: 117433630
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 115431227
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115431227%27 HTTP/1.1" 200 None
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Scrape type for 115431227: 0
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117633088
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633088%27 HTTP/1.1" 200 None
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117633088: 0
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117576849
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576849%27 HTTP/1.1" 200 None
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117576849: 2
2025-12-02 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0e149115-2f07-5da3-88e4-fd336675ec2a with identifier: 117551156
2025-12-02 19:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0e149115-2f07-5da3-88e4-fd336675ec2a with identifier: 117551156
2025-12-02 19:00:26 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 0e149115-2f07-5da3-88e4-fd336675ec2a with expiration date: 2025-12-02T13:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0e149115-2f07-5da3-88e4-fd336675ec2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GX17XZH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551156',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MAZDA',
 'model': 'CX-5 ESTATE',
 'odometer': 117064,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-13',
 'seller_name': 'Nunns Mazda',
 'title': 'MAZDA CX-5 ESTATE 2.0 Sport Nav 5dr',
 'transmission': 'manual',
 'trim': '2.0 Sport Nav 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551156%27 HTTP/1.1" 200 None
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Saving data for 117551156: {'auction_closing_time': 1764680400.0, 'created_time': 1764356504.202705, 'last_price_update_time': 1764702026.603172}
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117551156') HTTP/1.1" 204 0
2025-12-02 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 73be7197-8bd0-516d-a1d1-d2c85bf389be with identifier: 117599013
2025-12-02 19:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 73be7197-8bd0-516d-a1d1-d2c85bf389be with identifier: 117599013
2025-12-02 19:00:26 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 73be7197-8bd0-516d-a1d1-d2c85bf389be with expiration date: 2025-12-02T13:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '73be7197-8bd0-516d-a1d1-d2c85bf389be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YA17YCB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599013',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK SPECIAL EDS',
 'odometer': 30732,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': 'Vantage Motor Group',
 'title': 'VAUXHALL CORSA HATCHBACK SPECIAL EDS 1.4 [75] ecoFLEX Energy 5dr '
          '[AC]',
 'transmission': 'manual',
 'trim': '1.4 [75] ecoFLEX Energy 5dr [AC]',
 'vin': None,
 'year': 2017}
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599013%27 HTTP/1.1" 200 None
2025-12-02 19:00:26 [astonbarclay.gb] INFO: Saving data for 117599013: {'auction_closing_time': 1764680400.0, 'created_time': 1764356537.454614, 'last_price_update_time': 1764702026.739928}
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117599013') HTTP/1.1" 204 0
2025-12-02 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bee7c4e3-5c69-56d4-977e-a86a9837b0ab with identifier: 117433630
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-02 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bee7c4e3-5c69-56d4-977e-a86a9837b0ab with identifier: 117433630
2025-12-02 19:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bee7c4e3-5c69-56d4-977e-a86a9837b0ab with identifier: 117433630 to the API
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27bee7c4e3-5c69-56d4-977e-a86a9837b0ab%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id bee7c4e3-5c69-56d4-977e-a86a9837b0ab: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:00:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117433630?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'bee7c4e3-5c69-56d4-977e-a86a9837b0ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EX16ZBJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117433630',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'KA HATCHBACK',
 'odometer': 53877,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD KA HATCHBACK 1.2 Zetec 3dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.2 Zetec 3dr [Start Stop]',
 'vin': None,
 'year': 2016}
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433630%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Saving data for 117433630: {'auction_closing_time': 1764755100.0, 'created_time': 1764579680.758291, 'last_price_update_time': 1764702027.20046}
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117433630') HTTP/1.1" 204 0
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 116134889
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116134889%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Scrape type for 116134889: 0
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117576600
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576600%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117576600: 2
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117331639, 'registration': 'GC16OMO', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '1.6 TDI 110 Match Edition 5dr DSG', 'mileage': 79780, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2117, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-08-31', 'fuel': 'Diesel', 'motExpiry': '2026-05-04', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GC16OMO/2025-11-24/image/823f47f8-f69e-476d-8f70-62f9aa399c8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/1cf3ec81-2583-4556-81ea-7aeea725b12e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/374b9061-e3dc-48f1-982a-0cf73408536c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/71a71e84-3cb4-4315-a7ef-d7a8949cac91_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/84cb6214-dd1e-46d8-889f-a1a79a5d4386_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/c0ef6fec-8a38-486e-b38b-c113b4fe5c71_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/467f4197-3250-42ee-84ec-d901cbbb788b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/6d8f85cb-9d0b-4a85-8e82-ed7f6f36d10d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/6f28a036-b9c6-4618-a17a-fe1430fa7ecc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SB 08/17 12K 08/18 22K 08/19 30K 08/20 38K 04/21 43K 08/25 75K / SP 03/22 47K 03/23 54K 07/24 65K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 102, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/70649f9a-60c4-4fa0-82f1-f053032b5662.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117331639, 'registration': 'GC16OMO', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '1.6 TDI 110 Match Edition 5dr DSG', 'mileage': 79780, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2117, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-08-31', 'fuel': 'Diesel', 'motExpiry': '2026-05-04', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GC16OMO/2025-11-24/image/823f47f8-f69e-476d-8f70-62f9aa399c8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/1cf3ec81-2583-4556-81ea-7aeea725b12e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/374b9061-e3dc-48f1-982a-0cf73408536c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/71a71e84-3cb4-4315-a7ef-d7a8949cac91_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/84cb6214-dd1e-46d8-889f-a1a79a5d4386_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/c0ef6fec-8a38-486e-b38b-c113b4fe5c71_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/467f4197-3250-42ee-84ec-d901cbbb788b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/6d8f85cb-9d0b-4a85-8e82-ed7f6f36d10d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC16OMO/2025-11-24/image/6f28a036-b9c6-4618-a17a-fe1430fa7ecc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SB 08/17 12K 08/18 22K 08/19 30K 08/20 38K 04/21 43K 08/25 75K / SP 03/22 47K 03/23 54K 07/24 65K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 102, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/70649f9a-60c4-4fa0-82f1-f053032b5662.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 426a66f1-b1d9-5c85-9d11-b4b1a6628f48 with identifier: 117331639
2025-12-02 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 426a66f1-b1d9-5c85-9d11-b4b1a6628f48 with scrape type 2
2025-12-02 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 426a66f1-b1d9-5c85-9d11-b4b1a6628f48 with scrape type 2
2025-12-02 19:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 426a66f1-b1d9-5c85-9d11-b4b1a6628f48, identifier: 117331639
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662383, 'registration': 'LM18VOU', 'account': 'KCS002', 'make': 'PEUGEOT', 'model': 'TRAVELLER DIESEL ESTATE', 'derivative': '2.0 BlueHDi 150 Allure Standard 5dr', 'mileage': 76190, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2154, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-05-25', 'fuel': 'Diesel', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM18VOU/2025-12-02/image/330395e3-4c8b-475b-9273-a16080df0a3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/bf4b9b9d-e080-4d1e-af32-184011b14adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/cf92d786-4b9d-488c-95ce-3b4525bb52ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/3badfd6c-4ee2-47c3-8491-0ebd0a495466_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/c7e0059b-095e-42ff-98be-2932a418f62d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/a8e12838-1fd1-4e37-a66c-3393b69b6c16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/8c42d6d1-95f6-4c67-b313-62db0833b36b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/ab181ea5-aa04-49b5-9fb1-c0525ba02149_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/090a5132-1f03-443e-96d4-96f401d70feb_removebg.jpg?w=600'], 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/19 8K 10/20 21K 05/21 25K 05/22 33K 10/23 76K (MILEAGE ERROR) 11/24 63K 10/25 74K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dcd7148f-9f0a-424b-b24a-cfc04e4ae521.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662383, 'registration': 'LM18VOU', 'account': 'KCS002', 'make': 'PEUGEOT', 'model': 'TRAVELLER DIESEL ESTATE', 'derivative': '2.0 BlueHDi 150 Allure Standard 5dr', 'mileage': 76190, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2154, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-05-25', 'fuel': 'Diesel', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM18VOU/2025-12-02/image/330395e3-4c8b-475b-9273-a16080df0a3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/bf4b9b9d-e080-4d1e-af32-184011b14adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/cf92d786-4b9d-488c-95ce-3b4525bb52ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/3badfd6c-4ee2-47c3-8491-0ebd0a495466_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/c7e0059b-095e-42ff-98be-2932a418f62d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/a8e12838-1fd1-4e37-a66c-3393b69b6c16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/8c42d6d1-95f6-4c67-b313-62db0833b36b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/ab181ea5-aa04-49b5-9fb1-c0525ba02149_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/090a5132-1f03-443e-96d4-96f401d70feb_removebg.jpg?w=600'], 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/19 8K 10/20 21K 05/21 25K 05/22 33K 10/23 76K (MILEAGE ERROR) 11/24 63K 10/25 74K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dcd7148f-9f0a-424b-b24a-cfc04e4ae521.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52669e31-67d3-5cd8-9ca1-4e345de83c70 with identifier: 117662383
2025-12-02 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52669e31-67d3-5cd8-9ca1-4e345de83c70 with scrape type 1
2025-12-02 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 52669e31-67d3-5cd8-9ca1-4e345de83c70
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252F330395e3-4c8b-475b-9273-a16080df0a3a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/330395e3-4c8b-475b-9273-a16080df0a3a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 426a66f1-b1d9-5c85-9d11-b4b1a6628f48 with identifier: 117331639
2025-12-02 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 426a66f1-b1d9-5c85-9d11-b4b1a6628f48 with identifier: 117331639
2025-12-02 19:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 426a66f1-b1d9-5c85-9d11-b4b1a6628f48 with identifier: 117331639 to the API
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27426a66f1-b1d9-5c85-9d11-b4b1a6628f48%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 426a66f1-b1d9-5c85-9d11-b4b1a6628f48: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:00:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117331639?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '426a66f1-b1d9-5c85-9d11-b4b1a6628f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GC16OMO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117331639',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 79780,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 1.6 TDI 110 Match Edition 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.6 TDI 110 Match Edition 5dr DSG',
 'vin': None,
 'year': 2016}
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117331639%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Saving data for 117331639: {'auction_closing_time': 1764755100.0, 'created_time': 1763974960.875604, 'last_price_update_time': 1764702027.805992}
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117331639') HTTP/1.1" 204 0
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 116989244
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116989244%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Scrape type for 116989244: 0
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117290737
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117290737%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117290737: 0
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 116755943
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116755943%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Scrape type for 116755943: 0
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 114089759
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114089759%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Scrape type for 114089759: 0
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117330721
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117330721%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117330721: 0
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117507396
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507396%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117507396: 2
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252Fbf4b9b9d-e080-4d1e-af32-184011b14adb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/bf4b9b9d-e080-4d1e-af32-184011b14adb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117570740
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570740%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117570740: 2
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252Fcf92d786-4b9d-488c-95ce-3b4525bb52ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/cf92d786-4b9d-488c-95ce-3b4525bb52ad_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117632563
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632563%27 HTTP/1.1" 200 None
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117632563: 0
2025-12-02 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117632517
2025-12-02 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632517%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117632517: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117421533
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421533%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117421533: 2
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252F3badfd6c-4ee2-47c3-8491-0ebd0a495466_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/3badfd6c-4ee2-47c3-8491-0ebd0a495466_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117311708
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311708%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117311708: 2
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252Fc7e0059b-095e-42ff-98be-2932a418f62d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/c7e0059b-095e-42ff-98be-2932a418f62d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117563683
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563683%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117563683: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117376148
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117376148%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117376148: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117583759
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117583759%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117583759: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117422410
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422410%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117422410: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117420120
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420120%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117420120: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117489004
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117489004%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117489004: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117426088
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117426088%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117426088: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117543631
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543631%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117543631: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117415236
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415236%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117415236: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117451351
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451351%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117451351: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117486262
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117486262%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117486262: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 116918961
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116918961%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 116918961: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117585575
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585575%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117585575: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117563502
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563502%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117563502: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117548417
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548417%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117548417: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117566737
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117566737%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117566737: 0
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117339017
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117339017%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117339017: 2
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252Fa8e12838-1fd1-4e37-a66c-3393b69b6c16_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/a8e12838-1fd1-4e37-a66c-3393b69b6c16_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117661923?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117077436
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117077436%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117077436: 2
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252F8c42d6d1-95f6-4c67-b313-62db0833b36b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/8c42d6d1-95f6-4c67-b313-62db0833b36b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662353?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662079, 'registration': 'DS18MMO', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna 5dr', 'mileage': 60294, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2150, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-16', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS18MMO/2025-12-02/image/326395ca-a6ec-4001-893d-21e0f0907202_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/3f4f2b49-3ec9-4eda-b368-157b402a9d03_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/6a82ce94-55c1-40cd-86aa-02c1e9d4e2a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/92a974d9-f0db-4f98-8ef3-d9c65aae54e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/eb0f444d-5ccd-4174-b751-310d29957c4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/e48f57b9-748d-41a0-a19b-370f89bf0efd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/2abcfa8c-7f6c-4501-95ef-b2ac19257873_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/5c6f1c4e-1378-46c6-85d5-a622a28748e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/12ddd530-3d88-4642-ae11-10cc4829c874_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/f9e664e9-18f3-422b-b182-c43ae6c37176_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/19 7K 04/20 13K 01/21 18K 11/21 28K 06/22 40K 07/25 59K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f29362d2-c7d2-4366-a45d-1ee14972c400.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662079, 'registration': 'DS18MMO', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna 5dr', 'mileage': 60294, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2150, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-16', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS18MMO/2025-12-02/image/326395ca-a6ec-4001-893d-21e0f0907202_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/3f4f2b49-3ec9-4eda-b368-157b402a9d03_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/6a82ce94-55c1-40cd-86aa-02c1e9d4e2a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/92a974d9-f0db-4f98-8ef3-d9c65aae54e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/eb0f444d-5ccd-4174-b751-310d29957c4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/e48f57b9-748d-41a0-a19b-370f89bf0efd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/2abcfa8c-7f6c-4501-95ef-b2ac19257873_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/5c6f1c4e-1378-46c6-85d5-a622a28748e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/12ddd530-3d88-4642-ae11-10cc4829c874_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/f9e664e9-18f3-422b-b182-c43ae6c37176_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/19 7K 04/20 13K 01/21 18K 11/21 28K 06/22 40K 07/25 59K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f29362d2-c7d2-4366-a45d-1ee14972c400.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67123457-1c0a-5cdd-8be3-eb490de642b0 with identifier: 117662079
2025-12-02 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67123457-1c0a-5cdd-8be3-eb490de642b0 with scrape type 1
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67123457-1c0a-5cdd-8be3-eb490de642b0
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F326395ca-a6ec-4001-893d-21e0f0907202_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/326395ca-a6ec-4001-893d-21e0f0907202_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662118, 'registration': 'WJ17GRX', 'account': 'KCS002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 HSE Dynamic 5dr Auto', 'mileage': 68640, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2137, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-01-19', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/9ad10aec-2da0-42a9-9521-71876c49455f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/cd7da82f-372a-4200-a4d9-a87ddc1996e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/5fd14d88-adf2-4929-911c-0249130e453a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/e8ba6462-5e65-46f6-a029-df88ef3ce973_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/1e598046-c815-46c4-abdb-d527cfb41ec5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/227aece1-5b16-43ff-8611-8401b154f1ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/a1f561ef-cf99-4b02-b4ef-9f69c5489139_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/923ed404-47b5-487a-b6b7-d992452917d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/f0cdc0a4-e1d3-40a5-961d-f5690e49642f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/166df408-a2b7-4812-806d-a5eb8cd6ab32_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/3e4906e6-0399-4996-91b5-397a69195db3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 12/22 (NO MILEAGE) 01/24 (NO MILEAGE) 01/25 (NO MILEAGE)', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7c95ad48-fbca-490b-b5d6-bb70a6dd93ad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662118, 'registration': 'WJ17GRX', 'account': 'KCS002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 HSE Dynamic 5dr Auto', 'mileage': 68640, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2137, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-01-19', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/9ad10aec-2da0-42a9-9521-71876c49455f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/cd7da82f-372a-4200-a4d9-a87ddc1996e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/5fd14d88-adf2-4929-911c-0249130e453a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/e8ba6462-5e65-46f6-a029-df88ef3ce973_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/1e598046-c815-46c4-abdb-d527cfb41ec5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/227aece1-5b16-43ff-8611-8401b154f1ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/a1f561ef-cf99-4b02-b4ef-9f69c5489139_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/923ed404-47b5-487a-b6b7-d992452917d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/f0cdc0a4-e1d3-40a5-961d-f5690e49642f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/166df408-a2b7-4812-806d-a5eb8cd6ab32_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/3e4906e6-0399-4996-91b5-397a69195db3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 12/22 (NO MILEAGE) 01/24 (NO MILEAGE) 01/25 (NO MILEAGE)', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7c95ad48-fbca-490b-b5d6-bb70a6dd93ad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c79e020-ccca-522b-ba24-b7db825f3356 with identifier: 117662118
2025-12-02 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c79e020-ccca-522b-ba24-b7db825f3356 with scrape type 1
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F9ad10aec-2da0-42a9-9521-71876c49455f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/9ad10aec-2da0-42a9-9521-71876c49455f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117626705
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117626705%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117626705: 1
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252Fab181ea5-aa04-49b5-9fb1-c0525ba02149_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/ab181ea5-aa04-49b5-9fb1-c0525ba02149_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F3f4f2b49-3ec9-4eda-b368-157b402a9d03_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/3f4f2b49-3ec9-4eda-b368-157b402a9d03_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252Fcd7da82f-372a-4200-a4d9-a87ddc1996e1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/cd7da82f-372a-4200-a4d9-a87ddc1996e1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117616251
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616251%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117616251: 1
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252F090a5132-1f03-443e-96d4-96f401d70feb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/090a5132-1f03-443e-96d4-96f401d70feb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117424383?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F6a82ce94-55c1-40cd-86aa-02c1e9d4e2a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/6a82ce94-55c1-40cd-86aa-02c1e9d4e2a2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F5fd14d88-adf2-4929-911c-0249130e453a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/5fd14d88-adf2-4929-911c-0249130e453a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117661923, 'registration': 'NL17AHX', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'MOKKA X HATCHBACK', 'derivative': '1.4T Elite 5dr', 'mileage': 47817, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2155, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-08', 'fuel': 'Petrol', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL17AHX/2025-12-02/image/4fc06e3f-8cca-425e-9cfc-637074e2215e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/46ebe2eb-e791-41b1-bf4c-eee15f207ff0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/a7e094bc-bff5-4156-87b3-e4f722520ffd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/c8071269-6325-4dd4-8f2d-743c682ff0c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/ca2d2dac-6a86-411c-8ac4-7632546af028_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/21e4c5f5-4b42-4dc3-9145-94b55612a23a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/b9e5f552-9d7f-45c8-a2d2-c7095da6a44e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/cb27b343-ef8f-4511-b30e-9b5cd1188805_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/41f02a38-2e62-4634-9a46-ac1b4c2db1cc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 02/18 7K 02/19 14K 05/20 22K INV @ 05/22 30K 09/25 47K', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f7d17c16-888b-4075-8ba7-c45b490d9c10.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117661923, 'registration': 'NL17AHX', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'MOKKA X HATCHBACK', 'derivative': '1.4T Elite 5dr', 'mileage': 47817, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2155, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-08', 'fuel': 'Petrol', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL17AHX/2025-12-02/image/4fc06e3f-8cca-425e-9cfc-637074e2215e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/46ebe2eb-e791-41b1-bf4c-eee15f207ff0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/a7e094bc-bff5-4156-87b3-e4f722520ffd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/c8071269-6325-4dd4-8f2d-743c682ff0c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/ca2d2dac-6a86-411c-8ac4-7632546af028_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/21e4c5f5-4b42-4dc3-9145-94b55612a23a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/b9e5f552-9d7f-45c8-a2d2-c7095da6a44e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/cb27b343-ef8f-4511-b30e-9b5cd1188805_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/41f02a38-2e62-4634-9a46-ac1b4c2db1cc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 02/18 7K 02/19 14K 05/20 22K INV @ 05/22 30K 09/25 47K', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f7d17c16-888b-4075-8ba7-c45b490d9c10.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f with identifier: 117661923
2025-12-02 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f with scrape type 1
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252F4fc06e3f-8cca-425e-9cfc-637074e2215e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/4fc06e3f-8cca-425e-9cfc-637074e2215e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117661782, 'registration': 'AX19EOB', 'account': 'KCS002', 'make': 'HYUNDAI', 'model': 'KONA HATCHBACK', 'derivative': '1.0T GDi Blue Drive Premium 5dr', 'mileage': 35092, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2158, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-27', 'fuel': 'Petrol', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX19EOB/2025-12-02/image/deb87879-6401-4fe6-a708-c0cac2c0bc0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ecc7fb15-e6b4-4f9c-868e-b094b8092f74_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/40f6bcd2-1ff9-4d7c-8035-22aea9e6b361_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/744e863e-1b5f-486b-a867-6d07a6fe24e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ea46bbf0-2291-4923-991a-e4d7ec889044_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/cbc6017d-c189-43ca-8bc7-5235cfaf0482_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/5536dae1-42da-4d30-b9cc-122f425aba6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/288effb1-8abc-41d4-8a07-d2e858165642_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/96e1bdc1-e777-490e-8d10-8846db4f4257_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/f4187a4f-ffa5-477b-996f-26133ae180da_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/20 5K 09/21 8K 11/22 11K 01/23 12K 08/23 16K 11/24 26K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4dd893e7-5ec9-419a-905b-d4684116233f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117661782, 'registration': 'AX19EOB', 'account': 'KCS002', 'make': 'HYUNDAI', 'model': 'KONA HATCHBACK', 'derivative': '1.0T GDi Blue Drive Premium 5dr', 'mileage': 35092, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2158, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-27', 'fuel': 'Petrol', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX19EOB/2025-12-02/image/deb87879-6401-4fe6-a708-c0cac2c0bc0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ecc7fb15-e6b4-4f9c-868e-b094b8092f74_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/40f6bcd2-1ff9-4d7c-8035-22aea9e6b361_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/744e863e-1b5f-486b-a867-6d07a6fe24e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ea46bbf0-2291-4923-991a-e4d7ec889044_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/cbc6017d-c189-43ca-8bc7-5235cfaf0482_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/5536dae1-42da-4d30-b9cc-122f425aba6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/288effb1-8abc-41d4-8a07-d2e858165642_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/96e1bdc1-e777-490e-8d10-8846db4f4257_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/f4187a4f-ffa5-477b-996f-26133ae180da_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/20 5K 09/21 8K 11/22 11K 01/23 12K 08/23 16K 11/24 26K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4dd893e7-5ec9-419a-905b-d4684116233f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with identifier: 117661782
2025-12-02 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with scrape type 1
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252Fdeb87879-6401-4fe6-a708-c0cac2c0bc0d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/deb87879-6401-4fe6-a708-c0cac2c0bc0d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662353, 'registration': 'GF66NXS', 'account': 'KCS002', 'make': 'BMW', 'model': '2 SERIES DIESEL CONVERTIBLE', 'derivative': '218d [150] M Sport 2dr [Nav] Step Auto', 'mileage': 76409, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2157, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-10-07', 'fuel': 'Diesel', 'motExpiry': '2026-10-06', 'doors': 2, 'engineSize': 1995, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/GF66NXS/2025-12-02/image/d397b23e-3a30-459f-bc88-727df0c3f647_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4aaa9b86-ae7f-44ea-be39-27e98a68467a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3e22fc52-d21c-49d8-a306-547ee494d0f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4f1b3b64-e21d-4ffa-8b34-246da6053acd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/5f208a1f-0607-4660-b860-7672dd9de736_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/a5e0cb28-673b-4ea7-8be2-091bedc15c73_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3de95cae-e3cf-4748-8dc0-9a5bfad51400_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/e5e82012-b5b1-4ad9-b858-45c36be26c8e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 02/19 33K 09/19 42K 10/20 54K 07/22 65K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7ca4b9d2-9612-43ac-8616-4716322165f1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662353, 'registration': 'GF66NXS', 'account': 'KCS002', 'make': 'BMW', 'model': '2 SERIES DIESEL CONVERTIBLE', 'derivative': '218d [150] M Sport 2dr [Nav] Step Auto', 'mileage': 76409, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2157, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-10-07', 'fuel': 'Diesel', 'motExpiry': '2026-10-06', 'doors': 2, 'engineSize': 1995, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/GF66NXS/2025-12-02/image/d397b23e-3a30-459f-bc88-727df0c3f647_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4aaa9b86-ae7f-44ea-be39-27e98a68467a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3e22fc52-d21c-49d8-a306-547ee494d0f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4f1b3b64-e21d-4ffa-8b34-246da6053acd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/5f208a1f-0607-4660-b860-7672dd9de736_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/a5e0cb28-673b-4ea7-8be2-091bedc15c73_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3de95cae-e3cf-4748-8dc0-9a5bfad51400_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/e5e82012-b5b1-4ad9-b858-45c36be26c8e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 02/19 33K 09/19 42K 10/20 54K 07/22 65K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7ca4b9d2-9612-43ac-8616-4716322165f1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4719489b-1fba-5fbc-a000-82ecc981e7c2 with identifier: 117662353
2025-12-02 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4719489b-1fba-5fbc-a000-82ecc981e7c2 with scrape type 1
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4719489b-1fba-5fbc-a000-82ecc981e7c2
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252Fd397b23e-3a30-459f-bc88-727df0c3f647_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/d397b23e-3a30-459f-bc88-727df0c3f647_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117660087, 'registration': 'FD70MVG', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo Elite Nav 5dr', 'mileage': 47042, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2214, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-16', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bb1c5b0f-28e4-4167-8682-387669bca078_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/9435d6c4-f83f-423a-a9d1-119f4e90fe34_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bd5ef7b2-716d-4667-9330-ff01f0f81392_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d7dd04b8-e937-4f63-af3a-b8d4afb935f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/5ab5850a-ccf1-48f3-a062-44ef4c5aee28_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/3e87a060-d349-4347-a6d8-ea109f0da041_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d94def93-7122-496c-a693-700a24ed74e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/a5de513b-34a4-4f72-8f27-c42680adb6d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/55b525a7-1d87-475a-a34c-015eb1c9d665_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/c3c852dc-35a4-491b-8c87-be61d14fe8fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/95fcc619-4c1a-4f66-a40f-1108cb5b2a3a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/21 21K 12/22 29K 10/23 41K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/baa24e13-7ddf-4094-85d7-00ae2a9c15aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117660087, 'registration': 'FD70MVG', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo Elite Nav 5dr', 'mileage': 47042, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2214, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-16', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bb1c5b0f-28e4-4167-8682-387669bca078_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/9435d6c4-f83f-423a-a9d1-119f4e90fe34_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bd5ef7b2-716d-4667-9330-ff01f0f81392_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d7dd04b8-e937-4f63-af3a-b8d4afb935f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/5ab5850a-ccf1-48f3-a062-44ef4c5aee28_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/3e87a060-d349-4347-a6d8-ea109f0da041_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d94def93-7122-496c-a693-700a24ed74e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/a5de513b-34a4-4f72-8f27-c42680adb6d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/55b525a7-1d87-475a-a34c-015eb1c9d665_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/c3c852dc-35a4-491b-8c87-be61d14fe8fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/95fcc619-4c1a-4f66-a40f-1108cb5b2a3a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/21 21K 12/22 29K 10/23 41K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/baa24e13-7ddf-4094-85d7-00ae2a9c15aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with identifier: 117660087
2025-12-02 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with scrape type 1
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fbb1c5b0f-28e4-4167-8682-387669bca078_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bb1c5b0f-28e4-4167-8682-387669bca078_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117628577
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117628577%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117628577: 1
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F92a974d9-f0db-4f98-8ef3-d9c65aae54e4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/92a974d9-f0db-4f98-8ef3-d9c65aae54e4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252Fe8ba6462-5e65-46f6-a029-df88ef3ce973_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/e8ba6462-5e65-46f6-a029-df88ef3ce973_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252F46ebe2eb-e791-41b1-bf4c-eee15f207ff0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/46ebe2eb-e791-41b1-bf4c-eee15f207ff0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252Fecc7fb15-e6b4-4f9c-868e-b094b8092f74_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ecc7fb15-e6b4-4f9c-868e-b094b8092f74_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252F4aaa9b86-ae7f-44ea-be39-27e98a68467a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4aaa9b86-ae7f-44ea-be39-27e98a68467a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252F9435d6c4-f83f-423a-a9d1-119f4e90fe34_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/9435d6c4-f83f-423a-a9d1-119f4e90fe34_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117424304?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117627985
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627985%27 HTTP/1.1" 200 None
2025-12-02 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117627985: 1
2025-12-02 19:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117424383, 'registration': 'LF17NBM', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.4 [75] ecoFLEX Energy 5dr [AC]', 'mileage': 21253, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2216, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-09-30', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LF17NBM/2025-11-28/image/8a7fb9ff-05f1-4a3f-9607-f9834919dc4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/012714c4-894d-4911-aa3a-16cb614f5efc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/56e6d199-62fa-499b-bc01-bd637cce33bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/ea84d61c-4718-4206-8412-e88650c18b95_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/f3922ba9-9984-4b5d-b9a3-1f1f33d17833_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/67744a0c-755e-486f-936a-e880d4b15da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/74e75f6e-d79a-4bd0-9f73-e1ee7e96cdb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/7d5dd5f6-5d99-49b5-9247-4c602bd28a03_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/1de780f2-aff7-4a67-9b74-8d7fe411c3e6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 04/18 2K 03/19 4K 05/20 7K 09/21 10K 09/22 12K 09/23 14K 09/24 17K 09/25 20K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0075c95e-4e4f-46b5-baaf-fcd02ceef1ae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117424383, 'registration': 'LF17NBM', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.4 [75] ecoFLEX Energy 5dr [AC]', 'mileage': 21253, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2216, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-09-30', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LF17NBM/2025-11-28/image/8a7fb9ff-05f1-4a3f-9607-f9834919dc4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/012714c4-894d-4911-aa3a-16cb614f5efc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/56e6d199-62fa-499b-bc01-bd637cce33bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/ea84d61c-4718-4206-8412-e88650c18b95_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/f3922ba9-9984-4b5d-b9a3-1f1f33d17833_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/67744a0c-755e-486f-936a-e880d4b15da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/74e75f6e-d79a-4bd0-9f73-e1ee7e96cdb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/7d5dd5f6-5d99-49b5-9247-4c602bd28a03_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF17NBM/2025-11-28/image/1de780f2-aff7-4a67-9b74-8d7fe411c3e6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 04/18 2K 03/19 4K 05/20 7K 09/21 10K 09/22 12K 09/23 14K 09/24 17K 09/25 20K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0075c95e-4e4f-46b5-baaf-fcd02ceef1ae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08714493-ad4d-562a-9c83-32864832a3cc with identifier: 117424383
2025-12-02 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08714493-ad4d-562a-9c83-32864832a3cc with scrape type 2
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08714493-ad4d-562a-9c83-32864832a3cc with scrape type 2
2025-12-02 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 08714493-ad4d-562a-9c83-32864832a3cc, identifier: 117424383
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252Feb0f444d-5ccd-4174-b751-310d29957c4c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/eb0f444d-5ccd-4174-b751-310d29957c4c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F1e598046-c815-46c4-abdb-d527cfb41ec5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/1e598046-c815-46c4-abdb-d527cfb41ec5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252Fa7e094bc-bff5-4156-87b3-e4f722520ffd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/a7e094bc-bff5-4156-87b3-e4f722520ffd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252F40f6bcd2-1ff9-4d7c-8035-22aea9e6b361_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/40f6bcd2-1ff9-4d7c-8035-22aea9e6b361_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252F3e22fc52-d21c-49d8-a306-547ee494d0f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3e22fc52-d21c-49d8-a306-547ee494d0f7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fbd5ef7b2-716d-4667-9330-ff01f0f81392_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bd5ef7b2-716d-4667-9330-ff01f0f81392_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 08714493-ad4d-562a-9c83-32864832a3cc with identifier: 117424383
2025-12-02 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 08714493-ad4d-562a-9c83-32864832a3cc with identifier: 117424383
2025-12-02 19:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 08714493-ad4d-562a-9c83-32864832a3cc with identifier: 117424383 to the API
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2708714493-ad4d-562a-9c83-32864832a3cc%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 08714493-ad4d-562a-9c83-32864832a3cc: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:00:28 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117424383?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '08714493-ad4d-562a-9c83-32864832a3cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LF17NBM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117424383',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK SPECIAL EDS',
 'odometer': 21253,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': 'Wilsons',
 'title': 'VAUXHALL CORSA HATCHBACK SPECIAL EDS 1.4 [75] ecoFLEX Energy 5dr '
          '[AC]',
 'transmission': 'manual',
 'trim': '1.4 [75] ecoFLEX Energy 5dr [AC]',
 'vin': None,
 'year': 2017}
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424383%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [astonbarclay.gb] INFO: Saving data for 117424383: {'auction_closing_time': 1764755100.0, 'created_time': 1764234060.651773, 'last_price_update_time': 1764702029.624824}
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117424383') HTTP/1.1" 204 0
2025-12-02 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117627604
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627604%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117627604: 1
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252Fe48f57b9-748d-41a0-a19b-370f89bf0efd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/e48f57b9-748d-41a0-a19b-370f89bf0efd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F227aece1-5b16-43ff-8611-8401b154f1ac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/227aece1-5b16-43ff-8611-8401b154f1ac_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252Fc8071269-6325-4dd4-8f2d-743c682ff0c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/c8071269-6325-4dd4-8f2d-743c682ff0c7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252F744e863e-1b5f-486b-a867-6d07a6fe24e9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/744e863e-1b5f-486b-a867-6d07a6fe24e9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252F4f1b3b64-e21d-4ffa-8b34-246da6053acd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4f1b3b64-e21d-4ffa-8b34-246da6053acd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fd7dd04b8-e937-4f63-af3a-b8d4afb935f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d7dd04b8-e937-4f63-af3a-b8d4afb935f7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117424304, 'registration': 'DE16NRX', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T SE 5dr Auto', 'mileage': 41459, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2219, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-04-22', 'fuel': 'Petrol', 'motExpiry': '2025-11-30', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DE16NRX/2025-11-28/image/c0edcf26-800d-4ca1-b4bb-bcf1dda03328_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/947e09f6-f4f8-4a3f-94a6-95a4b01d3c9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/ce4fc753-a8d7-43f3-acd0-65b71e56fae4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/c5ad3e39-d756-4b4e-8889-48d1f2997920_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/76f1f4bb-cf0d-44e9-9a26-559410838a0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/9089eb3a-bce6-439c-93af-a69b0a56c403_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/acd3ab7d-c452-48df-99c0-35e1e6044c23_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/6825b49f-c3c1-4007-8c33-b3e7208395b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/ff98b8ad-8abe-4795-a628-e6e2fd087078_removebg.jpg?w=600'], 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/79ed858f-85af-42e6-a0b0-59a5f435e289.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117424304, 'registration': 'DE16NRX', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T SE 5dr Auto', 'mileage': 41459, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2219, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-04-22', 'fuel': 'Petrol', 'motExpiry': '2025-11-30', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DE16NRX/2025-11-28/image/c0edcf26-800d-4ca1-b4bb-bcf1dda03328_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/947e09f6-f4f8-4a3f-94a6-95a4b01d3c9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/ce4fc753-a8d7-43f3-acd0-65b71e56fae4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/c5ad3e39-d756-4b4e-8889-48d1f2997920_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/76f1f4bb-cf0d-44e9-9a26-559410838a0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/9089eb3a-bce6-439c-93af-a69b0a56c403_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/acd3ab7d-c452-48df-99c0-35e1e6044c23_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/6825b49f-c3c1-4007-8c33-b3e7208395b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE16NRX/2025-11-28/image/ff98b8ad-8abe-4795-a628-e6e2fd087078_removebg.jpg?w=600'], 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/79ed858f-85af-42e6-a0b0-59a5f435e289.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89bd8e76-431b-5dec-be13-c067feedc7ce with identifier: 117424304
2025-12-02 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89bd8e76-431b-5dec-be13-c067feedc7ce with scrape type 2
2025-12-02 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89bd8e76-431b-5dec-be13-c067feedc7ce with scrape type 2
2025-12-02 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 89bd8e76-431b-5dec-be13-c067feedc7ce, identifier: 117424304
2025-12-02 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117614027
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117614027%27 HTTP/1.1" 200 None
2025-12-02 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117614027: 1
2025-12-02 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 89bd8e76-431b-5dec-be13-c067feedc7ce with identifier: 117424304
2025-12-02 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BROWN HTTP/1.1" 200 None
2025-12-02 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 89bd8e76-431b-5dec-be13-c067feedc7ce with identifier: 117424304
2025-12-02 19:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 89bd8e76-431b-5dec-be13-c067feedc7ce with identifier: 117424304 to the API
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2789bd8e76-431b-5dec-be13-c067feedc7ce%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 89bd8e76-431b-5dec-be13-c067feedc7ce: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:00:29 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117424304?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'BROWN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '89bd8e76-431b-5dec-be13-c067feedc7ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DE16NRX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117424304',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 41459,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-22',
 'seller_name': 'Wilsons',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.4T SE 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.4T SE 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424304%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Saving data for 117424304: {'auction_closing_time': 1764755100.0, 'created_time': 1764234062.383561, 'last_price_update_time': 1764702030.410784}
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117424304') HTTP/1.1" 204 0
2025-12-02 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM18VOU/2025-12-02/image/3badfd6c-4ee2-47c3-8491-0ebd0a495466_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662383?view=catalogue)
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F2abcfa8c-7f6c-4501-95ef-b2ac19257873_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/2abcfa8c-7f6c-4501-95ef-b2ac19257873_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252Fa1f561ef-cf99-4b02-b4ef-9f69c5489139_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/a1f561ef-cf99-4b02-b4ef-9f69c5489139_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252Fca2d2dac-6a86-411c-8ac4-7632546af028_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/ca2d2dac-6a86-411c-8ac4-7632546af028_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252Fea46bbf0-2291-4923-991a-e4d7ec889044_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ea46bbf0-2291-4923-991a-e4d7ec889044_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252F5f208a1f-0607-4660-b860-7672dd9de736_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/5f208a1f-0607-4660-b860-7672dd9de736_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252F5ab5850a-ccf1-48f3-a062-44ef4c5aee28_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/5ab5850a-ccf1-48f3-a062-44ef4c5aee28_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM18VOU/2025-12-02/image/a8e12838-1fd1-4e37-a66c-3393b69b6c16_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662383?view=catalogue)
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117331028
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117331028%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117331028: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117512026
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117512026%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117512026: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117549056
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549056%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117549056: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117422977
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422977%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117422977: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117334306
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117334306%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117334306: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117525337
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117525337%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117525337: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117459934
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459934%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117459934: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117487536
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117487536%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117487536: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117458458
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458458%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117458458: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117413519
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117413519%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117413519: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117450382
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117450382%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117450382: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117424938
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424938%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117424938: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116994755
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116994755%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116994755: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117431352
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117431352%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117431352: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117461867
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117461867%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117461867: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117509153
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509153%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117509153: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117433308
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433308%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117433308: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117580534
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580534%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117580534: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117549150
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549150%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117549150: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117576078
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576078%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117576078: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117549131
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549131%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117549131: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117351302
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117351302%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117351302: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117583554
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117583554%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117583554: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117386686
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117386686%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117386686: 0
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117625623
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625623%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117625623: 1
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F5c6f1c4e-1378-46c6-85d5-a622a28748e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/5c6f1c4e-1378-46c6-85d5-a622a28748e7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F923ed404-47b5-487a-b6b7-d992452917d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/923ed404-47b5-487a-b6b7-d992452917d4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252F21e4c5f5-4b42-4dc3-9145-94b55612a23a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/21e4c5f5-4b42-4dc3-9145-94b55612a23a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252Fcbc6017d-c189-43ca-8bc7-5235cfaf0482_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/cbc6017d-c189-43ca-8bc7-5235cfaf0482_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252Fa5e0cb28-673b-4ea7-8be2-091bedc15c73_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/a5e0cb28-673b-4ea7-8be2-091bedc15c73_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252F3e87a060-d349-4347-a6d8-ea109f0da041_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/3e87a060-d349-4347-a6d8-ea109f0da041_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117424411?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM18VOU/2025-12-02/image/c7e0059b-095e-42ff-98be-2932a418f62d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662383?view=catalogue)
2025-12-02 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM18VOU/2025-12-02/image/8c42d6d1-95f6-4c67-b313-62db0833b36b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662383?view=catalogue)
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117488496
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488496%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117488496: 0
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117584632
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584632%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117584632: 0
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117595959
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117595959%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117595959: 0
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117553434
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553434%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117553434: 0
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117611334
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117611334%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117611334: 0
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117607169
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117607169%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117607169: 0
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117484807
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117484807%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117484807: 0
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117542492
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542492%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117542492: 0
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117549874
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549874%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117549874: 2
2025-12-02 19:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf3726ed0>
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252F3badfd6c-4ee2-47c3-8491-0ebd0a495466_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/3badfd6c-4ee2-47c3-8491-0ebd0a495466_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52669e31-67d3-5cd8-9ca1-4e345de83c70
2025-12-02 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d7dd04b8-e937-4f63-af3a-b8d4afb935f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue)
2025-12-02 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/cd7da82f-372a-4200-a4d9-a87ddc1996e1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue)
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F12ddd530-3d88-4642-ae11-10cc4829c874_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/12ddd530-3d88-4642-ae11-10cc4829c874_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252Ff0cdc0a4-e1d3-40a5-961d-f5690e49642f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/f0cdc0a4-e1d3-40a5-961d-f5690e49642f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252Fb9e5f552-9d7f-45c8-a2d2-c7095da6a44e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/b9e5f552-9d7f-45c8-a2d2-c7095da6a44e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252F5536dae1-42da-4d30-b9cc-122f425aba6d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/5536dae1-42da-4d30-b9cc-122f425aba6d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252F3de95cae-e3cf-4748-8dc0-9a5bfad51400_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3de95cae-e3cf-4748-8dc0-9a5bfad51400_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fd94def93-7122-496c-a693-700a24ed74e8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d94def93-7122-496c-a693-700a24ed74e8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117634427?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117634478?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117600033?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117488596
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488596%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117488596: 0
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117539515
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539515%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117539515: 0
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117550696
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550696%27 HTTP/1.1" 200 None
2025-12-02 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117550696: 2
2025-12-02 19:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0946ed0>
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252Fa8e12838-1fd1-4e37-a66c-3393b69b6c16_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/a8e12838-1fd1-4e37-a66c-3393b69b6c16_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52669e31-67d3-5cd8-9ca1-4e345de83c70
2025-12-02 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252Ff9e664e9-18f3-422b-b182-c43ae6c37176_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/f9e664e9-18f3-422b-b182-c43ae6c37176_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F166df408-a2b7-4812-806d-a5eb8cd6ab32_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/166df408-a2b7-4812-806d-a5eb8cd6ab32_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252Fcb27b343-ef8f-4511-b30e-9b5cd1188805_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/cb27b343-ef8f-4511-b30e-9b5cd1188805_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252F288effb1-8abc-41d4-8a07-d2e858165642_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/288effb1-8abc-41d4-8a07-d2e858165642_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252Fe5e82012-b5b1-4ad9-b858-45c36be26c8e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/e5e82012-b5b1-4ad9-b858-45c36be26c8e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fa5de513b-34a4-4f72-8f27-c42680adb6d0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/a5de513b-34a4-4f72-8f27-c42680adb6d0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117424411, 'registration': 'KT65SOA', 'account': 'WIL004', 'make': 'CITROEN', 'model': 'C1 HATCHBACK (RC)', 'derivative': '1.2 PureTech Flair 5dr', 'mileage': 24538, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2223, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-01-28', 'fuel': 'Petrol', 'motExpiry': '2025-12-06', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KT65SOA/2025-11-28/image/b6e3580d-11e7-4326-98cc-b535e1520926_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/17a36c1a-4ee6-4288-ad39-98e8b19bc2cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/1fef7f51-a0e6-490a-8c1d-30a3dd18aa35_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/bb8b774d-227d-4e6b-b809-438c510adecf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/23ec1f3a-399b-43f5-8a2a-eec99f8ded07_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/d9441b79-2628-41c5-a161-54008ca2bc99_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/f9ee05bf-6339-4ce1-ba8f-9a722020cb15_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/4ec4cefe-3d83-4b1a-bb66-5d0b347468c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/c9557575-aa20-4afc-b177-9b116eac4b23_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 12/17 4K 12/18 6K 11/19 9K 11/20 12K 12/21 13K 12/22 16K 12/23 19K 12/24 21K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3b9225a8-45e9-49c2-a294-5292caea47b6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117424411, 'registration': 'KT65SOA', 'account': 'WIL004', 'make': 'CITROEN', 'model': 'C1 HATCHBACK (RC)', 'derivative': '1.2 PureTech Flair 5dr', 'mileage': 24538, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2223, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-01-28', 'fuel': 'Petrol', 'motExpiry': '2025-12-06', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KT65SOA/2025-11-28/image/b6e3580d-11e7-4326-98cc-b535e1520926_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/17a36c1a-4ee6-4288-ad39-98e8b19bc2cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/1fef7f51-a0e6-490a-8c1d-30a3dd18aa35_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/bb8b774d-227d-4e6b-b809-438c510adecf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/23ec1f3a-399b-43f5-8a2a-eec99f8ded07_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/d9441b79-2628-41c5-a161-54008ca2bc99_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/f9ee05bf-6339-4ce1-ba8f-9a722020cb15_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/4ec4cefe-3d83-4b1a-bb66-5d0b347468c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT65SOA/2025-11-28/image/c9557575-aa20-4afc-b177-9b116eac4b23_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 12/17 4K 12/18 6K 11/19 9K 11/20 12K 12/21 13K 12/22 16K 12/23 19K 12/24 21K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3b9225a8-45e9-49c2-a294-5292caea47b6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e2026c7-afab-5035-a581-f271a0df55b0 with identifier: 117424411
2025-12-02 19:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e2026c7-afab-5035-a581-f271a0df55b0 with scrape type 2
2025-12-02 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e2026c7-afab-5035-a581-f271a0df55b0 with scrape type 2
2025-12-02 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9e2026c7-afab-5035-a581-f271a0df55b0, identifier: 117424411
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1cf8890>
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252Fc7e0059b-095e-42ff-98be-2932a418f62d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/c7e0059b-095e-42ff-98be-2932a418f62d_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52669e31-67d3-5cd8-9ca1-4e345de83c70
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06dce10>
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252F8c42d6d1-95f6-4c67-b313-62db0833b36b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/8c42d6d1-95f6-4c67-b313-62db0833b36b_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52669e31-67d3-5cd8-9ca1-4e345de83c70
2025-12-02 19:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF66NXS/2025-12-02/image/5f208a1f-0607-4660-b860-7672dd9de736_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662353?view=catalogue)
2025-12-02 19:00:32 [astonbarclay.gb] INFO: Found listing with ID: 117493567
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117493567%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117493567: 0
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117609313
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609313%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117609313: 0
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117548257
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548257%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117548257: 0
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117492284
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492284%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117492284: 0
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117494253
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117494253%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117494253: 0
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117536984
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117536984%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117536984: 0
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117544119
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544119%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117544119: 0
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117598923
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598923%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117598923: 0
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117539643
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539643%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117539643: 0
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117542115
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542115%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117542115: 2
2025-12-02 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9e2026c7-afab-5035-a581-f271a0df55b0 with identifier: 117424411
2025-12-02 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9e2026c7-afab-5035-a581-f271a0df55b0 with identifier: 117424411
2025-12-02 19:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9e2026c7-afab-5035-a581-f271a0df55b0 with identifier: 117424411 to the API
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279e2026c7-afab-5035-a581-f271a0df55b0%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9e2026c7-afab-5035-a581-f271a0df55b0: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:00:32 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117424411?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '9e2026c7-afab-5035-a581-f271a0df55b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KT65SOA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117424411',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'CITROEN',
 'model': 'C1 HATCHBACK (RC)',
 'odometer': 24538,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-28',
 'seller_name': 'Wilsons',
 'title': 'CITROEN C1 HATCHBACK (RC) 1.2 PureTech Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Flair 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424411%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [astonbarclay.gb] INFO: Saving data for 117424411: {'auction_closing_time': 1764755100.0, 'created_time': 1764234061.010928, 'last_price_update_time': 1764702033.427245}
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117424411') HTTP/1.1" 204 0
2025-12-02 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF66NXS/2025-12-02/image/a5e0cb28-673b-4ea7-8be2-091bedc15c73_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662353?view=catalogue)
2025-12-02 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD70MVG/2025-12-02/image/5ab5850a-ccf1-48f3-a062-44ef4c5aee28_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue)
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F3e4906e6-0399-4996-91b5-397a69195db3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/3e4906e6-0399-4996-91b5-397a69195db3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252F41f02a38-2e62-4634-9a46-ac1b4c2db1cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/41f02a38-2e62-4634-9a46-ac1b4c2db1cc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252F96e1bdc1-e777-490e-8d10-8846db4f4257_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/96e1bdc1-e777-490e-8d10-8846db4f4257_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252F55b525a7-1d87-475a-a34c-015eb1c9d665_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/55b525a7-1d87-475a-a34c-015eb1c9d665_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117634437?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0778250>
2025-12-02 19:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fd7dd04b8-e937-4f63-af3a-b8d4afb935f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d7dd04b8-e937-4f63-af3a-b8d4afb935f7_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:00:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0796a10>
2025-12-02 19:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252Fcd7da82f-372a-4200-a4d9-a87ddc1996e1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/cd7da82f-372a-4200-a4d9-a87ddc1996e1_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117634427, 'registration': 'VX69OMA', 'account': 'MER023', 'make': 'SUZUKI', 'model': 'IGNIS HATCHBACK', 'derivative': '1.2 Dualjet SHVS SZ-T 5dr', 'mileage': 57117, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2310, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-18', 'fuel': 'Petrol', 'motExpiry': '2026-04-25', 'doors': 5, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VX69OMA/2025-12-02/image/5869601d-16f8-4079-b6f5-fb53fd74ee3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/ab165de7-34ca-424c-be46-3d530345a0c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/d17fc5a2-0953-4c0c-aee7-60933a03b429_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/fc967ccb-9da1-46f0-bdd5-a8a006dfa767_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/51962326-1f02-460b-b0ca-2e0b0f73e672_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/f869c3e0-655f-4956-9f96-0cc788d57eec_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/aefccbd7-df7a-42e8-aa4d-50d477e6bb9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/1552f193-d154-4a0a-89ee-53b79dbfc7f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/feeebb7f-bea8-4fcc-bd53-ec35d919e63c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 04/25 53K', 'remarks': 'SD CARD / NO SPARE KEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 98, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4679b212-49e4-4faa-b973-799b12c9c3a2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117634427, 'registration': 'VX69OMA', 'account': 'MER023', 'make': 'SUZUKI', 'model': 'IGNIS HATCHBACK', 'derivative': '1.2 Dualjet SHVS SZ-T 5dr', 'mileage': 57117, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2310, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-18', 'fuel': 'Petrol', 'motExpiry': '2026-04-25', 'doors': 5, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VX69OMA/2025-12-02/image/5869601d-16f8-4079-b6f5-fb53fd74ee3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/ab165de7-34ca-424c-be46-3d530345a0c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/d17fc5a2-0953-4c0c-aee7-60933a03b429_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/fc967ccb-9da1-46f0-bdd5-a8a006dfa767_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/51962326-1f02-460b-b0ca-2e0b0f73e672_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/f869c3e0-655f-4956-9f96-0cc788d57eec_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/aefccbd7-df7a-42e8-aa4d-50d477e6bb9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/1552f193-d154-4a0a-89ee-53b79dbfc7f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/feeebb7f-bea8-4fcc-bd53-ec35d919e63c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 04/25 53K', 'remarks': 'SD CARD / NO SPARE KEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 98, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4679b212-49e4-4faa-b973-799b12c9c3a2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 947e4204-0720-5876-bad2-6dad899f30d7 with identifier: 117634427
2025-12-02 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 947e4204-0720-5876-bad2-6dad899f30d7 with scrape type 1
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 947e4204-0720-5876-bad2-6dad899f30d7
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252F5869601d-16f8-4079-b6f5-fb53fd74ee3c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/5869601d-16f8-4079-b6f5-fb53fd74ee3c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117507998, 'registration': 'WF69LTY', 'account': 'WIL004', 'make': 'PEUGEOT', 'model': '5008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure 5dr', 'mileage': 69830, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2221, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-14', 'fuel': 'Diesel', 'motExpiry': '2025-12-13', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WF69LTY/2025-12-02/image/ebba9d94-d048-40ae-ae2c-02dce2f59879_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/d7816e03-49d0-4507-be86-3cb520c3a2ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/c82a6c11-57dd-4ca7-9bbb-da86b4c3152c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e1cd49a7-747a-4449-8f7c-63d3e07418ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/29e5e650-0a5f-4881-b0e8-6b7a04b100f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/6701d40e-48f2-4334-96fe-482f81e13cae_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/0af3fb97-8ce3-45e0-9184-c553b71405e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e468d304-4f9f-4ca5-b567-be5d4744ca49_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/56dc19a4-1203-4f50-8f6e-f66647fcd2f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/37378945-9be0-4147-b384-ab49c666020a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 06/25 59K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bd67746-5097-4c71-b047-951dc1e77cbc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117507998, 'registration': 'WF69LTY', 'account': 'WIL004', 'make': 'PEUGEOT', 'model': '5008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure 5dr', 'mileage': 69830, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2221, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-14', 'fuel': 'Diesel', 'motExpiry': '2025-12-13', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WF69LTY/2025-12-02/image/ebba9d94-d048-40ae-ae2c-02dce2f59879_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/d7816e03-49d0-4507-be86-3cb520c3a2ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/c82a6c11-57dd-4ca7-9bbb-da86b4c3152c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e1cd49a7-747a-4449-8f7c-63d3e07418ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/29e5e650-0a5f-4881-b0e8-6b7a04b100f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/6701d40e-48f2-4334-96fe-482f81e13cae_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/0af3fb97-8ce3-45e0-9184-c553b71405e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e468d304-4f9f-4ca5-b567-be5d4744ca49_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/56dc19a4-1203-4f50-8f6e-f66647fcd2f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/37378945-9be0-4147-b384-ab49c666020a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 06/25 59K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bd67746-5097-4c71-b047-951dc1e77cbc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fe52d45-63a2-53ab-8319-e0b8532403ce with identifier: 117507998
2025-12-02 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fe52d45-63a2-53ab-8319-e0b8532403ce with scrape type 1
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4fe52d45-63a2-53ab-8319-e0b8532403ce
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252Febba9d94-d048-40ae-ae2c-02dce2f59879_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/ebba9d94-d048-40ae-ae2c-02dce2f59879_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117634478, 'registration': 'YK16VHA', 'account': 'MER023', 'make': 'PEUGEOT', 'model': '108 HATCHBACK', 'derivative': '1.2 PureTech Allure 3dr', 'mileage': 28078, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2309, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-25', 'fuel': 'Petrol', 'motExpiry': '2026-10-26', 'doors': 3, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YK16VHA/2025-12-02/image/53781a91-2e19-4ff8-b24a-04a2d0b4252f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/e6b915f7-c1c6-489e-b833-fe7f408acf6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/56839c9f-ed79-4986-9789-bc4e53f28fe0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/6b7f3635-b050-478a-938e-a2137ebf2984_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/2e638dff-170f-4acc-a160-24f93fd48d2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/83947f5e-e6cf-42e0-9105-7cb241d3b39e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/06659b41-2032-478d-bc81-59901621a370_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is front end and side NO SPARE KEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/be990718-9db1-4266-8bf5-0fed267546fd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117634478, 'registration': 'YK16VHA', 'account': 'MER023', 'make': 'PEUGEOT', 'model': '108 HATCHBACK', 'derivative': '1.2 PureTech Allure 3dr', 'mileage': 28078, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2309, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-25', 'fuel': 'Petrol', 'motExpiry': '2026-10-26', 'doors': 3, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YK16VHA/2025-12-02/image/53781a91-2e19-4ff8-b24a-04a2d0b4252f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/e6b915f7-c1c6-489e-b833-fe7f408acf6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/56839c9f-ed79-4986-9789-bc4e53f28fe0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/6b7f3635-b050-478a-938e-a2137ebf2984_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/2e638dff-170f-4acc-a160-24f93fd48d2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/83947f5e-e6cf-42e0-9105-7cb241d3b39e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/06659b41-2032-478d-bc81-59901621a370_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is front end and side NO SPARE KEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/be990718-9db1-4266-8bf5-0fed267546fd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf502d3f-3084-5f78-b546-5e0d0e94ab79 with identifier: 117634478
2025-12-02 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf502d3f-3084-5f78-b546-5e0d0e94ab79 with scrape type 1
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item cf502d3f-3084-5f78-b546-5e0d0e94ab79
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F53781a91-2e19-4ff8-b24a-04a2d0b4252f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/53781a91-2e19-4ff8-b24a-04a2d0b4252f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117507965, 'registration': 'KY67WSL', 'account': 'WIL004', 'make': 'BMW', 'model': 'I3 HATCHBACK', 'derivative': '125kW 33kWh 5dr Auto', 'mileage': 69400, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2229, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-11-17', 'fuel': 'Electric', 'motExpiry': '2026-01-12', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KY67WSL/2025-12-02/image/8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/b8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital 10/19 18k 09/21 30k 11/25 69k', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9b3d3e85-c8c4-4d88-ad1b-a3ccdd99aa9e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117507965, 'registration': 'KY67WSL', 'account': 'WIL004', 'make': 'BMW', 'model': 'I3 HATCHBACK', 'derivative': '125kW 33kWh 5dr Auto', 'mileage': 69400, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2229, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-11-17', 'fuel': 'Electric', 'motExpiry': '2026-01-12', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KY67WSL/2025-12-02/image/8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/b8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital 10/19 18k 09/21 30k 11/25 69k', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9b3d3e85-c8c4-4d88-ad1b-a3ccdd99aa9e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddf82103-8962-573a-a369-6a474c10af32 with identifier: 117507965
2025-12-02 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddf82103-8962-573a-a369-6a474c10af32 with scrape type 1
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117507988, 'registration': 'HN16PZZ', 'account': 'WIL004', 'make': 'BMW', 'model': 'I3 HATCHBACK', 'derivative': '125kW 5dr Auto', 'mileage': 40333, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2231, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-04-22', 'fuel': 'Electric', 'motExpiry': '2026-02-18', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/c1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/cb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/d22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital 01/19 9k 03/21 23k 02/23 30k', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a43e892-98b1-4210-96bd-76be9b6b29a0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117507988, 'registration': 'HN16PZZ', 'account': 'WIL004', 'make': 'BMW', 'model': 'I3 HATCHBACK', 'derivative': '125kW 5dr Auto', 'mileage': 40333, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2231, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-04-22', 'fuel': 'Electric', 'motExpiry': '2026-02-18', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/c1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/cb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/d22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital 01/19 9k 03/21 23k 02/23 30k', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a43e892-98b1-4210-96bd-76be9b6b29a0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 357b359d-a312-5739-8e8e-89d273bf3234 with identifier: 117507988
2025-12-02 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 357b359d-a312-5739-8e8e-89d273bf3234 with scrape type 1
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252Fc1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/c1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117600033, 'registration': 'LG18XNU', 'account': 'WIL004', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Pop 3dr', 'mileage': 53009, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2225, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-03-28', 'fuel': 'Petrol', 'motExpiry': '2026-03-27', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LG18XNU/2025-12-02/image/514ec32c-d084-4af5-accd-5b2b63485551_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/36eab235-5216-4ff7-b08c-64ea7e7dc5bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/0db97c86-0e25-4dab-ba9b-9bf0306f70c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/ef0963f0-8c1c-44d1-a99f-63c58ea64049_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/58f39e7f-9914-4196-9253-2b99e603c9fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/d731dbf0-8ef8-443e-afb2-7a9b2feb19a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/1d649000-b062-4b26-9035-2de748b37738_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/e1a8cede-7758-49aa-bad4-bae423261dff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/fe521320-6e60-4dc2-b4a0-a4b7dd7f440f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 04/19 6K 06/20 11K 03/21 16K 03/21 23K (SB ERROR) 03/23 76K (SB ERROR) 03/24 38K  03/25 47K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/306cda6f-5122-465b-88e3-d991267af878.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117600033, 'registration': 'LG18XNU', 'account': 'WIL004', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Pop 3dr', 'mileage': 53009, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2225, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-03-28', 'fuel': 'Petrol', 'motExpiry': '2026-03-27', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LG18XNU/2025-12-02/image/514ec32c-d084-4af5-accd-5b2b63485551_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/36eab235-5216-4ff7-b08c-64ea7e7dc5bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/0db97c86-0e25-4dab-ba9b-9bf0306f70c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/ef0963f0-8c1c-44d1-a99f-63c58ea64049_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/58f39e7f-9914-4196-9253-2b99e603c9fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/d731dbf0-8ef8-443e-afb2-7a9b2feb19a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/1d649000-b062-4b26-9035-2de748b37738_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/e1a8cede-7758-49aa-bad4-bae423261dff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/fe521320-6e60-4dc2-b4a0-a4b7dd7f440f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 04/19 6K 06/20 11K 03/21 16K 03/21 23K (SB ERROR) 03/23 76K (SB ERROR) 03/24 38K  03/25 47K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/306cda6f-5122-465b-88e3-d991267af878.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b091cd87-d12e-5c8f-9314-65e89b8dc3ac with identifier: 117600033
2025-12-02 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac with scrape type 1
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252F514ec32c-d084-4af5-accd-5b2b63485551_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/514ec32c-d084-4af5-accd-5b2b63485551_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19EOB/2025-12-02/image/cbc6017d-c189-43ca-8bc7-5235cfaf0482_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue)
2025-12-02 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD70MVG/2025-12-02/image/3e87a060-d349-4347-a6d8-ea109f0da041_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue)
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117537448
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537448%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117537448: 0
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117541958
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117541958%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117541958: 0
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117550449
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550449%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117550449: 0
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117552007
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117552007%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117552007: 0
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117541699
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117541699%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117541699: 0
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117498338
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498338%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117498338: 0
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117501383
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117501383%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117501383: 0
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117552056
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117552056%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117552056: 0
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117557140
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117557140%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117557140: 0
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117558544
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117558544%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117558544: 2
2025-12-02 19:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252Ff4187a4f-ffa5-477b-996f-26133ae180da_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/f4187a4f-ffa5-477b-996f-26133ae180da_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fc3c852dc-35a4-491b-8c87-be61d14fe8fe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/c3c852dc-35a4-491b-8c87-be61d14fe8fe_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Fab165de7-34ca-424c-be46-3d530345a0c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/ab165de7-34ca-424c-be46-3d530345a0c2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252Fd7816e03-49d0-4507-be86-3cb520c3a2ea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/d7816e03-49d0-4507-be86-3cb520c3a2ea_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252Fe6b915f7-c1c6-489e-b833-fe7f408acf6b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/e6b915f7-c1c6-489e-b833-fe7f408acf6b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252Fcb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/cb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252F36eab235-5216-4ff7-b08c-64ea7e7dc5bf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/36eab235-5216-4ff7-b08c-64ea7e7dc5bf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0925990>
2025-12-02 19:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252F5f208a1f-0607-4660-b860-7672dd9de736_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/5f208a1f-0607-4660-b860-7672dd9de736_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4719489b-1fba-5fbc-a000-82ecc981e7c2
2025-12-02 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117558044
2025-12-02 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117558044%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117558044: 0
2025-12-02 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 109140236
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27109140236%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [astonbarclay.gb] INFO: Scrape type for 109140236: 2
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf060b850>
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252Fa5e0cb28-673b-4ea7-8be2-091bedc15c73_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/a5e0cb28-673b-4ea7-8be2-091bedc15c73_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4719489b-1fba-5fbc-a000-82ecc981e7c2
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0642b90>
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252F5ab5850a-ccf1-48f3-a062-44ef4c5aee28_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/5ab5850a-ccf1-48f3-a062-44ef4c5aee28_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:00:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117634437, 'registration': 'PK16LSX', 'account': 'MER023', 'make': 'AUDI', 'model': 'Q5 ESTATE SPECIAL EDITIONS', 'derivative': '2.0 TDI [190] Quattro S Line Plus 5dr S Tronic', 'mileage': 93933, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2313, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-01-25', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PL16LSX/2025-12-02/image/719324e0-de27-4e14-b714-3a5c06a2a220_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/6043935d-f9a9-4bfb-875e-628744aed9d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/51ccb9ae-76ed-47a4-b517-548572c1a0ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/f487d300-e5d2-4d72-a9a8-f98804a27af7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/b2d0bb6d-4638-4aab-af45-acd6b2d165c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/0df47926-12ea-4ce2-b22c-043f4443abc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/c56ccd0a-e4a5-4f1c-8a46-4788fd327b13_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/2c878d17-3181-4357-8e18-f455692c5031_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/d765ab40-95ef-4f6f-b5d8-d83ffe00cd17_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book S/P @ 08/17 19K INV @ 01/24 77K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc854a14-8b7f-48ac-807d-c7254c7b9941.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117634437, 'registration': 'PK16LSX', 'account': 'MER023', 'make': 'AUDI', 'model': 'Q5 ESTATE SPECIAL EDITIONS', 'derivative': '2.0 TDI [190] Quattro S Line Plus 5dr S Tronic', 'mileage': 93933, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2313, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-01-25', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PL16LSX/2025-12-02/image/719324e0-de27-4e14-b714-3a5c06a2a220_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/6043935d-f9a9-4bfb-875e-628744aed9d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/51ccb9ae-76ed-47a4-b517-548572c1a0ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/f487d300-e5d2-4d72-a9a8-f98804a27af7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/b2d0bb6d-4638-4aab-af45-acd6b2d165c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/0df47926-12ea-4ce2-b22c-043f4443abc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/c56ccd0a-e4a5-4f1c-8a46-4788fd327b13_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/2c878d17-3181-4357-8e18-f455692c5031_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/d765ab40-95ef-4f6f-b5d8-d83ffe00cd17_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book S/P @ 08/17 19K INV @ 01/24 77K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc854a14-8b7f-48ac-807d-c7254c7b9941.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f128729-4f66-5610-a7f4-9ce4667c373f with identifier: 117634437
2025-12-02 19:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f128729-4f66-5610-a7f4-9ce4667c373f with scrape type 1
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 4f128729-4f66-5610-a7f4-9ce4667c373f
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252F719324e0-de27-4e14-b714-3a5c06a2a220_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/719324e0-de27-4e14-b714-3a5c06a2a220_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF66NXS/2025-12-02/image/e5e82012-b5b1-4ad9-b858-45c36be26c8e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662353?view=catalogue)
2025-12-02 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD70MVG/2025-12-02/image/a5de513b-34a4-4f72-8f27-c42680adb6d0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue)
2025-12-02 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19EOB/2025-12-02/image/288effb1-8abc-41d4-8a07-d2e858165642_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue)
2025-12-02 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ea46bbf0-2291-4923-991a-e4d7ec889044_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue)
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252F95fcc619-4c1a-4f66-a40f-1108cb5b2a3a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/95fcc619-4c1a-4f66-a40f-1108cb5b2a3a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Fd17fc5a2-0953-4c0c-aee7-60933a03b429_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/d17fc5a2-0953-4c0c-aee7-60933a03b429_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252Fc82a6c11-57dd-4ca7-9bbb-da86b4c3152c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/c82a6c11-57dd-4ca7-9bbb-da86b4c3152c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F56839c9f-ed79-4986-9789-bc4e53f28fe0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/56839c9f-ed79-4986-9789-bc4e53f28fe0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252F0db97c86-0e25-4dab-ba9b-9bf0306f70c9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/0db97c86-0e25-4dab-ba9b-9bf0306f70c9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL17AHX/2025-12-02/image/cb27b343-ef8f-4511-b30e-9b5cd1188805_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661923?view=catalogue)
2025-12-02 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117570189
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570189%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117570189: 2
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252F6043935d-f9a9-4bfb-875e-628744aed9d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/6043935d-f9a9-4bfb-875e-628744aed9d2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117614027?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117628577?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117549874?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08f9e50>
2025-12-02 19:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252Fcbc6017d-c189-43ca-8bc7-5235cfaf0482_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/cbc6017d-c189-43ca-8bc7-5235cfaf0482_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09b7250>
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252F3e87a060-d349-4347-a6d8-ea109f0da041_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/3e87a060-d349-4347-a6d8-ea109f0da041_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Ffc967ccb-9da1-46f0-bdd5-a8a006dfa767_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/fc967ccb-9da1-46f0-bdd5-a8a006dfa767_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252Fe1cd49a7-747a-4449-8f7c-63d3e07418ab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e1cd49a7-747a-4449-8f7c-63d3e07418ab_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F6b7f3635-b050-478a-938e-a2137ebf2984_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/6b7f3635-b050-478a-938e-a2137ebf2984_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252Fd6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252Fef0963f0-8c1c-44d1-a99f-63c58ea64049_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/ef0963f0-8c1c-44d1-a99f-63c58ea64049_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117077436?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117573652
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573652%27 HTTP/1.1" 200 None
2025-12-02 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117573652: 2
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252F51ccb9ae-76ed-47a4-b517-548572c1a0ea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/51ccb9ae-76ed-47a4-b517-548572c1a0ea_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117339017?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117625623?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a8a610>
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252Fe5e82012-b5b1-4ad9-b858-45c36be26c8e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/e5e82012-b5b1-4ad9-b858-45c36be26c8e_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4719489b-1fba-5fbc-a000-82ecc981e7c2
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf061f7d0>
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fa5de513b-34a4-4f72-8f27-c42680adb6d0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/a5de513b-34a4-4f72-8f27-c42680adb6d0_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0589390>
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252F288effb1-8abc-41d4-8a07-d2e858165642_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/288effb1-8abc-41d4-8a07-d2e858165642_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0875210>
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252Fea46bbf0-2291-4923-991a-e4d7ec889044_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ea46bbf0-2291-4923-991a-e4d7ec889044_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7
2025-12-02 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS18MMO/2025-12-02/image/5c6f1c4e-1378-46c6-85d5-a622a28748e7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue)
2025-12-02 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL17AHX/2025-12-02/image/21e4c5f5-4b42-4dc3-9145-94b55612a23a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661923?view=catalogue)
2025-12-02 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL16LSX/2025-12-02/image/719324e0-de27-4e14-b714-3a5c06a2a220_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634437?view=catalogue)
2025-12-02 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG18XNU/2025-12-02/image/36eab235-5216-4ff7-b08c-64ea7e7dc5bf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600033?view=catalogue)
2025-12-02 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/cb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue)
2025-12-02 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67WSL/2025-12-02/image/2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue)
2025-12-02 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/166df408-a2b7-4812-806d-a5eb8cd6ab32_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue)
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252F51962326-1f02-460b-b0ca-2e0b0f73e672_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/51962326-1f02-460b-b0ca-2e0b0f73e672_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252F29e5e650-0a5f-4881-b0e8-6b7a04b100f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/29e5e650-0a5f-4881-b0e8-6b7a04b100f5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F2e638dff-170f-4acc-a160-24f93fd48d2f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/2e638dff-170f-4acc-a160-24f93fd48d2f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252Fc2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252F58f39e7f-9914-4196-9253-2b99e603c9fd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/58f39e7f-9914-4196-9253-2b99e603c9fd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf062b210>
2025-12-02 19:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252Fcb27b343-ef8f-4511-b30e-9b5cd1188805_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/cb27b343-ef8f-4511-b30e-9b5cd1188805_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f
2025-12-02 19:00:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117614027, 'registration': 'VN22AWH', 'account': 'STE094', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS SALOON SPECIAL EDITIONS', 'derivative': 'A180d AMG Line Premium Edition 4dr Auto', 'mileage': 41895, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1129, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-04-21', 'fuel': 'Diesel', 'motExpiry': '2026-06-01', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/VN22AWH/2025-12-02/image/0733037a-40a2-407c-b820-b08821009ea3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ffe8c206-6654-4bc2-8b2b-3be36c6d96e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/3362e9a0-8a77-4e1d-9317-6a1d22d29a27_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/fd78f66e-27a8-4165-ad1a-ab887c18a71f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/26d5c4a3-3487-4953-83e7-bfac19d0b756_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/63d872dc-7494-4fab-8982-31a8594b6c93_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/07f574d2-02b5-48ca-a881-65e3ef8ba953_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ef98a5a3-14ff-4938-af3a-a2645bfd9fad_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/d82fd6f9-51bb-4a18-b147-5b0aa0fab017_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9d4f2077-eb54-436c-b10d-9a2d9c203768.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117614027, 'registration': 'VN22AWH', 'account': 'STE094', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS SALOON SPECIAL EDITIONS', 'derivative': 'A180d AMG Line Premium Edition 4dr Auto', 'mileage': 41895, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1129, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-04-21', 'fuel': 'Diesel', 'motExpiry': '2026-06-01', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/VN22AWH/2025-12-02/image/0733037a-40a2-407c-b820-b08821009ea3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ffe8c206-6654-4bc2-8b2b-3be36c6d96e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/3362e9a0-8a77-4e1d-9317-6a1d22d29a27_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/fd78f66e-27a8-4165-ad1a-ab887c18a71f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/26d5c4a3-3487-4953-83e7-bfac19d0b756_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/63d872dc-7494-4fab-8982-31a8594b6c93_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/07f574d2-02b5-48ca-a881-65e3ef8ba953_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ef98a5a3-14ff-4938-af3a-a2645bfd9fad_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/d82fd6f9-51bb-4a18-b147-5b0aa0fab017_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9d4f2077-eb54-436c-b10d-9a2d9c203768.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c94306fc-28f5-5b2e-9b3c-50581b7acee8 with identifier: 117614027
2025-12-02 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c94306fc-28f5-5b2e-9b3c-50581b7acee8 with scrape type 1
2025-12-02 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item c94306fc-28f5-5b2e-9b3c-50581b7acee8
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252F0733037a-40a2-407c-b820-b08821009ea3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/0733037a-40a2-407c-b820-b08821009ea3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117628577, 'registration': 'LL67XME', 'account': 'STE097', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper 3dr Auto', 'mileage': 59127, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1126, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-11-22', 'fuel': 'Petrol', 'motExpiry': '2026-11-25', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL67XME/2025-12-02/image/252f9f3e-84d8-4765-bd2a-0603b1d68223_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/899a345e-f22a-4971-8a52-919777198454_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/9a2cb65a-88b7-4d15-b814-474a82685a23_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/65982844-45ad-4fb3-8459-88f8770809b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/426147eb-6fff-41b8-a00a-7f248c18c6a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/c2e8d6bd-a8f5-4acb-b9a5-fb9a5e982c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/2442a66a-1fde-418f-8bb4-e2c183de5829_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/34d9e106-b052-49d8-9825-61799dc227f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/a62ed79c-00b7-4b83-94c4-4c0875e129b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/4a4248ed-ff7b-438b-bd82-ad0332b971a5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/19 11K - 06/20 16K - 09/21 26K -', 'remarks': 'VOSA STATES 26K- 41K- 54K- 59K-', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e76f074d-9ed9-4938-b201-c20f2b17b0d4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117628577, 'registration': 'LL67XME', 'account': 'STE097', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper 3dr Auto', 'mileage': 59127, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1126, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-11-22', 'fuel': 'Petrol', 'motExpiry': '2026-11-25', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL67XME/2025-12-02/image/252f9f3e-84d8-4765-bd2a-0603b1d68223_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/899a345e-f22a-4971-8a52-919777198454_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/9a2cb65a-88b7-4d15-b814-474a82685a23_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/65982844-45ad-4fb3-8459-88f8770809b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/426147eb-6fff-41b8-a00a-7f248c18c6a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/c2e8d6bd-a8f5-4acb-b9a5-fb9a5e982c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/2442a66a-1fde-418f-8bb4-e2c183de5829_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/34d9e106-b052-49d8-9825-61799dc227f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/a62ed79c-00b7-4b83-94c4-4c0875e129b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/4a4248ed-ff7b-438b-bd82-ad0332b971a5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/19 11K - 06/20 16K - 09/21 26K -', 'remarks': 'VOSA STATES 26K- 41K- 54K- 59K-', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e76f074d-9ed9-4938-b201-c20f2b17b0d4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35 with identifier: 117628577
2025-12-02 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35 with scrape type 1
2025-12-02 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F252f9f3e-84d8-4765-bd2a-0603b1d68223_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/252f9f3e-84d8-4765-bd2a-0603b1d68223_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117549874, 'registration': 'BW67KMO', 'account': 'WBA002', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '3.0d V6 Portfolio 5dr Auto AWD', 'mileage': 36591, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1309, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-02-16', 'fuel': 'Diesel', 'motExpiry': '2026-02-15', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BW67KMO/2025-11-27/image/fb76ccf8-c434-4d6e-82a3-867c2717e3dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/a0c362e4-fdea-4430-ab42-45ca6c009133_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/5898db8b-2f7e-477e-b089-9ce04f55fc73_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/fc2fa7ca-fd2b-4a31-b8c4-01e52797f979_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/5d51b4f7-7ea9-4646-ab12-e62425b55998_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/d7b39b75-927a-4a3d-a30f-81151f37d82a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/f976889d-90ee-4f6b-a6b2-23034a8b2259_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/585b46ac-1f52-4951-ab38-0c5f30100264_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/2e63a0e7-a9a7-4afc-b179-1f06f931a296_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/799ca787-85b4-4b06-9da8-fdedeff8e213_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/20- 13K, 05/21- 18K, 06/22- 23K, 07/23- 26K, 07/24- 30K', 'remarks': 'VOSA STATES 21K, 24K, 28K, 32K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa74e81f-2f73-48db-81cd-10487ae16692.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117549874, 'registration': 'BW67KMO', 'account': 'WBA002', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '3.0d V6 Portfolio 5dr Auto AWD', 'mileage': 36591, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1309, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-02-16', 'fuel': 'Diesel', 'motExpiry': '2026-02-15', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BW67KMO/2025-11-27/image/fb76ccf8-c434-4d6e-82a3-867c2717e3dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/a0c362e4-fdea-4430-ab42-45ca6c009133_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/5898db8b-2f7e-477e-b089-9ce04f55fc73_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/fc2fa7ca-fd2b-4a31-b8c4-01e52797f979_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/5d51b4f7-7ea9-4646-ab12-e62425b55998_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/d7b39b75-927a-4a3d-a30f-81151f37d82a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/f976889d-90ee-4f6b-a6b2-23034a8b2259_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/585b46ac-1f52-4951-ab38-0c5f30100264_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/2e63a0e7-a9a7-4afc-b179-1f06f931a296_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW67KMO/2025-11-27/image/799ca787-85b4-4b06-9da8-fdedeff8e213_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/20- 13K, 05/21- 18K, 06/22- 23K, 07/23- 26K, 07/24- 30K', 'remarks': 'VOSA STATES 21K, 24K, 28K, 32K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa74e81f-2f73-48db-81cd-10487ae16692.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48fe0c96-3a4c-5c0c-adb2-6fa64870d22a with identifier: 117549874
2025-12-02 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48fe0c96-3a4c-5c0c-adb2-6fa64870d22a with scrape type 2
2025-12-02 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48fe0c96-3a4c-5c0c-adb2-6fa64870d22a with scrape type 2
2025-12-02 19:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 48fe0c96-3a4c-5c0c-adb2-6fa64870d22a, identifier: 117549874
2025-12-02 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/923ed404-47b5-487a-b6b7-d992452917d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue)
2025-12-02 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117615900
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615900%27 HTTP/1.1" 200 None
2025-12-02 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117615900: 0
2025-12-02 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117542051
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542051%27 HTTP/1.1" 200 None
2025-12-02 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117542051: 2
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252Ff487d300-e5d2-4d72-a9a8-f98804a27af7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/f487d300-e5d2-4d72-a9a8-f98804a27af7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 48fe0c96-3a4c-5c0c-adb2-6fa64870d22a with identifier: 117549874
2025-12-02 19:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 48fe0c96-3a4c-5c0c-adb2-6fa64870d22a with identifier: 117549874
2025-12-02 19:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 48fe0c96-3a4c-5c0c-adb2-6fa64870d22a with identifier: 117549874 to the API
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117549874?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '48fe0c96-3a4c-5c0c-adb2-6fa64870d22a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BW67KMO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117549874',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JAGUAR',
 'model': 'F-PACE DIESEL ESTATE',
 'odometer': 36591,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-16',
 'seller_name': 'UKCGR - Premium',
 'title': 'JAGUAR F-PACE DIESEL ESTATE 3.0d V6 Portfolio 5dr Auto AWD',
 'transmission': 'automatic',
 'trim': '3.0d V6 Portfolio 5dr Auto AWD',
 'vin': None,
 'year': 2018}
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549874%27 HTTP/1.1" 200 None
2025-12-02 19:00:38 [astonbarclay.gb] INFO: Saving data for 117549874: {'auction_closing_time': 1764756000.0, 'created_time': 1764356610.424158, 'last_price_update_time': 1764702038.90351}
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117549874') HTTP/1.1" 204 0
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Ff869c3e0-655f-4956-9f96-0cc788d57eec_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/f869c3e0-655f-4956-9f96-0cc788d57eec_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252F6701d40e-48f2-4334-96fe-482f81e13cae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/6701d40e-48f2-4334-96fe-482f81e13cae_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F83947f5e-e6cf-42e0-9105-7cb241d3b39e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/83947f5e-e6cf-42e0-9105-7cb241d3b39e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252Fbb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252Fd731dbf0-8ef8-443e-afb2-7a9b2feb19a0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/d731dbf0-8ef8-443e-afb2-7a9b2feb19a0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252Fffe8c206-6654-4bc2-8b2b-3be36c6d96e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ffe8c206-6654-4bc2-8b2b-3be36c6d96e3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F899a345e-f22a-4971-8a52-919777198454_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/899a345e-f22a-4971-8a52-919777198454_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117077436, 'registration': 'LV70DKK', 'account': 'STE009', 'make': 'BMW', 'model': 'X5 ESTATE', 'derivative': 'xDrive45e M Sport 5dr Auto', 'mileage': 145107, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1122, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-11-13', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-11-12', 'doors': 5, 'engineSize': 2998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV70DKK/2025-11-20/image/5019cff0-c8a1-4a28-bcd4-edb47ca76122_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/a80ee9f1-9600-4309-84f7-2bb60118545c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/0130de73-b247-442e-bf81-0749cc5fcf55_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/ef26fb95-fcfa-4730-bef8-b80bb568b53d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/5418af2d-94c9-466d-9a8d-7c4d34b28a3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/d023e148-8d35-4232-bc07-6044fe3ee2b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/1c5a05d5-1f8e-4f85-b1ab-bbfafb962ae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/3a2321d5-2d38-4676-8613-3f4d591d0468_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/24e26f48-dfbb-4be8-b705-f64c1779d94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/411b5571-a89f-4112-bc0c-2eb266ada736_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/89cb84a4-35ca-4cf1-a64f-a7d1f505e180_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/21-21K, 06/22-41K, 12/22-60K, 08/23-79K, 03/24-100K, 11/24-120K. 08/25 139K', 'remarks': 'VOSA STATES MILES@ 85K, 120K, 145K. SPARE KEY IN OFFICE.', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f46333f8-d074-4029-b52b-9f39ce1b61cf.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117077436, 'registration': 'LV70DKK', 'account': 'STE009', 'make': 'BMW', 'model': 'X5 ESTATE', 'derivative': 'xDrive45e M Sport 5dr Auto', 'mileage': 145107, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1122, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-11-13', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-11-12', 'doors': 5, 'engineSize': 2998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV70DKK/2025-11-20/image/5019cff0-c8a1-4a28-bcd4-edb47ca76122_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/a80ee9f1-9600-4309-84f7-2bb60118545c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/0130de73-b247-442e-bf81-0749cc5fcf55_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/ef26fb95-fcfa-4730-bef8-b80bb568b53d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/5418af2d-94c9-466d-9a8d-7c4d34b28a3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/d023e148-8d35-4232-bc07-6044fe3ee2b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/1c5a05d5-1f8e-4f85-b1ab-bbfafb962ae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/3a2321d5-2d38-4676-8613-3f4d591d0468_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/24e26f48-dfbb-4be8-b705-f64c1779d94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/411b5571-a89f-4112-bc0c-2eb266ada736_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/89cb84a4-35ca-4cf1-a64f-a7d1f505e180_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/21-21K, 06/22-41K, 12/22-60K, 08/23-79K, 03/24-100K, 11/24-120K. 08/25 139K', 'remarks': 'VOSA STATES MILES@ 85K, 120K, 145K. SPARE KEY IN OFFICE.', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f46333f8-d074-4029-b52b-9f39ce1b61cf.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da27d14-4d62-5be5-add6-1800c7249336 with identifier: 117077436
2025-12-02 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da27d14-4d62-5be5-add6-1800c7249336 with scrape type 2
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5da27d14-4d62-5be5-add6-1800c7249336 with scrape type 2
2025-12-02 19:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5da27d14-4d62-5be5-add6-1800c7249336, identifier: 117077436
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117339017, 'registration': 'ET21WWC', 'account': 'STE009', 'make': 'BMW', 'model': '4 SERIES DIESEL COUPE', 'derivative': '420d MHT M Sport 2dr Step Auto', 'mileage': 38415, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1121, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-08-20', 'fuel': 'Diesel', 'motExpiry': '2025-10-20', 'doors': 2, 'engineSize': 1995, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/ET21WWC/2025-11-21/image/416cfb80-c90a-4c0b-a91b-5523a4a2da95_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/32dbaa27-ca36-4209-89b5-e06351d856bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/9c68204c-f022-4da4-902f-7da6dab3b52e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/eeb1bf1d-14d0-4264-bd26-3294387b6dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/791646b8-2a3c-4991-927d-960d583d6b7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/841603d8-5443-44b7-bd57-2681d1be8e97_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/9a31f1e7-d7ae-420e-9631-771e0841541a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/5df7e1a7-28cb-4a80-ae3b-9d86f85aa747_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/17ddde0d-1a4f-48cc-b105-9ca919359d41_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/61ce423b-0784-4e19-9ac4-485466238769_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/ff71ec24-838f-454f-92f9-12005a7bebe6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/22 12K - 02/22 27K - 09/23 22K', 'remarks': 'VOSA STATES, 32K, 38K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b2fa0d6e-32ef-430f-ad57-fc17da007d22.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117339017, 'registration': 'ET21WWC', 'account': 'STE009', 'make': 'BMW', 'model': '4 SERIES DIESEL COUPE', 'derivative': '420d MHT M Sport 2dr Step Auto', 'mileage': 38415, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1121, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-08-20', 'fuel': 'Diesel', 'motExpiry': '2025-10-20', 'doors': 2, 'engineSize': 1995, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/ET21WWC/2025-11-21/image/416cfb80-c90a-4c0b-a91b-5523a4a2da95_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/32dbaa27-ca36-4209-89b5-e06351d856bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/9c68204c-f022-4da4-902f-7da6dab3b52e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/eeb1bf1d-14d0-4264-bd26-3294387b6dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/791646b8-2a3c-4991-927d-960d583d6b7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/841603d8-5443-44b7-bd57-2681d1be8e97_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/9a31f1e7-d7ae-420e-9631-771e0841541a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/5df7e1a7-28cb-4a80-ae3b-9d86f85aa747_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/17ddde0d-1a4f-48cc-b105-9ca919359d41_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/61ce423b-0784-4e19-9ac4-485466238769_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET21WWC/2025-11-21/image/ff71ec24-838f-454f-92f9-12005a7bebe6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/22 12K - 02/22 27K - 09/23 22K', 'remarks': 'VOSA STATES, 32K, 38K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b2fa0d6e-32ef-430f-ad57-fc17da007d22.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa278351-0b46-5941-a165-0722aed85fcc with identifier: 117339017
2025-12-02 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa278351-0b46-5941-a165-0722aed85fcc with scrape type 2
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa278351-0b46-5941-a165-0722aed85fcc with scrape type 2
2025-12-02 19:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fa278351-0b46-5941-a165-0722aed85fcc, identifier: 117339017
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117625623, 'registration': 'LD19DVW', 'account': 'MER178', 'make': 'FORD', 'model': 'KA+ HATCHBACK', 'derivative': '1.2 85 Active 5dr', 'mileage': 25138, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1231, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-04', 'fuel': 'Petrol', 'motExpiry': '2025-12-21', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LD19DVW/2025-12-02/image/a4ac90ec-708d-45e1-a2a2-ab885a8fbc4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0549c7b8-be62-4964-9496-ddd80024e872_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/dd5a0fa5-ca1c-416a-92ec-99a107f2d644_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/3c9d855e-7aaf-499e-9ff6-fdb9b5e13b58_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/9eb0d604-96e0-492a-802a-bc3bd77e35c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0cfcec80-cfc2-41ea-b28d-72affdc95646_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/897e2d0d-3370-4187-bc02-29adbd99a990_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/76dedf30-ea35-4dc5-9fa4-b4910facd604_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/afba6973-2bbb-4e88-9ebf-ac886eadfc97_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '12/23 13K - 12/24 20K', 'remarks': 'VOSA STATES, 5K, 13K, 20K, 25K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ae96771f-d800-40b7-965b-834d76932882.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117625623, 'registration': 'LD19DVW', 'account': 'MER178', 'make': 'FORD', 'model': 'KA+ HATCHBACK', 'derivative': '1.2 85 Active 5dr', 'mileage': 25138, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1231, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-04', 'fuel': 'Petrol', 'motExpiry': '2025-12-21', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LD19DVW/2025-12-02/image/a4ac90ec-708d-45e1-a2a2-ab885a8fbc4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0549c7b8-be62-4964-9496-ddd80024e872_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/dd5a0fa5-ca1c-416a-92ec-99a107f2d644_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/3c9d855e-7aaf-499e-9ff6-fdb9b5e13b58_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/9eb0d604-96e0-492a-802a-bc3bd77e35c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0cfcec80-cfc2-41ea-b28d-72affdc95646_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/897e2d0d-3370-4187-bc02-29adbd99a990_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/76dedf30-ea35-4dc5-9fa4-b4910facd604_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/afba6973-2bbb-4e88-9ebf-ac886eadfc97_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '12/23 13K - 12/24 20K', 'remarks': 'VOSA STATES, 5K, 13K, 20K, 25K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ae96771f-d800-40b7-965b-834d76932882.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 456abc21-d3bf-5e9a-b7ef-16d93e70cf65 with identifier: 117625623
2025-12-02 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65 with scrape type 1
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252Fa4ac90ec-708d-45e1-a2a2-ab885a8fbc4e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/a4ac90ec-708d-45e1-a2a2-ab885a8fbc4e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG18XNU/2025-12-02/image/0db97c86-0e25-4dab-ba9b-9bf0306f70c9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600033?view=catalogue)
2025-12-02 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67WSL/2025-12-02/image/1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue)
2025-12-02 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue)
2025-12-02 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL16LSX/2025-12-02/image/6043935d-f9a9-4bfb-875e-628744aed9d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634437?view=catalogue)
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117615483
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615483%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117615483: 0
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117615572
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615572%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117615572: 0
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117615464
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615464%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117615464: 0
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117615130
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615130%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117615130: 0
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117543930
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543930%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117543930: 0
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117569240
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569240%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117569240: 2
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252Fb2d0bb6d-4638-4aab-af45-acd6b2d165c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/b2d0bb6d-4638-4aab-af45-acd6b2d165c7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5da27d14-4d62-5be5-add6-1800c7249336 with identifier: 117077436
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Hybrid+Electric HTTP/1.1" 200 None
2025-12-02 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5da27d14-4d62-5be5-add6-1800c7249336 with identifier: 117077436
2025-12-02 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'hedin automotive bmw', 'price_includes_vat': False, 'title': 'bmw x5 estate xdrive45e m sport 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'x5 estate', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'hybrid electric', 'odometer': 145107, 'odometer_reading_unit': 'mi', 'registration_date': '2020-11-13', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117077436', 'expiration_date': '2025-12-03t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': 'xdrive45e m sport 5dr auto', 'license_plate': 'lv70dkk', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 29, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '5da27d14-4d62-5be5-add6-1800c7249336', 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'bmw x5 estate', 'sanitized_make': 'bmw', 'odometer_in_km': 233526}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': 29,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '3.0l',
     'expiration_date': '2025-12-03t10:00:00z',
     'fuel_type': 'hybrid electric',
     'id': '5da27d14-4d62-5be5-add6-1800c7249336',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lv70dkk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117077436',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'bmw',
     'make_model': 'bmw x5 estate',
     'model': 'x5 estate',
     'odometer': 145107,
     'odometer_in_km': 233526,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-13',
     'sanitized_make': 'bmw',
     'seller_name': 'hedin automotive bmw',
     'title': 'bmw x5 estate xdrive45e m sport 5dr auto',
     'transmission': 'automatic',
     'trim': 'xdrive45e m sport 5dr auto',
     'vin': None,
     'year': 2020}
2025-12-02 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 5da27d14-4d62-5be5-add6-1800c7249336 spider: astonbarclay.gb
2025-12-02 19:00:39 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5da27d14-4d62-5be5-add6-1800c7249336 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'hedin automotive bmw', 'price_includes_vat': False, 'title': 'bmw x5 estate xdrive45e m sport 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'x5 estate', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'hybrid electric', 'odometer': 145107, 'odometer_reading_unit': 'mi', 'registration_date': '2020-11-13', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117077436', 'expiration_date': '2025-12-03t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': 'xdrive45e m sport 5dr auto', 'license_plate': 'lv70dkk', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 29, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '5da27d14-4d62-5be5-add6-1800c7249336', 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'bmw x5 estate', 'sanitized_make': 'bmw', 'odometer_in_km': 233526}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': 29,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '3.0l',
     'expiration_date': '2025-12-03t10:00:00z',
     'fuel_type': 'hybrid electric',
     'id': '5da27d14-4d62-5be5-add6-1800c7249336',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lv70dkk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117077436',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'bmw',
     'make_model': 'bmw x5 estate',
     'model': 'x5 estate',
     'odometer': 145107,
     'odometer_in_km': 233526,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-13',
     'sanitized_make': 'bmw',
     'seller_name': 'hedin automotive bmw',
     'title': 'bmw x5 estate xdrive45e m sport 5dr auto',
     'transmission': 'automatic',
     'trim': 'xdrive45e m sport 5dr auto',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': '5da27d14-4d62-5be5-add6-1800c7249336',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV70DKK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117077436',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': 'X5 ESTATE',
 'odometer': 145107,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-13',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'BMW X5 ESTATE xDrive45e M Sport 5dr Auto',
 'transmission': 'automatic',
 'trim': 'xDrive45e M Sport 5dr Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117077436%27 HTTP/1.1" 200 None
2025-12-02 19:00:39 [astonbarclay.gb] INFO: Saving data for 117077436: {'auction_closing_time': 1764756000.0, 'created_time': 1762974216.288209, 'last_price_update_time': 1764702039.846825}
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117077436') HTTP/1.1" 204 0
2025-12-02 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fa278351-0b46-5941-a165-0722aed85fcc with identifier: 117339017
2025-12-02 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fa278351-0b46-5941-a165-0722aed85fcc with identifier: 117339017
2025-12-02 19:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fa278351-0b46-5941-a165-0722aed85fcc with identifier: 117339017 to the API
2025-12-02 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117339017?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fa278351-0b46-5941-a165-0722aed85fcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ET21WWC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117339017',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '4 SERIES DIESEL COUPE',
 'odometer': 38415,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-20',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'BMW 4 SERIES DIESEL COUPE 420d MHT M Sport 2dr Step Auto',
 'transmission': 'automatic',
 'trim': '420d MHT M Sport 2dr Step Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117339017%27 HTTP/1.1" 200 None
2025-12-02 19:00:40 [astonbarclay.gb] INFO: Saving data for 117339017: {'auction_closing_time': 1764756000.0, 'created_time': 1763665323.543352, 'last_price_update_time': 1764702040.171185}
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117339017') HTTP/1.1" 204 0
2025-12-02 19:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03066d0>
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F5c6f1c4e-1378-46c6-85d5-a622a28748e7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/5c6f1c4e-1378-46c6-85d5-a622a28748e7_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67123457-1c0a-5cdd-8be3-eb490de642b0
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0312710>
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252F21e4c5f5-4b42-4dc3-9145-94b55612a23a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/21e4c5f5-4b42-4dc3-9145-94b55612a23a_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0317610>
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252F719324e0-de27-4e14-b714-3a5c06a2a220_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/719324e0-de27-4e14-b714-3a5c06a2a220_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f128729-4f66-5610-a7f4-9ce4667c373f
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0310290>
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252F36eab235-5216-4ff7-b08c-64ea7e7dc5bf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/36eab235-5216-4ff7-b08c-64ea7e7dc5bf_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ff8590>
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252Fcb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/cb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0315b50>
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0643d90>
2025-12-02 19:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F166df408-a2b7-4812-806d-a5eb8cd6ab32_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/166df408-a2b7-4812-806d-a5eb8cd6ab32_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK16VHA/2025-12-02/image/6b7f3635-b050-478a-938e-a2137ebf2984_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634478?view=catalogue)
2025-12-02 19:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG18XNU/2025-12-02/image/ef0963f0-8c1c-44d1-a99f-63c58ea64049_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600033?view=catalogue)
2025-12-02 19:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue)
2025-12-02 19:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue)
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Faefccbd7-df7a-42e8-aa4d-50d477e6bb9d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/aefccbd7-df7a-42e8-aa4d-50d477e6bb9d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252F0af3fb97-8ce3-45e0-9184-c553b71405e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/0af3fb97-8ce3-45e0-9184-c553b71405e5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F06659b41-2032-478d-bc81-59901621a370_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/06659b41-2032-478d-bc81-59901621a370_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252Fb8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/b8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252Fbbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252F1d649000-b062-4b26-9035-2de748b37738_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/1d649000-b062-4b26-9035-2de748b37738_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252F3362e9a0-8a77-4e1d-9317-6a1d22d29a27_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/3362e9a0-8a77-4e1d-9317-6a1d22d29a27_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F9a2cb65a-88b7-4d15-b814-474a82685a23_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/9a2cb65a-88b7-4d15-b814-474a82685a23_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F0549c7b8-be62-4964-9496-ddd80024e872_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0549c7b8-be62-4964-9496-ddd80024e872_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 117561133
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117561133%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [astonbarclay.gb] INFO: Scrape type for 117561133: 0
2025-12-02 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 117567379
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117567379%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [astonbarclay.gb] INFO: Scrape type for 117567379: 2
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252F0df47926-12ea-4ce2-b22c-043f4443abc8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/0df47926-12ea-4ce2-b22c-043f4443abc8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/109140236?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0424ad0>
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F923ed404-47b5-487a-b6b7-d992452917d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/923ed404-47b5-487a-b6b7-d992452917d4_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e1cd49a7-747a-4449-8f7c-63d3e07418ab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue)
2025-12-02 19:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX69OMA/2025-12-02/image/fc967ccb-9da1-46f0-bdd5-a8a006dfa767_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634427?view=catalogue)
2025-12-02 19:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF69LTY/2025-12-02/image/c82a6c11-57dd-4ca7-9bbb-da86b4c3152c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue)
2025-12-02 19:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK16VHA/2025-12-02/image/56839c9f-ed79-4986-9789-bc4e53f28fe0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634478?view=catalogue)
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252F1552f193-d154-4a0a-89ee-53b79dbfc7f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/1552f193-d154-4a0a-89ee-53b79dbfc7f1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252Fe468d304-4f9f-4ca5-b567-be5d4744ca49_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e468d304-4f9f-4ca5-b567-be5d4744ca49_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252Fd666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252Fe1a8cede-7758-49aa-bad4-bae423261dff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/e1a8cede-7758-49aa-bad4-bae423261dff_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252Ffd78f66e-27a8-4165-ad1a-ab887c18a71f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/fd78f66e-27a8-4165-ad1a-ab887c18a71f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F65982844-45ad-4fb3-8459-88f8770809b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/65982844-45ad-4fb3-8459-88f8770809b0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252Fdd5a0fa5-ca1c-416a-92ec-99a107f2d644_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/dd5a0fa5-ca1c-416a-92ec-99a107f2d644_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 117515289
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515289%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [astonbarclay.gb] INFO: Scrape type for 117515289: 2
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252Fc56ccd0a-e4a5-4f1c-8a46-4788fd327b13_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/c56ccd0a-e4a5-4f1c-8a46-4788fd327b13_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0314550>
2025-12-02 19:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252F0db97c86-0e25-4dab-ba9b-9bf0306f70c9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/0db97c86-0e25-4dab-ba9b-9bf0306f70c9_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0423e90>
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf041c110>
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0422bd0>
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252F6043935d-f9a9-4bfb-875e-628744aed9d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/6043935d-f9a9-4bfb-875e-628744aed9d2_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f128729-4f66-5610-a7f4-9ce4667c373f
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf041eb10>
2025-12-02 19:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F6b7f3635-b050-478a-938e-a2137ebf2984_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/6b7f3635-b050-478a-938e-a2137ebf2984_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf502d3f-3084-5f78-b546-5e0d0e94ab79
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03f5b10>
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252Fef0963f0-8c1c-44d1-a99f-63c58ea64049_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/ef0963f0-8c1c-44d1-a99f-63c58ea64049_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0315810>
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03fbed0>
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252Fd6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL16LSX/2025-12-02/image/51ccb9ae-76ed-47a4-b517-548572c1a0ea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634437?view=catalogue)
2025-12-02 19:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL16LSX/2025-12-02/image/f487d300-e5d2-4d72-a9a8-f98804a27af7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634437?view=catalogue)
2025-12-02 19:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN22AWH/2025-12-02/image/0733037a-40a2-407c-b820-b08821009ea3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117614027?view=catalogue)
2025-12-02 19:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67XME/2025-12-02/image/252f9f3e-84d8-4765-bd2a-0603b1d68223_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628577?view=catalogue)
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Ffeeebb7f-bea8-4fcc-bd53-ec35d919e63c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/feeebb7f-bea8-4fcc-bd53-ec35d919e63c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252F56dc19a4-1203-4f50-8f6e-f66647fcd2f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/56dc19a4-1203-4f50-8f6e-f66647fcd2f2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252Fd22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/d22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252Ffe521320-6e60-4dc2-b4a0-a4b7dd7f440f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/fe521320-6e60-4dc2-b4a0-a4b7dd7f440f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252F26d5c4a3-3487-4953-83e7-bfac19d0b756_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/26d5c4a3-3487-4953-83e7-bfac19d0b756_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F426147eb-6fff-41b8-a00a-7f248c18c6a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/426147eb-6fff-41b8-a00a-7f248c18c6a6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F3c9d855e-7aaf-499e-9ff6-fdb9b5e13b58_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/3c9d855e-7aaf-499e-9ff6-fdb9b5e13b58_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117542115, 'registration': 'EJ19KXH', 'account': 'WBA002', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav/Servotronic]', 'mileage': 78497, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1324, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-18', 'fuel': 'Petrol', 'motExpiry': '2026-05-22', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7c460db8-e1fb-4bdd-bb1a-2ed710367b96_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/76b3a07e-5b81-4fd7-85f5-0a0f59528ac6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/ff2b822c-f4bc-49c9-8b50-4973c404d3be_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/fcffe57a-859f-4590-8798-d17482780969_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/1c20d1bd-d768-40c7-9b0a-9cfda798cc8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/86f59198-89dc-4ae9-a4d8-e631075b54a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/0b8971ea-4368-48e8-8e60-3db2944fe3c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/72974111-97e0-4d0c-b45b-09a8e4cfea93_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/f85f1c49-d468-45db-bd4c-fa012309855f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7e4f09fa-cae7-44e8-be75-4002ed9f29df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/8974ac51-b0d3-492b-9d70-cbe4c46e6176_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital IDRIVE STATES 01/21- 17K, 10/21- 26K, 02/23- 39K, 11/23- 49K, 10/24- 61K, 02/25- 67K', 'remarks': 'VOSA STATES 29K 42K 56K 70K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3040f68-dfc7-4a4b-8943-6280166e2071.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117542115, 'registration': 'EJ19KXH', 'account': 'WBA002', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav/Servotronic]', 'mileage': 78497, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1324, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-18', 'fuel': 'Petrol', 'motExpiry': '2026-05-22', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7c460db8-e1fb-4bdd-bb1a-2ed710367b96_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/76b3a07e-5b81-4fd7-85f5-0a0f59528ac6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/ff2b822c-f4bc-49c9-8b50-4973c404d3be_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/fcffe57a-859f-4590-8798-d17482780969_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/1c20d1bd-d768-40c7-9b0a-9cfda798cc8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/86f59198-89dc-4ae9-a4d8-e631075b54a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/0b8971ea-4368-48e8-8e60-3db2944fe3c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/72974111-97e0-4d0c-b45b-09a8e4cfea93_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/f85f1c49-d468-45db-bd4c-fa012309855f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7e4f09fa-cae7-44e8-be75-4002ed9f29df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/8974ac51-b0d3-492b-9d70-cbe4c46e6176_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital IDRIVE STATES 01/21- 17K, 10/21- 26K, 02/23- 39K, 11/23- 49K, 10/24- 61K, 02/25- 67K', 'remarks': 'VOSA STATES 29K 42K 56K 70K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3040f68-dfc7-4a4b-8943-6280166e2071.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3feb7045-82ed-5742-a0b6-0794db7b4720 with identifier: 117542115
2025-12-02 19:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3feb7045-82ed-5742-a0b6-0794db7b4720 with scrape type 2
2025-12-02 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3feb7045-82ed-5742-a0b6-0794db7b4720 with scrape type 2
2025-12-02 19:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3feb7045-82ed-5742-a0b6-0794db7b4720, identifier: 117542115
2025-12-02 19:00:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 109140236, 'registration': 'NV67DLX', 'account': 'WBA002', 'make': 'AUDI', 'model': 'A5 SPORTBACK', 'derivative': '2.0 TFSI Quattro S Line 5dr S Tronic', 'mileage': 113675, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1337, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-12-18', 'fuel': 'Petrol', 'motExpiry': '2025-09-16', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NV67DLX/2025-11-29/image/a7e89435-7d39-43a3-868f-8c9ab3b42397_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/9d6ba6e9-7170-41b8-a381-63772e5b6ed6_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/be587c71-1fa4-42c4-b441-df22b1163c45_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/44de0c0c-31a4-41cd-900a-5d560b7aada9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/743f31d0-fbbc-469f-9b5d-2ec1876db40f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/8c141041-1032-4976-996f-5828131dca45_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/bd0c6e66-2c1a-4c4a-8e90-1768e036ad4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/ddc51307-c19e-4dda-92f4-1eed2028ccf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/3433e64b-5f89-4bae-96a5-f467d7d33158_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service print 08/18- 10K, 05/19- 21K, 11/20- 31K, 12/21- 37K, 09/22- 43K, 12/22- 53K, 06/23- 66K, 11/23- 76K, 05/24- 89K', 'remarks': 'VOSA STATES 43K, 71K, 94K, 112K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b211125-7cf3-4955-a841-90e627aab5f6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 109140236, 'registration': 'NV67DLX', 'account': 'WBA002', 'make': 'AUDI', 'model': 'A5 SPORTBACK', 'derivative': '2.0 TFSI Quattro S Line 5dr S Tronic', 'mileage': 113675, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1337, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-12-18', 'fuel': 'Petrol', 'motExpiry': '2025-09-16', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NV67DLX/2025-11-29/image/a7e89435-7d39-43a3-868f-8c9ab3b42397_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/9d6ba6e9-7170-41b8-a381-63772e5b6ed6_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/be587c71-1fa4-42c4-b441-df22b1163c45_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/44de0c0c-31a4-41cd-900a-5d560b7aada9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/743f31d0-fbbc-469f-9b5d-2ec1876db40f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/8c141041-1032-4976-996f-5828131dca45_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/bd0c6e66-2c1a-4c4a-8e90-1768e036ad4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/ddc51307-c19e-4dda-92f4-1eed2028ccf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NV67DLX/2025-11-29/image/3433e64b-5f89-4bae-96a5-f467d7d33158_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service print 08/18- 10K, 05/19- 21K, 11/20- 31K, 12/21- 37K, 09/22- 43K, 12/22- 53K, 06/23- 66K, 11/23- 76K, 05/24- 89K', 'remarks': 'VOSA STATES 43K, 71K, 94K, 112K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b211125-7cf3-4955-a841-90e627aab5f6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00b7097a-c7bf-5851-b051-79c3dcca1afa with identifier: 109140236
2025-12-02 19:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00b7097a-c7bf-5851-b051-79c3dcca1afa with scrape type 2
2025-12-02 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00b7097a-c7bf-5851-b051-79c3dcca1afa with scrape type 2
2025-12-02 19:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 00b7097a-c7bf-5851-b051-79c3dcca1afa, identifier: 109140236
2025-12-02 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL16LSX/2025-12-02/image/b2d0bb6d-4638-4aab-af45-acd6b2d165c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634437?view=catalogue)
2025-12-02 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67XME/2025-12-02/image/899a345e-f22a-4971-8a52-919777198454_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628577?view=catalogue)
2025-12-02 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD19DVW/2025-12-02/image/a4ac90ec-708d-45e1-a2a2-ab885a8fbc4e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625623?view=catalogue)
2025-12-02 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ffe8c206-6654-4bc2-8b2b-3be36c6d96e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117614027?view=catalogue)
2025-12-02 19:00:45 [astonbarclay.gb] INFO: Found listing with ID: 117549984
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549984%27 HTTP/1.1" 200 None
2025-12-02 19:00:45 [astonbarclay.gb] INFO: Scrape type for 117549984: 0
2025-12-02 19:00:45 [astonbarclay.gb] INFO: Found listing with ID: 117573571
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573571%27 HTTP/1.1" 200 None
2025-12-02 19:00:45 [astonbarclay.gb] INFO: Scrape type for 117573571: 2
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252F2c878d17-3181-4357-8e18-f455692c5031_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/2c878d17-3181-4357-8e18-f455692c5031_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3feb7045-82ed-5742-a0b6-0794db7b4720 with identifier: 117542115
2025-12-02 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3feb7045-82ed-5742-a0b6-0794db7b4720 with identifier: 117542115
2025-12-02 19:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3feb7045-82ed-5742-a0b6-0794db7b4720 with identifier: 117542115 to the API
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3feb7045-82ed-5742-a0b6-0794db7b4720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EJ19KXH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117542115',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 78497,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-18',
 'seller_name': 'UKCGR - Premium',
 'title': 'BMW 1 SERIES HATCHBACK 118i [1.5] Sport 5dr [Nav/Servotronic]',
 'transmission': 'manual',
 'trim': '118i [1.5] Sport 5dr [Nav/Servotronic]',
 'vin': None,
 'year': 2019}
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542115%27 HTTP/1.1" 200 None
2025-12-02 19:00:45 [astonbarclay.gb] INFO: Saving data for 117542115: {'auction_closing_time': 1764756000.0, 'created_time': 1764270327.129631, 'last_price_update_time': 1764702045.72851}
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117542115') HTTP/1.1" 204 0
2025-12-02 19:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 00b7097a-c7bf-5851-b051-79c3dcca1afa with identifier: 109140236
2025-12-02 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 00b7097a-c7bf-5851-b051-79c3dcca1afa with identifier: 109140236
2025-12-02 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182941 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182941
2025-12-02 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 00b7097a-c7bf-5851-b051-79c3dcca1afa spider: astonbarclay.gb
2025-12-02 19:00:46 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 00b7097a-c7bf-5851-b051-79c3dcca1afa due to rule: high_mileage_for_country.json, error: 182941 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182941
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '00b7097a-c7bf-5851-b051-79c3dcca1afa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NV67DLX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/109140236',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 113675,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-18',
 'seller_name': 'UKCGR - Premium',
 'title': 'AUDI A5 SPORTBACK 2.0 TFSI Quattro S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TFSI Quattro S Line 5dr S Tronic',
 'vin': None,
 'year': 2017}
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27109140236%27 HTTP/1.1" 200 None
2025-12-02 19:00:46 [astonbarclay.gb] INFO: Saving data for 109140236: {'auction_closing_time': 1764756000.0, 'created_time': 1764442910.839523, 'last_price_update_time': 1764702046.105162}
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='109140236') HTTP/1.1" 204 0
2025-12-02 19:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ca97d0>
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252Fe1cd49a7-747a-4449-8f7c-63d3e07418ab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e1cd49a7-747a-4449-8f7c-63d3e07418ab_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fe52d45-63a2-53ab-8319-e0b8532403ce
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf2018dd0>
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Ffc967ccb-9da1-46f0-bdd5-a8a006dfa767_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/fc967ccb-9da1-46f0-bdd5-a8a006dfa767_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 947e4204-0720-5876-bad2-6dad899f30d7
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf041e890>
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252Fc82a6c11-57dd-4ca7-9bbb-da86b4c3152c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/c82a6c11-57dd-4ca7-9bbb-da86b4c3152c_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fe52d45-63a2-53ab-8319-e0b8532403ce
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02deb10>
2025-12-02 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F56839c9f-ed79-4986-9789-bc4e53f28fe0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/56839c9f-ed79-4986-9789-bc4e53f28fe0_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf502d3f-3084-5f78-b546-5e0d0e94ab79
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252F37378945-9be0-4147-b384-ab49c666020a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/37378945-9be0-4147-b384-ab49c666020a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252Fc964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252F63d872dc-7494-4fab-8982-31a8594b6c93_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/63d872dc-7494-4fab-8982-31a8594b6c93_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252Fc2e8d6bd-a8f5-4acb-b9a5-fb9a5e982c56_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/c2e8d6bd-a8f5-4acb-b9a5-fb9a5e982c56_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F9eb0d604-96e0-492a-802a-bc3bd77e35c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/9eb0d604-96e0-492a-802a-bc3bd77e35c4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570189?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0549c7b8-be62-4964-9496-ddd80024e872_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625623?view=catalogue)
2025-12-02 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67XME/2025-12-02/image/9a2cb65a-88b7-4d15-b814-474a82685a23_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628577?view=catalogue)
2025-12-02 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG18XNU/2025-12-02/image/1d649000-b062-4b26-9035-2de748b37738_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600033?view=catalogue)
2025-12-02 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN22AWH/2025-12-02/image/3362e9a0-8a77-4e1d-9317-6a1d22d29a27_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117614027?view=catalogue)
2025-12-02 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117603221
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117603221%27 HTTP/1.1" 200 None
2025-12-02 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117603221: 2
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252Fd765ab40-95ef-4f6f-b5d8-d83ffe00cd17_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/d765ab40-95ef-4f6f-b5d8-d83ffe00cd17_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03e6350>
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252F51ccb9ae-76ed-47a4-b517-548572c1a0ea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/51ccb9ae-76ed-47a4-b517-548572c1a0ea_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f128729-4f66-5610-a7f4-9ce4667c373f
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07e65d0>
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252Ff487d300-e5d2-4d72-a9a8-f98804a27af7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/f487d300-e5d2-4d72-a9a8-f98804a27af7_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f128729-4f66-5610-a7f4-9ce4667c373f
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf047ba10>
2025-12-02 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252F0733037a-40a2-407c-b820-b08821009ea3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/0733037a-40a2-407c-b820-b08821009ea3_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c94306fc-28f5-5b2e-9b3c-50581b7acee8
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ffa610>
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F252f9f3e-84d8-4765-bd2a-0603b1d68223_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/252f9f3e-84d8-4765-bd2a-0603b1d68223_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35
2025-12-02 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue)
2025-12-02 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67XME/2025-12-02/image/65982844-45ad-4fb3-8459-88f8770809b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628577?view=catalogue)
2025-12-02 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD19DVW/2025-12-02/image/dd5a0fa5-ca1c-416a-92ec-99a107f2d644_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625623?view=catalogue)
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252F07f574d2-02b5-48ca-a881-65e3ef8ba953_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/07f574d2-02b5-48ca-a881-65e3ef8ba953_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F2442a66a-1fde-418f-8bb4-e2c183de5829_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/2442a66a-1fde-418f-8bb4-e2c183de5829_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F0cfcec80-cfc2-41ea-b28d-72affdc95646_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0cfcec80-cfc2-41ea-b28d-72affdc95646_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04ef3d0>
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252Fb2d0bb6d-4638-4aab-af45-acd6b2d165c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/b2d0bb6d-4638-4aab-af45-acd6b2d165c7_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f128729-4f66-5610-a7f4-9ce4667c373f
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04fe090>
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F899a345e-f22a-4971-8a52-919777198454_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/899a345e-f22a-4971-8a52-919777198454_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf097ef90>
2025-12-02 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252Fa4ac90ec-708d-45e1-a2a2-ab885a8fbc4e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/a4ac90ec-708d-45e1-a2a2-ab885a8fbc4e_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e63d0>
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252Fffe8c206-6654-4bc2-8b2b-3be36c6d96e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ffe8c206-6654-4bc2-8b2b-3be36c6d96e3_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c94306fc-28f5-5b2e-9b3c-50581b7acee8
2025-12-02 19:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN22AWH/2025-12-02/image/fd78f66e-27a8-4165-ad1a-ab887c18a71f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117614027?view=catalogue)
2025-12-02 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117612955
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117612955%27 HTTP/1.1" 200 None
2025-12-02 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117612955: 0
2025-12-02 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117638971
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638971%27 HTTP/1.1" 200 None
2025-12-02 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117638971: 1
2025-12-02 19:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG18XNU/2025-12-02/image/e1a8cede-7758-49aa-bad4-bae423261dff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600033?view=catalogue)
2025-12-02 19:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue)
2025-12-02 19:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue)
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252Fef98a5a3-14ff-4938-af3a-a2645bfd9fad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ef98a5a3-14ff-4938-af3a-a2645bfd9fad_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F34d9e106-b052-49d8-9825-61799dc227f3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/34d9e106-b052-49d8-9825-61799dc227f3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F897e2d0d-3370-4187-bc02-29adbd99a990_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/897e2d0d-3370-4187-bc02-29adbd99a990_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570189, 'registration': 'YBA960S', 'account': 'WBA002', 'make': 'AUDI', 'model': 'Q3 SPORTBACK', 'derivative': '45 TFSI Quattro S Line 5dr S Tronic', 'mileage': 88917, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1338, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YBA960S/2025-11-28/image/d809d656-ded6-400b-abed-b323f1860aed_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/50eb27f8-dd05-4d60-881f-7743608b1004_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/ab96ca5b-0ee3-4da2-9082-94a01fa1ee9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/605e0ee1-5af2-4cb8-9cab-61e6cd6aa38a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/3b866376-1b7d-42e1-aa15-3fdbe1863fa3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/109cc74a-ca5c-4333-ac48-b3d983e40447_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/b892ed3b-a96d-4638-8a3c-2a04b0d0684a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/07a6e070-2ab4-493d-91bc-9d549e5add96_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/ac699bf4-8658-45e9-9a50-ab1d03af92f5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 32K, 57K, 85K, 87K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd420974-62cb-4f27-a53d-35d532e12f14.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570189, 'registration': 'YBA960S', 'account': 'WBA002', 'make': 'AUDI', 'model': 'Q3 SPORTBACK', 'derivative': '45 TFSI Quattro S Line 5dr S Tronic', 'mileage': 88917, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1338, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YBA960S/2025-11-28/image/d809d656-ded6-400b-abed-b323f1860aed_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/50eb27f8-dd05-4d60-881f-7743608b1004_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/ab96ca5b-0ee3-4da2-9082-94a01fa1ee9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/605e0ee1-5af2-4cb8-9cab-61e6cd6aa38a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/3b866376-1b7d-42e1-aa15-3fdbe1863fa3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/109cc74a-ca5c-4333-ac48-b3d983e40447_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/b892ed3b-a96d-4638-8a3c-2a04b0d0684a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/07a6e070-2ab4-493d-91bc-9d549e5add96_removebg.jpg?w=600', 'https://abimg003.imgix.net/YBA960S/2025-11-28/image/ac699bf4-8658-45e9-9a50-ab1d03af92f5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 32K, 57K, 85K, 87K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd420974-62cb-4f27-a53d-35d532e12f14.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e2156c3-c198-5abc-8c32-7022f4c45796 with identifier: 117570189
2025-12-02 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e2156c3-c198-5abc-8c32-7022f4c45796 with scrape type 2
2025-12-02 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e2156c3-c198-5abc-8c32-7022f4c45796 with scrape type 2
2025-12-02 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0e2156c3-c198-5abc-8c32-7022f4c45796, identifier: 117570189
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf080c4d0>
2025-12-02 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F0549c7b8-be62-4964-9496-ddd80024e872_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0549c7b8-be62-4964-9496-ddd80024e872_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ddce90>
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F9a2cb65a-88b7-4d15-b814-474a82685a23_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/9a2cb65a-88b7-4d15-b814-474a82685a23_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066bb10>
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252F1d649000-b062-4b26-9035-2de748b37738_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/1d649000-b062-4b26-9035-2de748b37738_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04de210>
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252F3362e9a0-8a77-4e1d-9317-6a1d22d29a27_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/3362e9a0-8a77-4e1d-9317-6a1d22d29a27_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c94306fc-28f5-5b2e-9b3c-50581b7acee8
2025-12-02 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL16LSX/2025-12-02/image/2c878d17-3181-4357-8e18-f455692c5031_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634437?view=catalogue)
2025-12-02 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67XME/2025-12-02/image/426147eb-6fff-41b8-a00a-7f248c18c6a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628577?view=catalogue)
2025-12-02 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL16LSX/2025-12-02/image/c56ccd0a-e4a5-4f1c-8a46-4788fd327b13_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634437?view=catalogue)
2025-12-02 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 117556910
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117556910%27 HTTP/1.1" 200 None
2025-12-02 19:00:50 [astonbarclay.gb] INFO: Scrape type for 117556910: 2
2025-12-02 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0e2156c3-c198-5abc-8c32-7022f4c45796 with identifier: 117570189
2025-12-02 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0e2156c3-c198-5abc-8c32-7022f4c45796 with identifier: 117570189
2025-12-02 19:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0e2156c3-c198-5abc-8c32-7022f4c45796 with identifier: 117570189 to the API
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117570189?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0e2156c3-c198-5abc-8c32-7022f4c45796',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YBA960S',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570189',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 88917,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-31',
 'seller_name': 'UKCGR - Premium',
 'title': 'AUDI Q3 SPORTBACK 45 TFSI Quattro S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '45 TFSI Quattro S Line 5dr S Tronic',
 'vin': None,
 'year': 2019}
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570189%27 HTTP/1.1" 200 None
2025-12-02 19:00:51 [astonbarclay.gb] INFO: Saving data for 117570189: {'auction_closing_time': 1764756000.0, 'created_time': 1764356632.531224, 'last_price_update_time': 1764702051.193803}
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570189') HTTP/1.1" 204 0
2025-12-02 19:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e8210>
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252Fbbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0512f10>
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F65982844-45ad-4fb3-8459-88f8770809b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/65982844-45ad-4fb3-8459-88f8770809b0_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0483f50>
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252Fdd5a0fa5-ca1c-416a-92ec-99a107f2d644_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/dd5a0fa5-ca1c-416a-92ec-99a107f2d644_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65
2025-12-02 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD19DVW/2025-12-02/image/3c9d855e-7aaf-499e-9ff6-fdb9b5e13b58_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625623?view=catalogue)
2025-12-02 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN22AWH/2025-12-02/image/26d5c4a3-3487-4953-83e7-bfac19d0b756_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117614027?view=catalogue)
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252Fd82fd6f9-51bb-4a18-b147-5b0aa0fab017_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/d82fd6f9-51bb-4a18-b147-5b0aa0fab017_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252Fa62ed79c-00b7-4b83-94c4-4c0875e129b7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/a62ed79c-00b7-4b83-94c4-4c0875e129b7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F76dedf30-ea35-4dc5-9fa4-b4910facd604_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/76dedf30-ea35-4dc5-9fa4-b4910facd604_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD19DVW/2025-12-02/image/9eb0d604-96e0-492a-802a-bc3bd77e35c4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625623?view=catalogue)
2025-12-02 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67XME/2025-12-02/image/c2e8d6bd-a8f5-4acb-b9a5-fb9a5e982c56_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628577?view=catalogue)
2025-12-02 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117612919
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117612919%27 HTTP/1.1" 200 None
2025-12-02 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117612919: 0
2025-12-02 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117642729
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117642729%27 HTTP/1.1" 200 None
2025-12-02 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117642729: 1
2025-12-02 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04dd610>
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252Ffd78f66e-27a8-4165-ad1a-ab887c18a71f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/fd78f66e-27a8-4165-ad1a-ab887c18a71f_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c94306fc-28f5-5b2e-9b3c-50581b7acee8
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0799fd0>
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252Fe1a8cede-7758-49aa-bad4-bae423261dff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/e1a8cede-7758-49aa-bad4-bae423261dff_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ee510>
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252Fd666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06c9450>
2025-12-02 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67XME/2025-12-02/image/2442a66a-1fde-418f-8bb4-e2c183de5829_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628577?view=catalogue)
2025-12-02 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL16LSX/2025-12-02/image/d765ab40-95ef-4f6f-b5d8-d83ffe00cd17_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634437?view=catalogue)
2025-12-02 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN22AWH/2025-12-02/image/63d872dc-7494-4fab-8982-31a8594b6c93_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117614027?view=catalogue)
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F4a4248ed-ff7b-438b-bd82-ad0332b971a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/4a4248ed-ff7b-438b-bd82-ad0332b971a5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252Fafba6973-2bbb-4e88-9ebf-ac886eadfc97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/afba6973-2bbb-4e88-9ebf-ac886eadfc97_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06ca690>
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252F2c878d17-3181-4357-8e18-f455692c5031_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/2c878d17-3181-4357-8e18-f455692c5031_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f128729-4f66-5610-a7f4-9ce4667c373f
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b6650>
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F426147eb-6fff-41b8-a00a-7f248c18c6a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/426147eb-6fff-41b8-a00a-7f248c18c6a6_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06a9290>
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252Fc56ccd0a-e4a5-4f1c-8a46-4788fd327b13_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/c56ccd0a-e4a5-4f1c-8a46-4788fd327b13_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f128729-4f66-5610-a7f4-9ce4667c373f
2025-12-02 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue)
2025-12-02 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0cfcec80-cfc2-41ea-b28d-72affdc95646_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625623?view=catalogue)
2025-12-02 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117627785
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627785%27 HTTP/1.1" 200 None
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117627785: 0
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117621025
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621025%27 HTTP/1.1" 200 None
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117621025: 0
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117625569
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625569%27 HTTP/1.1" 200 None
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117625569: 0
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117634646
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634646%27 HTTP/1.1" 200 None
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117634646: 0
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117623195
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623195%27 HTTP/1.1" 200 None
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117623195: 0
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117622987
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117622987%27 HTTP/1.1" 200 None
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117622987: 0
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117498763
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498763%27 HTTP/1.1" 200 None
2025-12-02 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117498763: 2
2025-12-02 19:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67WSL/2025-12-02/image/6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue)
2025-12-02 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN22AWH/2025-12-02/image/07f574d2-02b5-48ca-a881-65e3ef8ba953_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117614027?view=catalogue)
2025-12-02 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117573571?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117569240?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf079f410>
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F3c9d855e-7aaf-499e-9ff6-fdb9b5e13b58_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/3c9d855e-7aaf-499e-9ff6-fdb9b5e13b58_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf076b150>
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252F26d5c4a3-3487-4953-83e7-bfac19d0b756_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/26d5c4a3-3487-4953-83e7-bfac19d0b756_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c94306fc-28f5-5b2e-9b3c-50581b7acee8
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf065f210>
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F9eb0d604-96e0-492a-802a-bc3bd77e35c4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/9eb0d604-96e0-492a-802a-bc3bd77e35c4_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e98d0>
2025-12-02 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252Fc2e8d6bd-a8f5-4acb-b9a5-fb9a5e982c56_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/c2e8d6bd-a8f5-4acb-b9a5-fb9a5e982c56_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35
2025-12-02 19:00:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117542051, 'registration': 'FP68XSJ', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'UP HATCHBACK SPECIAL EDS', 'derivative': '1.0 Up Beats 5dr', 'mileage': 19328, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1341, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-12-11', 'fuel': 'Petrol', 'motExpiry': '2026-12-10', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/6fbad83d-ae00-405b-8234-4b9eafdecf1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c28f3851-7798-4b9c-a3a2-2899adef5030_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c7fae7a8-6405-437f-9389-806c03b9a3b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/9d546b4f-2bfd-4176-a4a0-d0f5c2be977e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b7142c77-6913-4e6e-9fc0-ea25554b24e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b733d1ed-507c-4234-8bb8-6d5c28d4a530_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/fedd1c50-cdc7-42f5-b4a2-21014cd637b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/06f0bd4f-78f7-4124-89fd-e6cbcf2b0c59_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/2a3ecc2e-37b0-41b0-9b0c-ffe5dddfd003_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/21-12K 12/22-14K 12/24-17K 11/25-19K', 'remarks': 'VOSA STATES 14K 16K 17K 19K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/571c4744-bc97-4e71-8775-00e962cdbfec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117542051, 'registration': 'FP68XSJ', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'UP HATCHBACK SPECIAL EDS', 'derivative': '1.0 Up Beats 5dr', 'mileage': 19328, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1341, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-12-11', 'fuel': 'Petrol', 'motExpiry': '2026-12-10', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/6fbad83d-ae00-405b-8234-4b9eafdecf1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c28f3851-7798-4b9c-a3a2-2899adef5030_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c7fae7a8-6405-437f-9389-806c03b9a3b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/9d546b4f-2bfd-4176-a4a0-d0f5c2be977e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b7142c77-6913-4e6e-9fc0-ea25554b24e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b733d1ed-507c-4234-8bb8-6d5c28d4a530_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/fedd1c50-cdc7-42f5-b4a2-21014cd637b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/06f0bd4f-78f7-4124-89fd-e6cbcf2b0c59_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/2a3ecc2e-37b0-41b0-9b0c-ffe5dddfd003_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/21-12K 12/22-14K 12/24-17K 11/25-19K', 'remarks': 'VOSA STATES 14K 16K 17K 19K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/571c4744-bc97-4e71-8775-00e962cdbfec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f360f0-a557-5a39-ad4b-7c9f2412e678 with identifier: 117542051
2025-12-02 19:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f360f0-a557-5a39-ad4b-7c9f2412e678 with scrape type 2
2025-12-02 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30f360f0-a557-5a39-ad4b-7c9f2412e678 with scrape type 2
2025-12-02 19:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 30f360f0-a557-5a39-ad4b-7c9f2412e678, identifier: 117542051
2025-12-02 19:00:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117515289, 'registration': 'NRZ4642', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.2 TCE 120 Dynamique S Nav 5dr EDC', 'mileage': 54853, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1352, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-02-19', 'fuel': 'Petrol', 'motExpiry': '2026-02-20', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NRZ4642/2025-11-26/image/99fe0ccf-862c-48c1-b622-99253ff3409d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a88ac83f-e879-44d5-a658-7d6e08221025_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a719c30e-901f-425f-b68c-f38bd110d0bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/1efd0f00-6512-452e-abaa-98b933b2b8f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9fb205ed-7273-4f9e-af2f-eadb8eb2f47a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/103b86f4-d800-4194-850f-ff5b30d5aae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/375a81ef-23b0-48fd-bc8a-f4d8711613d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9123ca56-e92a-4c0f-93bf-46ebb28f5122_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/db2d6591-c8ea-460b-9261-b56358bcf755_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/38331cbc-5bc3-4803-bf6b-fe6e5a48e4af_removebg.jpg?w=600'], 'colour': 'ORANGE/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/19-6k,  08/19-10k,  11/19-11k,  11/20-16k,  11/21-22k,  12/22-30k,  11/23-38k,  11/24-47k', 'remarks': 'SPARE KEY - VOSA STATES 17k 23k 31k 40k 49k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10d12ff1-dbac-44d6-a1a5-89376d8c9b38.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117515289, 'registration': 'NRZ4642', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.2 TCE 120 Dynamique S Nav 5dr EDC', 'mileage': 54853, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1352, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-02-19', 'fuel': 'Petrol', 'motExpiry': '2026-02-20', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NRZ4642/2025-11-26/image/99fe0ccf-862c-48c1-b622-99253ff3409d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a88ac83f-e879-44d5-a658-7d6e08221025_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a719c30e-901f-425f-b68c-f38bd110d0bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/1efd0f00-6512-452e-abaa-98b933b2b8f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9fb205ed-7273-4f9e-af2f-eadb8eb2f47a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/103b86f4-d800-4194-850f-ff5b30d5aae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/375a81ef-23b0-48fd-bc8a-f4d8711613d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9123ca56-e92a-4c0f-93bf-46ebb28f5122_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/db2d6591-c8ea-460b-9261-b56358bcf755_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/38331cbc-5bc3-4803-bf6b-fe6e5a48e4af_removebg.jpg?w=600'], 'colour': 'ORANGE/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/19-6k,  08/19-10k,  11/19-11k,  11/20-16k,  11/21-22k,  12/22-30k,  11/23-38k,  11/24-47k', 'remarks': 'SPARE KEY - VOSA STATES 17k 23k 31k 40k 49k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10d12ff1-dbac-44d6-a1a5-89376d8c9b38.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with identifier: 117515289
2025-12-02 19:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with scrape type 2
2025-12-02 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with scrape type 2
2025-12-02 19:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e, identifier: 117515289
2025-12-02 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67XME/2025-12-02/image/34d9e106-b052-49d8-9825-61799dc227f3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628577?view=catalogue)
2025-12-02 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD19DVW/2025-12-02/image/897e2d0d-3370-4187-bc02-29adbd99a990_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625623?view=catalogue)
2025-12-02 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117625254
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625254%27 HTTP/1.1" 200 None
2025-12-02 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117625254: 0
2025-12-02 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117643996
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117643996%27 HTTP/1.1" 200 None
2025-12-02 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117643996: 1
2025-12-02 19:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 30f360f0-a557-5a39-ad4b-7c9f2412e678 with identifier: 117542051
2025-12-02 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 30f360f0-a557-5a39-ad4b-7c9f2412e678 with identifier: 117542051
2025-12-02 19:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 30f360f0-a557-5a39-ad4b-7c9f2412e678 with identifier: 117542051 to the API
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '30f360f0-a557-5a39-ad4b-7c9f2412e678',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FP68XSJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117542051',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'UP HATCHBACK SPECIAL EDS',
 'odometer': 19328,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-11',
 'seller_name': 'UKCGR - Premium',
 'title': 'VOLKSWAGEN UP HATCHBACK SPECIAL EDS 1.0 Up Beats 5dr',
 'transmission': 'manual',
 'trim': '1.0 Up Beats 5dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542051%27 HTTP/1.1" 200 None
2025-12-02 19:00:55 [astonbarclay.gb] INFO: Saving data for 117542051: {'auction_closing_time': 1764756000.0, 'created_time': 1764270403.155883, 'last_price_update_time': 1764702055.750764}
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117542051') HTTP/1.1" 204 0
2025-12-02 19:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with identifier: 117515289
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:00:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE%2FBLACK HTTP/1.1" 200 None
2025-12-02 19:00:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with identifier: 117515289
2025-12-02 19:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with identifier: 117515289 to the API
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '74a14cf4-c2f2-5cff-bc72-ad31317e6f4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NRZ4642',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515289',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 54853,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-19',
 'seller_name': 'UKCGR - Premium',
 'title': 'RENAULT CAPTUR HATCHBACK 1.2 TCE 120 Dynamique S Nav 5dr EDC',
 'transmission': 'automatic',
 'trim': '1.2 TCE 120 Dynamique S Nav 5dr EDC',
 'vin': None,
 'year': 2018}
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515289%27 HTTP/1.1" 200 None
2025-12-02 19:00:56 [astonbarclay.gb] INFO: Saving data for 117515289: {'auction_closing_time': 1764756000.0, 'created_time': 1764270367.185981, 'last_price_update_time': 1764702056.324519}
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117515289') HTTP/1.1" 204 0
2025-12-02 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090b450>
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F2442a66a-1fde-418f-8bb4-e2c183de5829_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/2442a66a-1fde-418f-8bb4-e2c183de5829_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf065eed0>
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252Fd765ab40-95ef-4f6f-b5d8-d83ffe00cd17_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/d765ab40-95ef-4f6f-b5d8-d83ffe00cd17_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f128729-4f66-5610-a7f4-9ce4667c373f
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0894c50>
2025-12-02 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252F63d872dc-7494-4fab-8982-31a8594b6c93_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/63d872dc-7494-4fab-8982-31a8594b6c93_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c94306fc-28f5-5b2e-9b3c-50581b7acee8
2025-12-02 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD19DVW/2025-12-02/image/76dedf30-ea35-4dc5-9fa4-b4910facd604_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625623?view=catalogue)
2025-12-02 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67XME/2025-12-02/image/a62ed79c-00b7-4b83-94c4-4c0875e129b7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628577?view=catalogue)
2025-12-02 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ef98a5a3-14ff-4938-af3a-a2645bfd9fad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117614027?view=catalogue)
2025-12-02 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN22AWH/2025-12-02/image/d82fd6f9-51bb-4a18-b147-5b0aa0fab017_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117614027?view=catalogue)
2025-12-02 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue)
2025-12-02 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue)
2025-12-02 19:00:57 [astonbarclay.gb] INFO: Found listing with ID: 117628272
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117628272%27 HTTP/1.1" 200 None
2025-12-02 19:00:57 [astonbarclay.gb] INFO: Scrape type for 117628272: 0
2025-12-02 19:00:57 [astonbarclay.gb] INFO: Found listing with ID: 117629580
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117629580%27 HTTP/1.1" 200 None
2025-12-02 19:00:57 [astonbarclay.gb] INFO: Scrape type for 117629580: 0
2025-12-02 19:00:57 [astonbarclay.gb] INFO: Found listing with ID: 117614495
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117614495%27 HTTP/1.1" 200 None
2025-12-02 19:00:57 [astonbarclay.gb] INFO: Scrape type for 117614495: 0
2025-12-02 19:00:57 [astonbarclay.gb] INFO: Found listing with ID: 53111162
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2753111162%27 HTTP/1.1" 200 None
2025-12-02 19:00:57 [astonbarclay.gb] INFO: Scrape type for 53111162: 2
2025-12-02 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07f3110>
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c6e250>
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F0cfcec80-cfc2-41ea-b28d-72affdc95646_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0cfcec80-cfc2-41ea-b28d-72affdc95646_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65
2025-12-02 19:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf035c2d0>
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf068d7d0>
2025-12-02 19:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252F07f574d2-02b5-48ca-a881-65e3ef8ba953_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/07f574d2-02b5-48ca-a881-65e3ef8ba953_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c94306fc-28f5-5b2e-9b3c-50581b7acee8
2025-12-02 19:00:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117573571, 'registration': 'EF24YGP', 'account': 'WBA002', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '2.0 B3P Ultra Dark 5dr Auto', 'mileage': 18329, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1354, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-06-16', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EF24YGP/2025-11-27/image/a71c7792-a133-4ab2-bea6-4531a79437d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/413e9332-571d-495a-a2d5-c0370567cdae_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/03df579e-9093-4e15-8887-95fa7a6bbc77_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/9d454c5c-fe82-466f-8c85-5b0cfeb845cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/ced45dae-1fe8-47ba-ae12-cbd1b2d614ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/e421488b-5dc4-495b-89d0-00c5625d897a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/16880807-c245-4654-b857-b9a5161d0aac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/60231612-8c08-440d-9e32-364a7e4d8dc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/081a96bf-44d5-4ebe-9c31-201527a9c825_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book PDI IN SERVICE BOOK, 06/25- 12K ON PRINT', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/febe8c06-724e-4552-a4c3-f8e8db1e9f9e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117573571, 'registration': 'EF24YGP', 'account': 'WBA002', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '2.0 B3P Ultra Dark 5dr Auto', 'mileage': 18329, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1354, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-06-16', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EF24YGP/2025-11-27/image/a71c7792-a133-4ab2-bea6-4531a79437d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/413e9332-571d-495a-a2d5-c0370567cdae_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/03df579e-9093-4e15-8887-95fa7a6bbc77_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/9d454c5c-fe82-466f-8c85-5b0cfeb845cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/ced45dae-1fe8-47ba-ae12-cbd1b2d614ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/e421488b-5dc4-495b-89d0-00c5625d897a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/16880807-c245-4654-b857-b9a5161d0aac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/60231612-8c08-440d-9e32-364a7e4d8dc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF24YGP/2025-11-27/image/081a96bf-44d5-4ebe-9c31-201527a9c825_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book PDI IN SERVICE BOOK, 06/25- 12K ON PRINT', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/febe8c06-724e-4552-a4c3-f8e8db1e9f9e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f00d31d8-c125-523a-a187-ee8117483cdf with identifier: 117573571
2025-12-02 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00d31d8-c125-523a-a187-ee8117483cdf with scrape type 2
2025-12-02 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f00d31d8-c125-523a-a187-ee8117483cdf with scrape type 2
2025-12-02 19:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f00d31d8-c125-523a-a187-ee8117483cdf, identifier: 117573571
2025-12-02 19:00:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117569240, 'registration': 'EK69OCE', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2T [130] Elite 5dr [Start Stop] Auto', 'mileage': 46424, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1349, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-11-08', 'fuel': 'Petrol', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK69OCE/2025-11-28/image/11df625d-5680-4aa5-95e9-8b18144856ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/57370a72-54a5-4b6c-a007-96d7278605a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/73070958-b6af-4026-970e-61a23574f016_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/243a6225-730c-4d26-bc27-048a2e5f95f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/6f750872-4a07-46e4-9433-ae230fcaf218_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/31b06694-6458-4969-95fb-d51d4a2fa8b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/ad2d60cc-02e6-4edb-bedf-fd245340502a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/dc288836-056c-4b4a-93e6-f3f1072f2592_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/f77f00fc-f755-494e-89b3-e28f5f099450_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/20- 5K, 02/21- 11K, ??- 19K, 02/24- 30K, 05/25- 40K, ??- 45K', 'remarks': 'VOSA STATES 18K, 28K, 36K, 45K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/680620f0-cd48-4511-b937-70c25e20f1c0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117569240, 'registration': 'EK69OCE', 'account': 'WBA002', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2T [130] Elite 5dr [Start Stop] Auto', 'mileage': 46424, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1349, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-11-08', 'fuel': 'Petrol', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK69OCE/2025-11-28/image/11df625d-5680-4aa5-95e9-8b18144856ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/57370a72-54a5-4b6c-a007-96d7278605a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/73070958-b6af-4026-970e-61a23574f016_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/243a6225-730c-4d26-bc27-048a2e5f95f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/6f750872-4a07-46e4-9433-ae230fcaf218_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/31b06694-6458-4969-95fb-d51d4a2fa8b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/ad2d60cc-02e6-4edb-bedf-fd245340502a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/dc288836-056c-4b4a-93e6-f3f1072f2592_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK69OCE/2025-11-28/image/f77f00fc-f755-494e-89b3-e28f5f099450_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/20- 5K, 02/21- 11K, ??- 19K, 02/24- 30K, 05/25- 40K, ??- 45K', 'remarks': 'VOSA STATES 18K, 28K, 36K, 45K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/680620f0-cd48-4511-b937-70c25e20f1c0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9d7038-2273-58b5-b194-7529f135a030 with identifier: 117569240
2025-12-02 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9d7038-2273-58b5-b194-7529f135a030 with scrape type 2
2025-12-02 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a9d7038-2273-58b5-b194-7529f135a030 with scrape type 2
2025-12-02 19:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4a9d7038-2273-58b5-b194-7529f135a030, identifier: 117569240
2025-12-02 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f00d31d8-c125-523a-a187-ee8117483cdf with identifier: 117573571
2025-12-02 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f00d31d8-c125-523a-a187-ee8117483cdf with identifier: 117573571
2025-12-02 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f00d31d8-c125-523a-a187-ee8117483cdf with identifier: 117573571 to the API
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117573571?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f00d31d8-c125-523a-a187-ee8117483cdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EF24YGP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573571',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLVO',
 'model': 'XC40 ESTATE',
 'odometer': 18329,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-16',
 'seller_name': 'UKCGR - Premium',
 'title': 'VOLVO XC40 ESTATE 2.0 B3P Ultra Dark 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 B3P Ultra Dark 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573571%27 HTTP/1.1" 200 None
2025-12-02 19:00:58 [astonbarclay.gb] INFO: Saving data for 117573571: {'auction_closing_time': 1764756000.0, 'created_time': 1764356611.507261, 'last_price_update_time': 1764702058.887185}
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117573571') HTTP/1.1" 204 0
2025-12-02 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4a9d7038-2273-58b5-b194-7529f135a030 with identifier: 117569240
2025-12-02 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4a9d7038-2273-58b5-b194-7529f135a030 with identifier: 117569240
2025-12-02 19:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4a9d7038-2273-58b5-b194-7529f135a030 with identifier: 117569240 to the API
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117569240?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4a9d7038-2273-58b5-b194-7529f135a030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK69OCE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117569240',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND X HATCHBACK',
 'odometer': 46424,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-08',
 'seller_name': 'UKCGR - Premium',
 'title': 'VAUXHALL CROSSLAND X HATCHBACK 1.2T [130] Elite 5dr [Start Stop] '
          'Auto',
 'transmission': 'automatic',
 'trim': '1.2T [130] Elite 5dr [Start Stop] Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569240%27 HTTP/1.1" 200 None
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Saving data for 117569240: {'auction_closing_time': 1764756000.0, 'created_time': 1764356602.12702, 'last_price_update_time': 1764702059.20003}
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117569240') HTTP/1.1" 204 0
2025-12-02 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67XME/2025-12-02/image/4a4248ed-ff7b-438b-bd82-ad0332b971a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628577?view=catalogue)
2025-12-02 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD19DVW/2025-12-02/image/afba6973-2bbb-4e88-9ebf-ac886eadfc97_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625623?view=catalogue)
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117613527
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613527%27 HTTP/1.1" 200 None
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117613527: 0
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117616319
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616319%27 HTTP/1.1" 200 None
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117616319: 0
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117616040
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616040%27 HTTP/1.1" 200 None
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117616040: 0
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117615588
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615588%27 HTTP/1.1" 200 None
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117615588: 0
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117615414
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615414%27 HTTP/1.1" 200 None
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117615414: 0
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117581566
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581566%27 HTTP/1.1" 200 None
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117581566: 0
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117645160
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117645160%27 HTTP/1.1" 200 None
2025-12-02 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117645160: 1
2025-12-02 19:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a82b90>
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F34d9e106-b052-49d8-9825-61799dc227f3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/34d9e106-b052-49d8-9825-61799dc227f3_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf080e250>
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F897e2d0d-3370-4187-bc02-29adbd99a990_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/897e2d0d-3370-4187-bc02-29adbd99a990_removebg.jpg?w=600 saved to cache
2025-12-02 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65
2025-12-02 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/d22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue)
2025-12-02 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG18XNU/2025-12-02/image/fe521320-6e60-4dc2-b4a0-a4b7dd7f440f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600033?view=catalogue)
2025-12-02 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF69LTY/2025-12-02/image/37378945-9be0-4147-b384-ab49c666020a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue)
2025-12-02 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117556910?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b5b410>
2025-12-02 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252F76dedf30-ea35-4dc5-9fa4-b4910facd604_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/76dedf30-ea35-4dc5-9fa4-b4910facd604_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08863d0>
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252Fa62ed79c-00b7-4b83-94c4-4c0875e129b7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/a62ed79c-00b7-4b83-94c4-4c0875e129b7_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b5bb90>
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252Fef98a5a3-14ff-4938-af3a-a2645bfd9fad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ef98a5a3-14ff-4938-af3a-a2645bfd9fad_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c94306fc-28f5-5b2e-9b3c-50581b7acee8
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0747790>
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN22AWH%252F2025-12-02%252Fimage%252Fd82fd6f9-51bb-4a18-b147-5b0aa0fab017_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN22AWH/2025-12-02/image/d82fd6f9-51bb-4a18-b147-5b0aa0fab017_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c94306fc-28f5-5b2e-9b3c-50581b7acee8
2025-12-02 19:01:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c94306fc-28f5-5b2e-9b3c-50581b7acee8, skipping ID generation
2025-12-02 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c94306fc-28f5-5b2e-9b3c-50581b7acee8 with scrape type 1
2025-12-02 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c94306fc-28f5-5b2e-9b3c-50581b7acee8 from tracking dictionaries
2025-12-02 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c94306fc-28f5-5b2e-9b3c-50581b7acee8 sending to next pipeline
2025-12-02 19:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c94306fc-28f5-5b2e-9b3c-50581b7acee8, identifier: 117614027
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1cf8490>
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05e5f50>
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252Fc964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:01:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117638971, 'registration': 'YP69YFG', 'account': 'WBA002', 'make': 'BMW', 'model': 'X4 DIESEL ESTATE', 'derivative': 'xDrive20d M Sport 5dr Step Auto', 'mileage': 29480, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1357, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-29', 'fuel': 'Diesel', 'motExpiry': '2026-09-01', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP69YFG/2025-12-01/image/37e0a56a-26bd-4db0-aca3-3f0d74b6e858_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/e7607686-8b00-46e0-a44d-abf95ccd44f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/92c521cc-6197-471b-b442-9056f4096ef9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/aa7a08dd-bd7c-40f5-8772-fb7111786647_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/d7e5d628-1e1d-4f16-9e0b-6702d6f220ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/fc85f602-0e9a-4311-9f3e-ad417516254a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/729e2884-c49f-45bb-b938-a82471f9596e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00ad56d2-9141-4e15-85e3-0e9433238a7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00aa13e2-f14f-48f4-93d7-3d6c406b7e61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/df7075d9-cfb9-4475-b35b-89ace0c8bedd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/9144efbc-77c4-4b5c-a1ae-b7ff87a04bec_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/21- 7K, 02/23- 13K', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 10K, 16K, 20K, 27K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ef3b7e2-2988-465f-8f0a-5782c2f51ab5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117638971, 'registration': 'YP69YFG', 'account': 'WBA002', 'make': 'BMW', 'model': 'X4 DIESEL ESTATE', 'derivative': 'xDrive20d M Sport 5dr Step Auto', 'mileage': 29480, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1357, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-29', 'fuel': 'Diesel', 'motExpiry': '2026-09-01', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP69YFG/2025-12-01/image/37e0a56a-26bd-4db0-aca3-3f0d74b6e858_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/e7607686-8b00-46e0-a44d-abf95ccd44f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/92c521cc-6197-471b-b442-9056f4096ef9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/aa7a08dd-bd7c-40f5-8772-fb7111786647_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/d7e5d628-1e1d-4f16-9e0b-6702d6f220ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/fc85f602-0e9a-4311-9f3e-ad417516254a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/729e2884-c49f-45bb-b938-a82471f9596e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00ad56d2-9141-4e15-85e3-0e9433238a7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00aa13e2-f14f-48f4-93d7-3d6c406b7e61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/df7075d9-cfb9-4475-b35b-89ace0c8bedd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/9144efbc-77c4-4b5c-a1ae-b7ff87a04bec_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/21- 7K, 02/23- 13K', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 10K, 16K, 20K, 27K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ef3b7e2-2988-465f-8f0a-5782c2f51ab5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84ce3049-ca46-5717-9e57-9f448ec2e2c6 with identifier: 117638971
2025-12-02 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6 with scrape type 1
2025-12-02 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F37e0a56a-26bd-4db0-aca3-3f0d74b6e858_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/37e0a56a-26bd-4db0-aca3-3f0d74b6e858_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF69LTY/2025-12-02/image/56dc19a4-1203-4f50-8f6e-f66647fcd2f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue)
2025-12-02 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX69OMA/2025-12-02/image/feeebb7f-bea8-4fcc-bd53-ec35d919e63c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634427?view=catalogue)
2025-12-02 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67WSL/2025-12-02/image/77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue)
2025-12-02 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117631748
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631748%27 HTTP/1.1" 200 None
2025-12-02 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117631748: 0
2025-12-02 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117616437
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616437%27 HTTP/1.1" 200 None
2025-12-02 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117616437: 0
2025-12-02 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117615989
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615989%27 HTTP/1.1" 200 None
2025-12-02 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117615989: 0
2025-12-02 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117616597
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616597%27 HTTP/1.1" 200 None
2025-12-02 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117616597: 2
2025-12-02 19:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c94306fc-28f5-5b2e-9b3c-50581b7acee8 with identifier: 117614027
2025-12-02 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c94306fc-28f5-5b2e-9b3c-50581b7acee8 with identifier: 117614027
2025-12-02 19:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c94306fc-28f5-5b2e-9b3c-50581b7acee8 with identifier: 117614027 to the API
2025-12-02 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/VN22AWH/2025-12-02/image/d82fd6f9-51bb-4a18-b147-5b0aa0fab017_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c94306fc-28f5-5b2e-9b3c-50581b7acee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VN22AWH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117614027',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS SALOON SPECIAL EDITIONS',
 'odometer': 41895,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26128,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/0733037a-40a2-407c-b820-b08821009ea3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26287,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ffe8c206-6654-4bc2-8b2b-3be36c6d96e3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26924,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/3362e9a0-8a77-4e1d-9317-6a1d22d29a27_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28008,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/fd78f66e-27a8-4165-ad1a-ab887c18a71f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45704,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/26d5c4a3-3487-4953-83e7-bfac19d0b756_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97809,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/63d872dc-7494-4fab-8982-31a8594b6c93_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79198,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/07f574d2-02b5-48ca-a881-65e3ef8ba953_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46741,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/ef98a5a3-14ff-4938-af3a-a2645bfd9fad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c94306fc-28f5-5b2e-9b3c-50581b7acee8/c94306fc-28f5-5b2e-9b3c-50581b7acee8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37763,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VN22AWH/2025-12-02/image/d82fd6f9-51bb-4a18-b147-5b0aa0fab017_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-21',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'MERCEDES-BENZ A CLASS SALOON SPECIAL EDITIONS A180d AMG Line '
          'Premium Edition 4dr Auto',
 'transmission': 'automatic',
 'trim': 'A180d AMG Line Premium Edition 4dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117614027%27 HTTP/1.1" 200 None
2025-12-02 19:01:02 [astonbarclay.gb] INFO: Saving data for 117614027: {'created_time': 1764702062.180031, 'last_price_update_time': 1764702062.180045, 'auction_closing_time': 1764756000.0}
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117614027') HTTP/1.1" 204 0
2025-12-02 19:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e468d304-4f9f-4ca5-b567-be5d4744ca49_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue)
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252Fe7607686-8b00-46e0-a44d-abf95ccd44f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/e7607686-8b00-46e0-a44d-abf95ccd44f4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0636850>
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67XME%252F2025-12-02%252Fimage%252F4a4248ed-ff7b-438b-bd82-ad0332b971a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67XME/2025-12-02/image/4a4248ed-ff7b-438b-bd82-ad0332b971a5_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35
2025-12-02 19:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35, skipping ID generation
2025-12-02 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35 with scrape type 1
2025-12-02 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35 from tracking dictionaries
2025-12-02 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35 sending to next pipeline
2025-12-02 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35, identifier: 117628577
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf086c850>
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD19DVW%252F2025-12-02%252Fimage%252Fafba6973-2bbb-4e88-9ebf-ac886eadfc97_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD19DVW/2025-12-02/image/afba6973-2bbb-4e88-9ebf-ac886eadfc97_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65
2025-12-02 19:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 456abc21-d3bf-5e9a-b7ef-16d93e70cf65, skipping ID generation
2025-12-02 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65 with scrape type 1
2025-12-02 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65 from tracking dictionaries
2025-12-02 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 456abc21-d3bf-5e9a-b7ef-16d93e70cf65 sending to next pipeline
2025-12-02 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 456abc21-d3bf-5e9a-b7ef-16d93e70cf65, identifier: 117625623
2025-12-02 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX69OMA/2025-12-02/image/1552f193-d154-4a0a-89ee-53b79dbfc7f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634427?view=catalogue)
2025-12-02 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117643292
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117643292%27 HTTP/1.1" 200 None
2025-12-02 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117643292: 1
2025-12-02 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35 with identifier: 117628577
2025-12-02 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35 with identifier: 117628577
2025-12-02 19:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35 with identifier: 117628577 to the API
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LL67XME/2025-12-02/image/4a4248ed-ff7b-438b-bd82-ad0332b971a5_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL67XME',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117628577',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 59127,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35062,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/252f9f3e-84d8-4765-bd2a-0603b1d68223_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36346,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/899a345e-f22a-4971-8a52-919777198454_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30716,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/9a2cb65a-88b7-4d15-b814-474a82685a23_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29609,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/65982844-45ad-4fb3-8459-88f8770809b0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55655,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/426147eb-6fff-41b8-a00a-7f248c18c6a6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57204,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/c2e8d6bd-a8f5-4acb-b9a5-fb9a5e982c56_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43177,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/2442a66a-1fde-418f-8bb4-e2c183de5829_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48777,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/34d9e106-b052-49d8-9825-61799dc227f3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39092,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/a62ed79c-00b7-4b83-94c4-4c0875e129b7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35/e7bfa6d6-5bfe-515e-a3d0-d2b9fb2fee35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55309,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LL67XME/2025-12-02/image/4a4248ed-ff7b-438b-bd82-ad0332b971a5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-22',
 'seller_name': 'Hedin Automotive Mini',
 'title': 'MINI HATCHBACK 1.5 Cooper 3dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 Cooper 3dr Auto',
 'vin': None,
 'year': 2017}
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117628577%27 HTTP/1.1" 200 None
2025-12-02 19:01:03 [astonbarclay.gb] INFO: Saving data for 117628577: {'created_time': 1764702063.378241, 'last_price_update_time': 1764702063.378251, 'auction_closing_time': 1764756000.0}
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117628577') HTTP/1.1" 204 0
2025-12-02 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 456abc21-d3bf-5e9a-b7ef-16d93e70cf65 with identifier: 117625623
2025-12-02 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 456abc21-d3bf-5e9a-b7ef-16d93e70cf65 with identifier: 117625623
2025-12-02 19:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 456abc21-d3bf-5e9a-b7ef-16d93e70cf65 with identifier: 117625623 to the API
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LD19DVW/2025-12-02/image/afba6973-2bbb-4e88-9ebf-ac886eadfc97_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '456abc21-d3bf-5e9a-b7ef-16d93e70cf65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LD19DVW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117625623',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KA+ HATCHBACK',
 'odometer': 25138,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22701,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/a4ac90ec-708d-45e1-a2a2-ab885a8fbc4e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25243,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0549c7b8-be62-4964-9496-ddd80024e872_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21187,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/dd5a0fa5-ca1c-416a-92ec-99a107f2d644_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23368,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/3c9d855e-7aaf-499e-9ff6-fdb9b5e13b58_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46499,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/9eb0d604-96e0-492a-802a-bc3bd77e35c4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82183,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/0cfcec80-cfc2-41ea-b28d-72affdc95646_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77534,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/897e2d0d-3370-4187-bc02-29adbd99a990_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41857,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/76dedf30-ea35-4dc5-9fa4-b4910facd604_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456abc21-d3bf-5e9a-b7ef-16d93e70cf65/456abc21-d3bf-5e9a-b7ef-16d93e70cf65_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45166,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD19DVW/2025-12-02/image/afba6973-2bbb-4e88-9ebf-ac886eadfc97_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-04',
 'seller_name': 'Hedin Automotive',
 'title': 'FORD KA+ HATCHBACK 1.2 85 Active 5dr',
 'transmission': 'manual',
 'trim': '1.2 85 Active 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625623%27 HTTP/1.1" 200 None
2025-12-02 19:01:03 [astonbarclay.gb] INFO: Saving data for 117625623: {'created_time': 1764702063.782627, 'last_price_update_time': 1764702063.78264, 'auction_closing_time': 1764756000.0}
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117625623') HTTP/1.1" 204 0
2025-12-02 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07c1d50>
2025-12-02 19:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252Fd22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/d22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0887990>
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252Ffe521320-6e60-4dc2-b4a0-a4b7dd7f440f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/fe521320-6e60-4dc2-b4a0-a4b7dd7f440f_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf3360690>
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252F37378945-9be0-4147-b384-ab49c666020a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/37378945-9be0-4147-b384-ab49c666020a_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4fe52d45-63a2-53ab-8319-e0b8532403ce
2025-12-02 19:01:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117556910, 'registration': 'AV16DPN', 'account': 'WBA003', 'make': 'VAUXHALL', 'model': 'VIVA HATCHBACK', 'derivative': '1.0 SL 5dr', 'mileage': 42101, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1358, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-08-12', 'fuel': 'Petrol', 'motExpiry': '2026-09-24', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AV16DPN/2025-11-27/image/28b6389a-c84a-4ddf-b4d4-85221844e474_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/dc707e54-d8c9-415e-8f4c-f05d4d0c3e0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/e061aa01-711c-41c0-9632-95138e2d5c28_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/4d90f8e0-b940-4d13-b565-1e094b6a84d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/482d6628-c19d-43bf-a6ae-863d015af646_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/88a4202f-5d16-4cca-9e94-0b48082ed12b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/04f52327-e3cd-400b-ac97-06edb8cbc26f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/8d07e779-4158-445c-9369-309d41416efd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/b1e5d424-f3f0-427b-9d00-c423644ec3bd_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/17- 7K, 06/18- 17K, 09/19- 25K, 09/20- 25K, 10/21- 27K, 09/22- 29K, 09/23- 32K, 09/24- 36K, 09/25- 41K', 'remarks': 'VOSA STATES 29K, 32K, 36K, 41K, BROKEN SPARE KEY IN OFFICE (BUTTON)', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f43c96a6-0c50-4cf0-baa8-f6dde8946c97.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117556910, 'registration': 'AV16DPN', 'account': 'WBA003', 'make': 'VAUXHALL', 'model': 'VIVA HATCHBACK', 'derivative': '1.0 SL 5dr', 'mileage': 42101, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1358, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-08-12', 'fuel': 'Petrol', 'motExpiry': '2026-09-24', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AV16DPN/2025-11-27/image/28b6389a-c84a-4ddf-b4d4-85221844e474_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/dc707e54-d8c9-415e-8f4c-f05d4d0c3e0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/e061aa01-711c-41c0-9632-95138e2d5c28_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/4d90f8e0-b940-4d13-b565-1e094b6a84d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/482d6628-c19d-43bf-a6ae-863d015af646_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/88a4202f-5d16-4cca-9e94-0b48082ed12b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/04f52327-e3cd-400b-ac97-06edb8cbc26f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/8d07e779-4158-445c-9369-309d41416efd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV16DPN/2025-11-27/image/b1e5d424-f3f0-427b-9d00-c423644ec3bd_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/17- 7K, 06/18- 17K, 09/19- 25K, 09/20- 25K, 10/21- 27K, 09/22- 29K, 09/23- 32K, 09/24- 36K, 09/25- 41K', 'remarks': 'VOSA STATES 29K, 32K, 36K, 41K, BROKEN SPARE KEY IN OFFICE (BUTTON)', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f43c96a6-0c50-4cf0-baa8-f6dde8946c97.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc9c5282-b0bf-5c36-b372-f3e9640a5c6d with identifier: 117556910
2025-12-02 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc9c5282-b0bf-5c36-b372-f3e9640a5c6d with scrape type 2
2025-12-02 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc9c5282-b0bf-5c36-b372-f3e9640a5c6d with scrape type 2
2025-12-02 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bc9c5282-b0bf-5c36-b372-f3e9640a5c6d, identifier: 117556910
2025-12-02 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF69LTY/2025-12-02/image/0af3fb97-8ce3-45e0-9184-c553b71405e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue)
2025-12-02 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67WSL/2025-12-02/image/b8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue)
2025-12-02 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL16LSX/2025-12-02/image/0df47926-12ea-4ce2-b22c-043f4443abc8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634437?view=catalogue)
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F92c521cc-6197-471b-b442-9056f4096ef9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/92c521cc-6197-471b-b442-9056f4096ef9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bc9c5282-b0bf-5c36-b372-f3e9640a5c6d with identifier: 117556910
2025-12-02 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bc9c5282-b0bf-5c36-b372-f3e9640a5c6d with identifier: 117556910
2025-12-02 19:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bc9c5282-b0bf-5c36-b372-f3e9640a5c6d with identifier: 117556910 to the API
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117556910?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'bc9c5282-b0bf-5c36-b372-f3e9640a5c6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AV16DPN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117556910',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'VIVA HATCHBACK',
 'odometer': 42101,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-12',
 'seller_name': 'UKCGR - Select',
 'title': 'VAUXHALL VIVA HATCHBACK 1.0 SL 5dr',
 'transmission': 'manual',
 'trim': '1.0 SL 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117556910%27 HTTP/1.1" 200 None
2025-12-02 19:01:05 [astonbarclay.gb] INFO: Saving data for 117556910: {'auction_closing_time': 1764756000.0, 'created_time': 1764356765.227364, 'last_price_update_time': 1764702065.014058}
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117556910') HTTP/1.1" 204 0
2025-12-02 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX69OMA/2025-12-02/image/aefccbd7-df7a-42e8-aa4d-50d477e6bb9d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634427?view=catalogue)
2025-12-02 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG18XNU/2025-12-02/image/d731dbf0-8ef8-443e-afb2-7a9b2feb19a0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600033?view=catalogue)
2025-12-02 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK16VHA/2025-12-02/image/06659b41-2032-478d-bc81-59901621a370_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634478?view=catalogue)
2025-12-02 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 117597433
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597433%27 HTTP/1.1" 200 None
2025-12-02 19:01:05 [astonbarclay.gb] INFO: Scrape type for 117597433: 0
2025-12-02 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 117632895
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632895%27 HTTP/1.1" 200 None
2025-12-02 19:01:05 [astonbarclay.gb] INFO: Scrape type for 117632895: 0
2025-12-02 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 117631988
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631988%27 HTTP/1.1" 200 None
2025-12-02 19:01:05 [astonbarclay.gb] INFO: Scrape type for 117631988: 0
2025-12-02 19:01:05 [astonbarclay.gb] INFO: Found listing with ID: 117642583
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117642583%27 HTTP/1.1" 200 None
2025-12-02 19:01:05 [astonbarclay.gb] INFO: Scrape type for 117642583: 1
2025-12-02 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117643996?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf041f890>
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252F56dc19a4-1203-4f50-8f6e-f66647fcd2f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/56dc19a4-1203-4f50-8f6e-f66647fcd2f2_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4fe52d45-63a2-53ab-8319-e0b8532403ce
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0629290>
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Ffeeebb7f-bea8-4fcc-bd53-ec35d919e63c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/feeebb7f-bea8-4fcc-bd53-ec35d919e63c_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 947e4204-0720-5876-bad2-6dad899f30d7
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06a9dd0>
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04ec790>
2025-12-02 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252Fe468d304-4f9f-4ca5-b567-be5d4744ca49_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e468d304-4f9f-4ca5-b567-be5d4744ca49_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4fe52d45-63a2-53ab-8319-e0b8532403ce
2025-12-02 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP69YFG/2025-12-01/image/37e0a56a-26bd-4db0-aca3-3f0d74b6e858_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue)
2025-12-02 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue)
2025-12-02 19:01:06 [scrapy.extensions.logstats] INFO: Crawled 61 pages (at 61 pages/min), scraped 17 items (at 17 items/min)
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252Faa7a08dd-bd7c-40f5-8772-fb7111786647_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/aa7a08dd-bd7c-40f5-8772-fb7111786647_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117516097
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117516097%27 HTTP/1.1" 200 None
2025-12-02 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117516097: 2
2025-12-02 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/53111162?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117567379?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0636b50>
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252F1552f193-d154-4a0a-89ee-53b79dbfc7f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/1552f193-d154-4a0a-89ee-53b79dbfc7f1_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 947e4204-0720-5876-bad2-6dad899f30d7
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d5ff50>
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252F0af3fb97-8ce3-45e0-9184-c553b71405e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/0af3fb97-8ce3-45e0-9184-c553b71405e5_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4fe52d45-63a2-53ab-8319-e0b8532403ce
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf093fa90>
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252Fb8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/b8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06de610>
2025-12-02 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL16LSX%252F2025-12-02%252Fimage%252F0df47926-12ea-4ce2-b22c-043f4443abc8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL16LSX/2025-12-02/image/0df47926-12ea-4ce2-b22c-043f4443abc8_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f128729-4f66-5610-a7f4-9ce4667c373f
2025-12-02 19:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f128729-4f66-5610-a7f4-9ce4667c373f, skipping ID generation
2025-12-02 19:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f128729-4f66-5610-a7f4-9ce4667c373f with scrape type 1
2025-12-02 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4f128729-4f66-5610-a7f4-9ce4667c373f from tracking dictionaries
2025-12-02 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f128729-4f66-5610-a7f4-9ce4667c373f sending to next pipeline
2025-12-02 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4f128729-4f66-5610-a7f4-9ce4667c373f, identifier: 117634437
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252Fd7e5d628-1e1d-4f16-9e0b-6702d6f220ca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/d7e5d628-1e1d-4f16-9e0b-6702d6f220ca_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117603221?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4f128729-4f66-5610-a7f4-9ce4667c373f with identifier: 117634437
2025-12-02 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4f128729-4f66-5610-a7f4-9ce4667c373f with identifier: 117634437
2025-12-02 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151170 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151170
2025-12-02 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4f128729-4f66-5610-a7f4-9ce4667c373f spider: astonbarclay.gb
2025-12-02 19:01:07 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4f128729-4f66-5610-a7f4-9ce4667c373f due to rule: high_mileage_for_country.json, error: 151170 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151170
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '4f128729-4f66-5610-a7f4-9ce4667c373f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PK16LSX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117634437',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'AUDI',
 'model': 'Q5 ESTATE SPECIAL EDITIONS',
 'odometer': 93933,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21790,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/719324e0-de27-4e14-b714-3a5c06a2a220_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21297,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/6043935d-f9a9-4bfb-875e-628744aed9d2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24055,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/51ccb9ae-76ed-47a4-b517-548572c1a0ea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23293,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/f487d300-e5d2-4d72-a9a8-f98804a27af7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40824,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/b2d0bb6d-4638-4aab-af45-acd6b2d165c7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88791,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/0df47926-12ea-4ce2-b22c-043f4443abc8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84788,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/c56ccd0a-e4a5-4f1c-8a46-4788fd327b13_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43078,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/2c878d17-3181-4357-8e18-f455692c5031_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f128729-4f66-5610-a7f4-9ce4667c373f/4f128729-4f66-5610-a7f4-9ce4667c373f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37817,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/d765ab40-95ef-4f6f-b5d8-d83ffe00cd17_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'AUDI Q5 ESTATE SPECIAL EDITIONS 2.0 TDI [190] Quattro S Line Plus '
          '5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI [190] Quattro S Line Plus 5dr S Tronic',
 'vin': None,
 'year': 2016}
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634437%27 HTTP/1.1" 200 None
2025-12-02 19:01:07 [astonbarclay.gb] INFO: Saving data for 117634437: {'created_time': 1764702067.564684, 'last_price_update_time': 1764702067.564696, 'auction_closing_time': 1764755100.0}
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117634437') HTTP/1.1" 204 0
2025-12-02 19:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0358690>
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Faefccbd7-df7a-42e8-aa4d-50d477e6bb9d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/aefccbd7-df7a-42e8-aa4d-50d477e6bb9d_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 947e4204-0720-5876-bad2-6dad899f30d7
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf033f510>
2025-12-02 19:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252Fd731dbf0-8ef8-443e-afb2-7a9b2feb19a0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/d731dbf0-8ef8-443e-afb2-7a9b2feb19a0_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06ac490>
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F06659b41-2032-478d-bc81-59901621a370_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/06659b41-2032-478d-bc81-59901621a370_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf502d3f-3084-5f78-b546-5e0d0e94ab79
2025-12-02 19:01:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117643996, 'registration': 'WA19OEF', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE Dynamique S Nav 5dr', 'mileage': 58171, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1370, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-05-20', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WA19OEF/2025-12-02/image/cd89afed-1985-48bf-89d7-833c0429d62b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/02350ad5-4cbc-4224-a122-0d176485cc67_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/d6075723-ac24-45b1-bbb0-92e63cf7b04d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/15a7d715-80e9-435e-a2cf-45367fe744ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/a6e3c591-1822-40cc-b969-4178d01d7122_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/7a559993-feb2-404e-a71a-3ec4425fd5b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/643b15f2-0020-4f0c-994b-124ff3a8854b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/5bab4905-9a81-4130-9734-207c893b7f40_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/bef26e51-a6a7-41fc-9598-2205664c081c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/65b8e1e3-d2cb-4434-8215-0291b45b7082_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 04/24-27k', 'remarks': 'SPARE KEY - VOSA STATES 4K, 5K, 27K, 44K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/704d0f5b-796b-4911-8893-424681446b49.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117643996, 'registration': 'WA19OEF', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE Dynamique S Nav 5dr', 'mileage': 58171, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1370, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-05-20', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WA19OEF/2025-12-02/image/cd89afed-1985-48bf-89d7-833c0429d62b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/02350ad5-4cbc-4224-a122-0d176485cc67_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/d6075723-ac24-45b1-bbb0-92e63cf7b04d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/15a7d715-80e9-435e-a2cf-45367fe744ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/a6e3c591-1822-40cc-b969-4178d01d7122_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/7a559993-feb2-404e-a71a-3ec4425fd5b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/643b15f2-0020-4f0c-994b-124ff3a8854b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/5bab4905-9a81-4130-9734-207c893b7f40_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/bef26e51-a6a7-41fc-9598-2205664c081c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/65b8e1e3-d2cb-4434-8215-0291b45b7082_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 04/24-27k', 'remarks': 'SPARE KEY - VOSA STATES 4K, 5K, 27K, 44K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/704d0f5b-796b-4911-8893-424681446b49.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba725021-09cf-57e7-9aed-956ffee46fe6 with identifier: 117643996
2025-12-02 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba725021-09cf-57e7-9aed-956ffee46fe6 with scrape type 1
2025-12-02 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba725021-09cf-57e7-9aed-956ffee46fe6
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252Fcd89afed-1985-48bf-89d7-833c0429d62b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/cd89afed-1985-48bf-89d7-833c0429d62b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP69YFG/2025-12-01/image/e7607686-8b00-46e0-a44d-abf95ccd44f4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue)
2025-12-02 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK16VHA/2025-12-02/image/83947f5e-e6cf-42e0-9105-7cb241d3b39e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634478?view=catalogue)
2025-12-02 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX69OMA/2025-12-02/image/f869c3e0-655f-4956-9f96-0cc788d57eec_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634427?view=catalogue)
2025-12-02 19:01:08 [astonbarclay.gb] INFO: Found listing with ID: 117632412
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632412%27 HTTP/1.1" 200 None
2025-12-02 19:01:08 [astonbarclay.gb] INFO: Scrape type for 117632412: 0
2025-12-02 19:01:08 [astonbarclay.gb] INFO: Found listing with ID: 117540360
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117540360%27 HTTP/1.1" 200 None
2025-12-02 19:01:08 [astonbarclay.gb] INFO: Scrape type for 117540360: 2
2025-12-02 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP69YFG/2025-12-01/image/92c521cc-6197-471b-b442-9056f4096ef9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue)
2025-12-02 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67WSL/2025-12-02/image/68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue)
2025-12-02 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF69LTY/2025-12-02/image/6701d40e-48f2-4334-96fe-482f81e13cae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue)
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252Ffc85f602-0e9a-4311-9f3e-ad417516254a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/fc85f602-0e9a-4311-9f3e-ad417516254a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F02350ad5-4cbc-4224-a122-0d176485cc67_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/02350ad5-4cbc-4224-a122-0d176485cc67_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117498763?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117645160?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f0eb10>
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F37e0a56a-26bd-4db0-aca3-3f0d74b6e858_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/37e0a56a-26bd-4db0-aca3-3f0d74b6e858_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07a8d10>
2025-12-02 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252Fbb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 53111162, 'registration': 'SM17ZJV', 'account': 'WBA002', 'make': 'HYUNDAI', 'model': 'IX20 HATCHBACK', 'derivative': '1.6 SE 5dr Auto', 'mileage': 71033, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1375, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-08-08', 'fuel': 'Petrol', 'motExpiry': '2026-05-13', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/5ce2434a-2ee9-432e-8853-cb5a222bb8ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/1d80ffe5-a095-4564-aa87-40dfbfe4f6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/a095452f-d79d-4969-a86f-6dccd45ef430_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/0b5766dc-948b-4444-a7b0-aa2a2237aeb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/981a634a-ecd4-4b6a-a106-55779a58129d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/11f848b9-347a-444c-ac9f-e08869bea02e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/30eed4c9-e12e-42c0-a466-08a2c59b0d37_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/d3a99276-62bb-4864-9cf7-68f3eff8a416_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/fcf7a759-2d6e-4c7e-ac63-d456a172d536_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 26K, 38K, 52K, 65K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5a25b185-9a15-4107-95f2-5b7ef0169c36.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 53111162, 'registration': 'SM17ZJV', 'account': 'WBA002', 'make': 'HYUNDAI', 'model': 'IX20 HATCHBACK', 'derivative': '1.6 SE 5dr Auto', 'mileage': 71033, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1375, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-08-08', 'fuel': 'Petrol', 'motExpiry': '2026-05-13', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/5ce2434a-2ee9-432e-8853-cb5a222bb8ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/1d80ffe5-a095-4564-aa87-40dfbfe4f6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/a095452f-d79d-4969-a86f-6dccd45ef430_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/0b5766dc-948b-4444-a7b0-aa2a2237aeb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/981a634a-ecd4-4b6a-a106-55779a58129d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/11f848b9-347a-444c-ac9f-e08869bea02e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/30eed4c9-e12e-42c0-a466-08a2c59b0d37_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/d3a99276-62bb-4864-9cf7-68f3eff8a416_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM17ZJV/2025-11-29/image/fcf7a759-2d6e-4c7e-ac63-d456a172d536_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 26K, 38K, 52K, 65K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5a25b185-9a15-4107-95f2-5b7ef0169c36.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af4c8a8-c703-51b7-bceb-a0fdc5642faf with identifier: 53111162
2025-12-02 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af4c8a8-c703-51b7-bceb-a0fdc5642faf with scrape type 2
2025-12-02 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0af4c8a8-c703-51b7-bceb-a0fdc5642faf with scrape type 2
2025-12-02 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0af4c8a8-c703-51b7-bceb-a0fdc5642faf, identifier: 53111162
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117567379, 'registration': 'LL18FXA', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR DIESEL ESTATE', 'derivative': '2.0 D180 R-Dynamic S 5dr Auto', 'mileage': 90337, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1351, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-05-12', 'fuel': 'Diesel', 'motExpiry': '2025-12-05', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LL18FXA/2025-11-27/image/776d6d36-443f-4b06-bcd1-f38dd1e1ebf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/f2716bc0-cd7f-4478-9c6d-c06d8db33a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/272cc48f-39ed-4603-bc12-3f58863b75d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/baa1f55f-c513-4ba7-b394-793e395c01ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/3dbeb76f-74dc-49eb-93e9-d3184278825e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/c345c357-0307-46fc-87ff-9e18370bd29e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/b26f03f9-e6c1-4a94-aaf5-13ba30eb21a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/0ba0720b-5c65-45c3-a9aa-84f3c2ad9056_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/450bc8d1-ded1-4fdf-a594-14d92b9b491d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/22- 44K, 09/25- 87K', 'remarks': 'VOSA STATES 39K, 51K, 63K, 75K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a10cecab-7e9e-48d0-8d1a-d85d9af58333.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117567379, 'registration': 'LL18FXA', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR DIESEL ESTATE', 'derivative': '2.0 D180 R-Dynamic S 5dr Auto', 'mileage': 90337, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1351, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-05-12', 'fuel': 'Diesel', 'motExpiry': '2025-12-05', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LL18FXA/2025-11-27/image/776d6d36-443f-4b06-bcd1-f38dd1e1ebf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/f2716bc0-cd7f-4478-9c6d-c06d8db33a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/272cc48f-39ed-4603-bc12-3f58863b75d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/baa1f55f-c513-4ba7-b394-793e395c01ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/3dbeb76f-74dc-49eb-93e9-d3184278825e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/c345c357-0307-46fc-87ff-9e18370bd29e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/b26f03f9-e6c1-4a94-aaf5-13ba30eb21a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/0ba0720b-5c65-45c3-a9aa-84f3c2ad9056_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18FXA/2025-11-27/image/450bc8d1-ded1-4fdf-a594-14d92b9b491d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/22- 44K, 09/25- 87K', 'remarks': 'VOSA STATES 39K, 51K, 63K, 75K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a10cecab-7e9e-48d0-8d1a-d85d9af58333.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b0a19e9-e636-5748-9ae1-562ce50533f1 with identifier: 117567379
2025-12-02 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0a19e9-e636-5748-9ae1-562ce50533f1 with scrape type 2
2025-12-02 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b0a19e9-e636-5748-9ae1-562ce50533f1 with scrape type 2
2025-12-02 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5b0a19e9-e636-5748-9ae1-562ce50533f1, identifier: 117567379
2025-12-02 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG18XNU/2025-12-02/image/58f39e7f-9914-4196-9253-2b99e603c9fd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600033?view=catalogue)
2025-12-02 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue)
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Found listing with ID: 117613969
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613969%27 HTTP/1.1" 200 None
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Scrape type for 117613969: 0
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Found listing with ID: 117639808
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639808%27 HTTP/1.1" 200 None
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Scrape type for 117639808: 1
2025-12-02 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0af4c8a8-c703-51b7-bceb-a0fdc5642faf with identifier: 53111162
2025-12-02 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0af4c8a8-c703-51b7-bceb-a0fdc5642faf with identifier: 53111162
2025-12-02 19:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0af4c8a8-c703-51b7-bceb-a0fdc5642faf with identifier: 53111162 to the API
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270af4c8a8-c703-51b7-bceb-a0fdc5642faf%27 HTTP/1.1" 200 None
2025-12-02 19:01:09 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0af4c8a8-c703-51b7-bceb-a0fdc5642faf: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:01:08 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/53111162?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0af4c8a8-c703-51b7-bceb-a0fdc5642faf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SM17ZJV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/53111162',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'IX20 HATCHBACK',
 'odometer': 71033,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-08',
 'seller_name': 'UKCGR - Premium',
 'title': 'HYUNDAI IX20 HATCHBACK 1.6 SE 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 SE 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2753111162%27 HTTP/1.1" 200 None
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Saving data for 53111162: {'auction_closing_time': 1764756000.0, 'created_time': 1764356713.484996, 'last_price_update_time': 1764702069.608992}
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='53111162') HTTP/1.1" 204 0
2025-12-02 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5b0a19e9-e636-5748-9ae1-562ce50533f1 with identifier: 117567379
2025-12-02 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5b0a19e9-e636-5748-9ae1-562ce50533f1 with identifier: 117567379
2025-12-02 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145382 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145382
2025-12-02 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 5b0a19e9-e636-5748-9ae1-562ce50533f1 spider: astonbarclay.gb
2025-12-02 19:01:09 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5b0a19e9-e636-5748-9ae1-562ce50533f1 due to rule: high_mileage_for_make.json, error: 145382 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145382
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '5b0a19e9-e636-5748-9ae1-562ce50533f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL18FXA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117567379',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR DIESEL ESTATE',
 'odometer': 90337,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-12',
 'seller_name': 'UKCGR - Premium',
 'title': 'LAND ROVER RANGE ROVER VELAR DIESEL ESTATE 2.0 D180 R-Dynamic S 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '2.0 D180 R-Dynamic S 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117567379%27 HTTP/1.1" 200 None
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Saving data for 117567379: {'auction_closing_time': 1764756000.0, 'created_time': 1764356599.216159, 'last_price_update_time': 1764702069.820453}
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117567379') HTTP/1.1" 204 0
2025-12-02 19:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F729e2884-c49f-45bb-b938-a82471f9596e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/729e2884-c49f-45bb-b938-a82471f9596e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252Fd6075723-ac24-45b1-bbb0-92e63cf7b04d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/d6075723-ac24-45b1-bbb0-92e63cf7b04d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117603221, 'registration': 'HV17SZJ', 'account': 'WBA002', 'make': 'CITROEN', 'model': 'C1 HATCHBACK', 'derivative': '1.0 VTi Feel 3dr', 'mileage': 18301, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1355, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-24', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/e96160ad-1a7b-4b07-8884-d1abb8d7a454_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/9a2226a6-057e-40b4-8ab1-f2e33d434d67_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/524f22d7-ef9a-4fdf-8237-e2b8734808c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/54f5c3fe-18f0-4fb8-8fd4-24e7a34ef62c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/6ef0e8ad-fd69-41ec-ad0f-d3c0718eadd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/2fb0d343-48e2-4fe1-b13a-a041ee6b9cb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/51a4dd60-1558-4400-87c9-dd05dd25a41e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/8ffc46f0-9cad-4317-b660-35663d61c346_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/2b643824-5002-4de1-a744-057500eab661_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 03/20-17K, 06/24-18K', 'remarks': 'VOSA STATES - 17K, 18K, 18K, 18K, 18K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0e1d188a-4da2-4144-8538-ee78439809e1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117603221, 'registration': 'HV17SZJ', 'account': 'WBA002', 'make': 'CITROEN', 'model': 'C1 HATCHBACK', 'derivative': '1.0 VTi Feel 3dr', 'mileage': 18301, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1355, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-24', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/e96160ad-1a7b-4b07-8884-d1abb8d7a454_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/9a2226a6-057e-40b4-8ab1-f2e33d434d67_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/524f22d7-ef9a-4fdf-8237-e2b8734808c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/54f5c3fe-18f0-4fb8-8fd4-24e7a34ef62c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/6ef0e8ad-fd69-41ec-ad0f-d3c0718eadd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/2fb0d343-48e2-4fe1-b13a-a041ee6b9cb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/51a4dd60-1558-4400-87c9-dd05dd25a41e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/8ffc46f0-9cad-4317-b660-35663d61c346_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV17SZJ/2025-11-28/image/2b643824-5002-4de1-a744-057500eab661_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 03/20-17K, 06/24-18K', 'remarks': 'VOSA STATES - 17K, 18K, 18K, 18K, 18K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0e1d188a-4da2-4144-8538-ee78439809e1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0bc1ddc-4aa8-59fb-a483-f51ba40d796a with identifier: 117603221
2025-12-02 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0bc1ddc-4aa8-59fb-a483-f51ba40d796a with scrape type 2
2025-12-02 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0bc1ddc-4aa8-59fb-a483-f51ba40d796a with scrape type 2
2025-12-02 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f0bc1ddc-4aa8-59fb-a483-f51ba40d796a, identifier: 117603221
2025-12-02 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP69YFG/2025-12-01/image/aa7a08dd-bd7c-40f5-8772-fb7111786647_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue)
2025-12-02 19:01:10 [astonbarclay.gb] INFO: Found listing with ID: 117641132
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117641132%27 HTTP/1.1" 200 None
2025-12-02 19:01:10 [astonbarclay.gb] INFO: Scrape type for 117641132: 1
2025-12-02 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117616597?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f0bc1ddc-4aa8-59fb-a483-f51ba40d796a with identifier: 117603221
2025-12-02 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f0bc1ddc-4aa8-59fb-a483-f51ba40d796a with identifier: 117603221
2025-12-02 19:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f0bc1ddc-4aa8-59fb-a483-f51ba40d796a with identifier: 117603221 to the API
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117603221?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f0bc1ddc-4aa8-59fb-a483-f51ba40d796a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HV17SZJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117603221',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'CITROEN',
 'model': 'C1 HATCHBACK',
 'odometer': 18301,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': 'UKCGR - Premium',
 'title': 'CITROEN C1 HATCHBACK 1.0 VTi Feel 3dr',
 'transmission': 'manual',
 'trim': '1.0 VTi Feel 3dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117603221%27 HTTP/1.1" 200 None
2025-12-02 19:01:10 [astonbarclay.gb] INFO: Saving data for 117603221: {'auction_closing_time': 1764756000.0, 'created_time': 1764442911.232741, 'last_price_update_time': 1764702070.36268}
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117603221') HTTP/1.1" 204 0
2025-12-02 19:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0973650>
2025-12-02 19:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252Fe7607686-8b00-46e0-a44d-abf95ccd44f4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/e7607686-8b00-46e0-a44d-abf95ccd44f4_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aa25d0>
2025-12-02 19:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F83947f5e-e6cf-42e0-9105-7cb241d3b39e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/83947f5e-e6cf-42e0-9105-7cb241d3b39e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf502d3f-3084-5f78-b546-5e0d0e94ab79
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06e6950>
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Ff869c3e0-655f-4956-9f96-0cc788d57eec_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/f869c3e0-655f-4956-9f96-0cc788d57eec_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 947e4204-0720-5876-bad2-6dad899f30d7
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08145d0>
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F92c521cc-6197-471b-b442-9056f4096ef9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/92c521cc-6197-471b-b442-9056f4096ef9_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf099ab10>
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c5fd0>
2025-12-02 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252F6701d40e-48f2-4334-96fe-482f81e13cae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/6701d40e-48f2-4334-96fe-482f81e13cae_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4fe52d45-63a2-53ab-8319-e0b8532403ce
2025-12-02 19:01:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117498763, 'registration': 'MX19XLV', 'account': 'WBA002', 'make': 'FORD', 'model': 'KA+ HATCHBACK', 'derivative': '1.2 Zetec 5dr', 'mileage': 40317, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1368, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-11-20', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MX19XLV/2025-11-26/image/b02ed9e8-4841-4d9d-b8ac-b2c2a26d0dd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/6a88bf99-2d56-4153-8bfa-bc5f5c7b65b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/7bd785a6-4b9f-4908-9acc-2c29b4e7f56b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/4dbb1b24-9ab3-49ed-aa7f-985d2031b239_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/52548eb6-fb2c-42b7-8ddb-97b5078d713a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/eee41f0a-66f9-4190-b2f8-892c840cc955_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/66e8f4e3-d01e-44e1-94a1-3959ab5f745f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/1fa5fab2-6545-4ff3-959b-d434e2ab5ff4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/21- 7K, 05/22- 12K, 11/22- 14K, 09/23- 22K, 08/24- 29K', 'remarks': 'VOSA STATES 14K, 22K, 31K, 40K, SPARE KEY IN OFFICE, BOOK PACK IN OFFICE (PINK TICKET 489)', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2a976826-f629-4233-878a-1c35a9b5395e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117498763, 'registration': 'MX19XLV', 'account': 'WBA002', 'make': 'FORD', 'model': 'KA+ HATCHBACK', 'derivative': '1.2 Zetec 5dr', 'mileage': 40317, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1368, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-11-20', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MX19XLV/2025-11-26/image/b02ed9e8-4841-4d9d-b8ac-b2c2a26d0dd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/6a88bf99-2d56-4153-8bfa-bc5f5c7b65b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/7bd785a6-4b9f-4908-9acc-2c29b4e7f56b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/4dbb1b24-9ab3-49ed-aa7f-985d2031b239_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/52548eb6-fb2c-42b7-8ddb-97b5078d713a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/eee41f0a-66f9-4190-b2f8-892c840cc955_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/66e8f4e3-d01e-44e1-94a1-3959ab5f745f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX19XLV/2025-11-26/image/1fa5fab2-6545-4ff3-959b-d434e2ab5ff4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/21- 7K, 05/22- 12K, 11/22- 14K, 09/23- 22K, 08/24- 29K', 'remarks': 'VOSA STATES 14K, 22K, 31K, 40K, SPARE KEY IN OFFICE, BOOK PACK IN OFFICE (PINK TICKET 489)', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2a976826-f629-4233-878a-1c35a9b5395e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e7ae16-6425-56e3-a8be-8ff0aef28e4f with identifier: 117498763
2025-12-02 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e7ae16-6425-56e3-a8be-8ff0aef28e4f with scrape type 2
2025-12-02 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22e7ae16-6425-56e3-a8be-8ff0aef28e4f with scrape type 2
2025-12-02 19:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 22e7ae16-6425-56e3-a8be-8ff0aef28e4f, identifier: 117498763
2025-12-02 19:01:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117645160, 'registration': 'FL17KPN', 'account': 'WBA002', 'make': 'KIA', 'model': 'NIRO ESTATE', 'derivative': '1.6 GDi Hybrid 3 5dr DCT', 'mileage': 15898, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1383, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-04', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-07-04', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FL17KPN/2025-12-02/image/f2c067c8-06f9-4c78-8af4-371636b7c1d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/d0724b01-407f-472a-87ce-ad16c59997a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/9474a8b1-ded9-4e97-b769-a7fd427934d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/76616079-59fe-45d0-9797-bf0ee0e5e3cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/a54d3cf7-04ef-4a86-a752-43098b703503_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/cb57757c-d32f-4a16-ad33-e850eafa993e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/3b0b0df4-67c5-42a6-9ebc-da3c6a761621_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/50c0df84-70fe-4775-a7f7-8d5e2dfe0de9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/7d391b17-afc7-4da2-8108-b0cec42f547e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/0d55c81d-84d1-42d6-8cb6-64da9ba8da99_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/20-8k,  09/21-9k,  01/23-No Mileage,  01/24-13k,  02/24-15k', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES 10k, 12k, 13k, 15k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a2887bd-90b5-4484-8c23-11299543e2d7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117645160, 'registration': 'FL17KPN', 'account': 'WBA002', 'make': 'KIA', 'model': 'NIRO ESTATE', 'derivative': '1.6 GDi Hybrid 3 5dr DCT', 'mileage': 15898, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1383, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-04', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-07-04', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FL17KPN/2025-12-02/image/f2c067c8-06f9-4c78-8af4-371636b7c1d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/d0724b01-407f-472a-87ce-ad16c59997a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/9474a8b1-ded9-4e97-b769-a7fd427934d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/76616079-59fe-45d0-9797-bf0ee0e5e3cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/a54d3cf7-04ef-4a86-a752-43098b703503_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/cb57757c-d32f-4a16-ad33-e850eafa993e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/3b0b0df4-67c5-42a6-9ebc-da3c6a761621_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/50c0df84-70fe-4775-a7f7-8d5e2dfe0de9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/7d391b17-afc7-4da2-8108-b0cec42f547e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/0d55c81d-84d1-42d6-8cb6-64da9ba8da99_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/20-8k,  09/21-9k,  01/23-No Mileage,  01/24-13k,  02/24-15k', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES 10k, 12k, 13k, 15k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a2887bd-90b5-4484-8c23-11299543e2d7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9fd9a40-7f20-5541-9707-6e049ae8e7da with identifier: 117645160
2025-12-02 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9fd9a40-7f20-5541-9707-6e049ae8e7da with scrape type 1
2025-12-02 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9fd9a40-7f20-5541-9707-6e049ae8e7da
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252Ff2c067c8-06f9-4c78-8af4-371636b7c1d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/f2c067c8-06f9-4c78-8af4-371636b7c1d7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX69OMA/2025-12-02/image/d17fc5a2-0953-4c0c-aee7-60933a03b429_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634427?view=catalogue)
2025-12-02 19:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WA19OEF/2025-12-02/image/cd89afed-1985-48bf-89d7-833c0429d62b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643996?view=catalogue)
2025-12-02 19:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX69OMA/2025-12-02/image/51962326-1f02-460b-b0ca-2e0b0f73e672_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634427?view=catalogue)
2025-12-02 19:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK16VHA/2025-12-02/image/2e638dff-170f-4acc-a160-24f93fd48d2f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634478?view=catalogue)
2025-12-02 19:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP69YFG/2025-12-01/image/d7e5d628-1e1d-4f16-9e0b-6702d6f220ca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue)
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F00ad56d2-9141-4e15-85e3-0e9433238a7a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00ad56d2-9141-4e15-85e3-0e9433238a7a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F15a7d715-80e9-435e-a2cf-45367fe744ac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/15a7d715-80e9-435e-a2cf-45367fe744ac_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 22e7ae16-6425-56e3-a8be-8ff0aef28e4f with identifier: 117498763
2025-12-02 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 22e7ae16-6425-56e3-a8be-8ff0aef28e4f with identifier: 117498763
2025-12-02 19:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 22e7ae16-6425-56e3-a8be-8ff0aef28e4f with identifier: 117498763 to the API
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117498763?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '22e7ae16-6425-56e3-a8be-8ff0aef28e4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MX19XLV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117498763',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KA+ HATCHBACK',
 'odometer': 40317,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'UKCGR - Premium',
 'title': 'FORD KA+ HATCHBACK 1.2 Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.2 Zetec 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498763%27 HTTP/1.1" 200 None
2025-12-02 19:01:12 [astonbarclay.gb] INFO: Saving data for 117498763: {'auction_closing_time': 1764756000.0, 'created_time': 1764184335.905467, 'last_price_update_time': 1764702072.703927}
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117498763') HTTP/1.1" 204 0
2025-12-02 19:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03628d0>
2025-12-02 19:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252F58f39e7f-9914-4196-9253-2b99e603c9fd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/58f39e7f-9914-4196-9253-2b99e603c9fd_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0361d50>
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252F86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF69LTY/2025-12-02/image/29e5e650-0a5f-4881-b0e8-6b7a04b100f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue)
2025-12-02 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue)
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Found listing with ID: 117022539
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117022539%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Scrape type for 117022539: 0
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Found listing with ID: 117023522
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023522%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Scrape type for 117023522: 0
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Found listing with ID: 117023546
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023546%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Scrape type for 117023546: 0
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Found listing with ID: 117481203
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117481203%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Scrape type for 117481203: 0
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Found listing with ID: 117135963
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117135963%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Scrape type for 117135963: 0
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Found listing with ID: 117579570
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579570%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Scrape type for 117579570: 2
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252Fd0724b01-407f-472a-87ce-ad16c59997a8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/d0724b01-407f-472a-87ce-ad16c59997a8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD70MVG/2025-12-02/image/95fcc619-4c1a-4f66-a40f-1108cb5b2a3a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue)
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F00aa13e2-f14f-48f4-93d7-3d6c406b7e61_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00aa13e2-f14f-48f4-93d7-3d6c406b7e61_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252Fa6e3c591-1822-40cc-b969-4178d01d7122_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/a6e3c591-1822-40cc-b969-4178d01d7122_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117642583?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07fcb50>
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252Faa7a08dd-bd7c-40f5-8772-fb7111786647_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/aa7a08dd-bd7c-40f5-8772-fb7111786647_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117616597, 'registration': 'DN67XHW', 'account': 'WBA003', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 Acenta 5dr', 'mileage': 37363, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1389, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-12', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DN67XHW/2025-12-01/image/a60170fc-f4c5-428d-940d-f93188ddaab9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/d1cd060c-9dde-49f2-87af-05745aa4302e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/73e67bfe-7a9c-4d65-a0cf-560150290cb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/8cda68cc-24dc-40af-847c-c374fd354a2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/3919dbfa-1f15-40ef-b9ff-802e0bcb6771_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/a3818234-0fe9-4b87-8b09-4da66b92fab9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/aacc80ed-70eb-4a34-8f05-992e4c41529e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/c5c5e87c-b5c5-464a-b077-abce681c2e18_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/e08b036b-3710-47c8-bf55-bd005edcd9ad_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/10- 11K, 09/12- 13K, 09/19- 15K, 09/21- 23K', 'remarks': 'VOSA STATES 26K, 31K, 34K, 36K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/664ab624-cd60-4228-a359-57d858f0a92c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117616597, 'registration': 'DN67XHW', 'account': 'WBA003', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 Acenta 5dr', 'mileage': 37363, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1389, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-12', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DN67XHW/2025-12-01/image/a60170fc-f4c5-428d-940d-f93188ddaab9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/d1cd060c-9dde-49f2-87af-05745aa4302e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/73e67bfe-7a9c-4d65-a0cf-560150290cb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/8cda68cc-24dc-40af-847c-c374fd354a2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/3919dbfa-1f15-40ef-b9ff-802e0bcb6771_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/a3818234-0fe9-4b87-8b09-4da66b92fab9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/aacc80ed-70eb-4a34-8f05-992e4c41529e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/c5c5e87c-b5c5-464a-b077-abce681c2e18_removebg.jpg?w=600', 'https://abimg003.imgix.net/DN67XHW/2025-12-01/image/e08b036b-3710-47c8-bf55-bd005edcd9ad_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/10- 11K, 09/12- 13K, 09/19- 15K, 09/21- 23K', 'remarks': 'VOSA STATES 26K, 31K, 34K, 36K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/664ab624-cd60-4228-a359-57d858f0a92c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 862ac8c3-f6d8-5b1a-a251-49e04da48663 with identifier: 117616597
2025-12-02 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 862ac8c3-f6d8-5b1a-a251-49e04da48663 with scrape type 2
2025-12-02 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 862ac8c3-f6d8-5b1a-a251-49e04da48663 with scrape type 2
2025-12-02 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 862ac8c3-f6d8-5b1a-a251-49e04da48663, identifier: 117616597
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Found listing with ID: 117121221
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121221%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Scrape type for 117121221: 0
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Found listing with ID: 117663364
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117663364%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [astonbarclay.gb] INFO: Scrape type for 117663364: 1
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F9474a8b1-ded9-4e97-b769-a7fd427934d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/9474a8b1-ded9-4e97-b769-a7fd427934d8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 862ac8c3-f6d8-5b1a-a251-49e04da48663 with identifier: 117616597
2025-12-02 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 862ac8c3-f6d8-5b1a-a251-49e04da48663 with identifier: 117616597
2025-12-02 19:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 862ac8c3-f6d8-5b1a-a251-49e04da48663 with identifier: 117616597 to the API
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27862ac8c3-f6d8-5b1a-a251-49e04da48663%27 HTTP/1.1" 200 None
2025-12-02 19:01:14 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 862ac8c3-f6d8-5b1a-a251-49e04da48663: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:01:13 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117616597?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '862ac8c3-f6d8-5b1a-a251-49e04da48663',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DN67XHW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117616597',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'MICRA HATCHBACK',
 'odometer': 37363,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-31',
 'seller_name': 'UKCGR - Select',
 'title': 'NISSAN MICRA HATCHBACK 1.0 Acenta 5dr',
 'transmission': 'manual',
 'trim': '1.0 Acenta 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616597%27 HTTP/1.1" 200 None
2025-12-02 19:01:14 [astonbarclay.gb] INFO: Saving data for 117616597: {'created_time': 1764579730.830666, 'last_price_update_time': 1764702074.312338, 'auction_closing_time': 1764756000.0}
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117616597') HTTP/1.1" 204 0
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06dfe90>
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Fd17fc5a2-0953-4c0c-aee7-60933a03b429_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/d17fc5a2-0953-4c0c-aee7-60933a03b429_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 947e4204-0720-5876-bad2-6dad899f30d7
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0689350>
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252Fcd89afed-1985-48bf-89d7-833c0429d62b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/cd89afed-1985-48bf-89d7-833c0429d62b_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba725021-09cf-57e7-9aed-956ffee46fe6
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07a8d50>
2025-12-02 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252F51962326-1f02-460b-b0ca-2e0b0f73e672_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/51962326-1f02-460b-b0ca-2e0b0f73e672_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 947e4204-0720-5876-bad2-6dad899f30d7
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08ce7d0>
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F2e638dff-170f-4acc-a160-24f93fd48d2f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/2e638dff-170f-4acc-a160-24f93fd48d2f_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf502d3f-3084-5f78-b546-5e0d0e94ab79
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07800d0>
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252Fd7e5d628-1e1d-4f16-9e0b-6702d6f220ca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/d7e5d628-1e1d-4f16-9e0b-6702d6f220ca_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP69YFG/2025-12-01/image/729e2884-c49f-45bb-b938-a82471f9596e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue)
2025-12-02 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF69LTY/2025-12-02/image/d7816e03-49d0-4507-be86-3cb520c3a2ea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue)
2025-12-02 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WA19OEF/2025-12-02/image/02350ad5-4cbc-4224-a122-0d176485cc67_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643996?view=catalogue)
2025-12-02 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WA19OEF/2025-12-02/image/d6075723-ac24-45b1-bbb0-92e63cf7b04d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643996?view=catalogue)
2025-12-02 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP69YFG/2025-12-01/image/fc85f602-0e9a-4311-9f3e-ad417516254a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue)
2025-12-02 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK16VHA/2025-12-02/image/e6b915f7-c1c6-489e-b833-fe7f408acf6b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634478?view=catalogue)
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252Fdf7075d9-cfb9-4475-b35b-89ace0c8bedd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/df7075d9-cfb9-4475-b35b-89ace0c8bedd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F7a559993-feb2-404e-a71a-3ec4425fd5b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/7a559993-feb2-404e-a71a-3ec4425fd5b5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06af510>
2025-12-02 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252F29e5e650-0a5f-4881-b0e8-6b7a04b100f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/29e5e650-0a5f-4881-b0e8-6b7a04b100f5_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4fe52d45-63a2-53ab-8319-e0b8532403ce
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aa0690>
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252Fc2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL17KPN/2025-12-02/image/f2c067c8-06f9-4c78-8af4-371636b7c1d7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117645160?view=catalogue)
2025-12-02 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 117662891
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662891%27 HTTP/1.1" 200 None
2025-12-02 19:01:16 [astonbarclay.gb] INFO: Scrape type for 117662891: 1
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F76616079-59fe-45d0-9797-bf0ee0e5e3cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/76616079-59fe-45d0-9797-bf0ee0e5e3cf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117643292, 'registration': 'CX19KFZ', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 HSE Dynamic 5dr Auto', 'mileage': 77911, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1390, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-07-16', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/509da8eb-e92d-4b68-869d-a431ed1dc35f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/6016ece5-6d6c-4401-b62e-f90bfa35405f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/a1aab6a2-08c1-4c0b-8052-e7a16c6749d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/0c58c09a-7dc8-4485-bbf1-a40e20c14209_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/de7affdb-fdea-4875-b773-400807de5351_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/498b946f-dddd-4b9d-826c-2079277a0f5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/59497552-ffb6-4a90-b05c-089f399cbefd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/9403cec6-456e-4912-bea9-e8d744e8d9f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/7d1ed69c-7ccd-4fe3-9224-f71cae19918a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/2fc081c2-f9cd-4e23-bd71-3851e4406f12_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/8f635196-23e7-4804-8ee6-6d291cfbc345_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/20- 14K, 09/24- 60K', 'remarks': 'VOSA STATES 30K, 45K, 57K, 71K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2a83f3c6-b738-4add-ae99-77f451cbabd2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117643292, 'registration': 'CX19KFZ', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 HSE Dynamic 5dr Auto', 'mileage': 77911, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1390, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-07-16', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/509da8eb-e92d-4b68-869d-a431ed1dc35f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/6016ece5-6d6c-4401-b62e-f90bfa35405f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/a1aab6a2-08c1-4c0b-8052-e7a16c6749d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/0c58c09a-7dc8-4485-bbf1-a40e20c14209_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/de7affdb-fdea-4875-b773-400807de5351_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/498b946f-dddd-4b9d-826c-2079277a0f5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/59497552-ffb6-4a90-b05c-089f399cbefd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/9403cec6-456e-4912-bea9-e8d744e8d9f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/7d1ed69c-7ccd-4fe3-9224-f71cae19918a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/2fc081c2-f9cd-4e23-bd71-3851e4406f12_removebg.jpg?w=600', 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/8f635196-23e7-4804-8ee6-6d291cfbc345_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/20- 14K, 09/24- 60K', 'remarks': 'VOSA STATES 30K, 45K, 57K, 71K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2a83f3c6-b738-4add-ae99-77f451cbabd2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6d669f-3c5d-5b4d-88a6-7e28667084cd with identifier: 117643292
2025-12-02 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd with scrape type 1
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F509da8eb-e92d-4b68-869d-a431ed1dc35f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/509da8eb-e92d-4b68-869d-a431ed1dc35f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090d690>
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252F95fcc619-4c1a-4f66-a40f-1108cb5b2a3a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/95fcc619-4c1a-4f66-a40f-1108cb5b2a3a_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:01:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117642583, 'registration': 'EF66YDO', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 HSE Dynamic 5dr Auto', 'mileage': 56528, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1396, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-12-23', 'fuel': 'Diesel', 'motExpiry': '2025-12-08', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF66YDO/2025-12-02/image/a97e932b-2c6b-4687-9883-aaf9a24a0b77_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/38fcfcb0-5ba9-43ec-b8c5-e27c42df719e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/fe88614c-d9ef-44d9-90fb-845bff623ee0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/0877d3ad-36f1-450d-9f9c-0cdbdbbdd59e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/31a6b343-f334-461b-a6d9-06e385e5e97e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/d7e2af2d-785a-4a73-a287-9ced8ed4eefb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/6bae8ace-04cf-4379-91fc-29d6465fe85c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/79a2d3fe-03d4-40a0-be33-0b1f732606ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/4edd28df-7613-417d-a4cd-0bf8858f8c97_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/8f0bcd69-60ab-464f-b50f-de3897b191ff_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/22-36k,  12/16-42k', 'remarks': 'SPARE KEY - VOSA STATES 28k, 36k, 42k, 49k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/910b3695-1351-4768-bd85-8b9a2c7019c1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117642583, 'registration': 'EF66YDO', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 HSE Dynamic 5dr Auto', 'mileage': 56528, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1396, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-12-23', 'fuel': 'Diesel', 'motExpiry': '2025-12-08', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF66YDO/2025-12-02/image/a97e932b-2c6b-4687-9883-aaf9a24a0b77_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/38fcfcb0-5ba9-43ec-b8c5-e27c42df719e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/fe88614c-d9ef-44d9-90fb-845bff623ee0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/0877d3ad-36f1-450d-9f9c-0cdbdbbdd59e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/31a6b343-f334-461b-a6d9-06e385e5e97e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/d7e2af2d-785a-4a73-a287-9ced8ed4eefb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/6bae8ace-04cf-4379-91fc-29d6465fe85c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/79a2d3fe-03d4-40a0-be33-0b1f732606ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/4edd28df-7613-417d-a4cd-0bf8858f8c97_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/8f0bcd69-60ab-464f-b50f-de3897b191ff_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/22-36k,  12/16-42k', 'remarks': 'SPARE KEY - VOSA STATES 28k, 36k, 42k, 49k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/910b3695-1351-4768-bd85-8b9a2c7019c1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45b45be2-c558-5d93-9a39-071396d590cd with identifier: 117642583
2025-12-02 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45b45be2-c558-5d93-9a39-071396d590cd with scrape type 1
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45b45be2-c558-5d93-9a39-071396d590cd
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252Fa97e932b-2c6b-4687-9883-aaf9a24a0b77_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/a97e932b-2c6b-4687-9883-aaf9a24a0b77_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WA19OEF/2025-12-02/image/15a7d715-80e9-435e-a2cf-45367fe744ac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643996?view=catalogue)
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F9144efbc-77c4-4b5c-a1ae-b7ff87a04bec_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/9144efbc-77c4-4b5c-a1ae-b7ff87a04bec_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F643b15f2-0020-4f0c-994b-124ff3a8854b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/643b15f2-0020-4f0c-994b-124ff3a8854b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117642729?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00ad56d2-9141-4e15-85e3-0e9433238a7a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue)
2025-12-02 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL17KPN/2025-12-02/image/d0724b01-407f-472a-87ce-ad16c59997a8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117645160?view=catalogue)
2025-12-02 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 117662789
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662789%27 HTTP/1.1" 200 None
2025-12-02 19:01:16 [astonbarclay.gb] INFO: Scrape type for 117662789: 1
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252Fa54d3cf7-04ef-4a86-a752-43098b703503_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/a54d3cf7-04ef-4a86-a752-43098b703503_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F6016ece5-6d6c-4401-b62e-f90bfa35405f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/6016ece5-6d6c-4401-b62e-f90bfa35405f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F38fcfcb0-5ba9-43ec-b8c5-e27c42df719e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/38fcfcb0-5ba9-43ec-b8c5-e27c42df719e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf065fa50>
2025-12-02 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F729e2884-c49f-45bb-b938-a82471f9596e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/729e2884-c49f-45bb-b938-a82471f9596e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf046a650>
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252Fd7816e03-49d0-4507-be86-3cb520c3a2ea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/d7816e03-49d0-4507-be86-3cb520c3a2ea_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4fe52d45-63a2-53ab-8319-e0b8532403ce
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf074ab10>
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F02350ad5-4cbc-4224-a122-0d176485cc67_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/02350ad5-4cbc-4224-a122-0d176485cc67_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ba725021-09cf-57e7-9aed-956ffee46fe6
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06904d0>
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252Fd6075723-ac24-45b1-bbb0-92e63cf7b04d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/d6075723-ac24-45b1-bbb0-92e63cf7b04d_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ba725021-09cf-57e7-9aed-956ffee46fe6
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07483d0>
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252Ffc85f602-0e9a-4311-9f3e-ad417516254a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/fc85f602-0e9a-4311-9f3e-ad417516254a_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf033fc10>
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252Fe6b915f7-c1c6-489e-b833-fe7f408acf6b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/e6b915f7-c1c6-489e-b833-fe7f408acf6b_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf502d3f-3084-5f78-b546-5e0d0e94ab79
2025-12-02 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00aa13e2-f14f-48f4-93d7-3d6c406b7e61_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue)
2025-12-02 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX69OMA/2025-12-02/image/ab165de7-34ca-424c-be46-3d530345a0c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634427?view=catalogue)
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F5bab4905-9a81-4130-9734-207c893b7f40_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/5bab4905-9a81-4130-9734-207c893b7f40_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0783490>
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252Ff2c067c8-06f9-4c78-8af4-371636b7c1d7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/f2c067c8-06f9-4c78-8af4-371636b7c1d7_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9fd9a40-7f20-5541-9707-6e049ae8e7da
2025-12-02 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WA19OEF/2025-12-02/image/a6e3c591-1822-40cc-b969-4178d01d7122_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643996?view=catalogue)
2025-12-02 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD70MVG/2025-12-02/image/c3c852dc-35a4-491b-8c87-be61d14fe8fe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue)
2025-12-02 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL17KPN/2025-12-02/image/9474a8b1-ded9-4e97-b769-a7fd427934d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117645160?view=catalogue)
2025-12-02 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19EOB/2025-12-02/image/f4187a4f-ffa5-477b-996f-26133ae180da_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue)
2025-12-02 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117498427
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498427%27 HTTP/1.1" 200 None
2025-12-02 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117498427: 0
2025-12-02 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117493107
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117493107%27 HTTP/1.1" 200 None
2025-12-02 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117493107: 0
2025-12-02 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117030784
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117030784%27 HTTP/1.1" 200 None
2025-12-02 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117030784: 2
2025-12-02 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252Fcb57757c-d32f-4a16-ad33-e850eafa993e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/cb57757c-d32f-4a16-ad33-e850eafa993e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252Fa1aab6a2-08c1-4c0b-8052-e7a16c6749d3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/a1aab6a2-08c1-4c0b-8052-e7a16c6749d3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252Ffe88614c-d9ef-44d9-90fb-845bff623ee0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/fe88614c-d9ef-44d9-90fb-845bff623ee0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WA19OEF/2025-12-02/image/7a559993-feb2-404e-a71a-3ec4425fd5b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643996?view=catalogue)
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252Fbef26e51-a6a7-41fc-9598-2205664c081c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/bef26e51-a6a7-41fc-9598-2205664c081c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d7bc10>
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F15a7d715-80e9-435e-a2cf-45367fe744ac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/15a7d715-80e9-435e-a2cf-45367fe744ac_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ba725021-09cf-57e7-9aed-956ffee46fe6
2025-12-02 19:01:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117516097, 'registration': 'DA17JVP', 'account': 'WBA004', 'make': 'AUDI', 'model': 'Q3 ESTATE SPECIAL EDITIONS', 'derivative': '2.0 TDI [184] Quattro Black Edition 5dr S Tronic', 'mileage': 69777, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1397, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-05-30', 'fuel': 'Diesel', 'motExpiry': '2025-11-28', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DA17JVP/2025-11-26/image/3c178bc2-8dc9-4fd0-9c06-50c2c7f51772_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/90396b07-446f-45e4-abfb-bf2e19115bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/efc83eb9-b0d8-44df-ba6a-a2a4f6e7ce57_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/113d529b-5438-4bcd-aab5-3a1374961536_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2c819e7e-dacc-409f-8c51-aca980a67758_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/6f3e9c4c-add3-41be-94f1-28d2fac80c6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/040b6195-d655-4f28-91d8-15719663b4fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/718bcf6f-28d6-4099-bc6a-2b0d80b9b44b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2b15990d-2535-4bf4-89d1-94d98d87dea5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/19- 18K, 06/20- 28K, 03/21- 33K, 04/23- 45K, 01/25- 63K', 'remarks': 'MILEAGE DISCREPANCY VOSA STATES 05/20- UNKNOWN MILEAGE - 28K - 31K - 37,582 MILES (PASS) - 46,628 MILES (FAIL) - 43,316 MILES (PASS) - 51K - 62K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1b6806e3-161a-4d8a-9a15-2a5b41f6950a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117516097, 'registration': 'DA17JVP', 'account': 'WBA004', 'make': 'AUDI', 'model': 'Q3 ESTATE SPECIAL EDITIONS', 'derivative': '2.0 TDI [184] Quattro Black Edition 5dr S Tronic', 'mileage': 69777, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1397, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-05-30', 'fuel': 'Diesel', 'motExpiry': '2025-11-28', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DA17JVP/2025-11-26/image/3c178bc2-8dc9-4fd0-9c06-50c2c7f51772_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/90396b07-446f-45e4-abfb-bf2e19115bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/efc83eb9-b0d8-44df-ba6a-a2a4f6e7ce57_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/113d529b-5438-4bcd-aab5-3a1374961536_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2c819e7e-dacc-409f-8c51-aca980a67758_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/6f3e9c4c-add3-41be-94f1-28d2fac80c6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/040b6195-d655-4f28-91d8-15719663b4fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/718bcf6f-28d6-4099-bc6a-2b0d80b9b44b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2b15990d-2535-4bf4-89d1-94d98d87dea5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/19- 18K, 06/20- 28K, 03/21- 33K, 04/23- 45K, 01/25- 63K', 'remarks': 'MILEAGE DISCREPANCY VOSA STATES 05/20- UNKNOWN MILEAGE - 28K - 31K - 37,582 MILES (PASS) - 46,628 MILES (FAIL) - 43,316 MILES (PASS) - 51K - 62K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1b6806e3-161a-4d8a-9a15-2a5b41f6950a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b28762c-2bae-5102-9653-180e962825f3 with identifier: 117516097
2025-12-02 19:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b28762c-2bae-5102-9653-180e962825f3 with scrape type 2
2025-12-02 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b28762c-2bae-5102-9653-180e962825f3 with scrape type 2
2025-12-02 19:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7b28762c-2bae-5102-9653-180e962825f3, identifier: 117516097
2025-12-02 19:01:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117642729, 'registration': 'HN16MZV', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '0.9 TCE 90 Dynamique S Nav 5dr', 'mileage': 8231, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1360, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9111d2e2-980b-46c1-95a5-5228cc00836c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/be41a77d-b585-47ea-9a27-47f4073c1a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3635b566-2f38-487c-8c05-47aaf04c79c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9473d0ee-4e85-4f63-a9a7-bd30112caacd_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/32bfbbb0-a8df-4e62-b43c-196cba9998fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3cf4715d-58b2-4c84-99b5-85bc6c04fd83_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/98628d4b-d3d1-42ba-8b75-a8f070fe3335_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/4365e49e-8539-4417-a4e7-3a790f03be2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/b191f662-90c7-48bf-8092-462dfdd79258_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/52cfcde6-c75c-4ed9-b860-3f71e9b0c027_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/17- 4K, 04/18- 6K, 03/19- 7K, 03/21- 7K, 03/22- 7K, 03/23- 7K, 03/24- 7K, 03/25- 8K', 'remarks': 'VOSA STATES 7K, 7K, 7K, 8K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/569e6203-b409-467a-ad72-985e1f6fc6ce.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117642729, 'registration': 'HN16MZV', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '0.9 TCE 90 Dynamique S Nav 5dr', 'mileage': 8231, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1360, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9111d2e2-980b-46c1-95a5-5228cc00836c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/be41a77d-b585-47ea-9a27-47f4073c1a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3635b566-2f38-487c-8c05-47aaf04c79c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9473d0ee-4e85-4f63-a9a7-bd30112caacd_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/32bfbbb0-a8df-4e62-b43c-196cba9998fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3cf4715d-58b2-4c84-99b5-85bc6c04fd83_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/98628d4b-d3d1-42ba-8b75-a8f070fe3335_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/4365e49e-8539-4417-a4e7-3a790f03be2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/b191f662-90c7-48bf-8092-462dfdd79258_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/52cfcde6-c75c-4ed9-b860-3f71e9b0c027_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/17- 4K, 04/18- 6K, 03/19- 7K, 03/21- 7K, 03/22- 7K, 03/23- 7K, 03/24- 7K, 03/25- 8K', 'remarks': 'VOSA STATES 7K, 7K, 7K, 8K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/569e6203-b409-467a-ad72-985e1f6fc6ce.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f21697d1-bff0-598f-b98d-5127299e6dd9 with identifier: 117642729
2025-12-02 19:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f21697d1-bff0-598f-b98d-5127299e6dd9 with scrape type 1
2025-12-02 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f21697d1-bff0-598f-b98d-5127299e6dd9
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F9111d2e2-980b-46c1-95a5-5228cc00836c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9111d2e2-980b-46c1-95a5-5228cc00836c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf051e490>
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F00ad56d2-9141-4e15-85e3-0e9433238a7a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00ad56d2-9141-4e15-85e3-0e9433238a7a_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0763890>
2025-12-02 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252Fd0724b01-407f-472a-87ce-ad16c59997a8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/d0724b01-407f-472a-87ce-ad16c59997a8_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9fd9a40-7f20-5541-9707-6e049ae8e7da
2025-12-02 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/509da8eb-e92d-4b68-869d-a431ed1dc35f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue)
2025-12-02 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL17KPN/2025-12-02/image/76616079-59fe-45d0-9797-bf0ee0e5e3cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117645160?view=catalogue)
2025-12-02 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF66YDO/2025-12-02/image/a97e932b-2c6b-4687-9883-aaf9a24a0b77_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642583?view=catalogue)
2025-12-02 19:01:20 [astonbarclay.gb] INFO: Found listing with ID: 117498519
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498519%27 HTTP/1.1" 200 None
2025-12-02 19:01:20 [astonbarclay.gb] INFO: Scrape type for 117498519: 0
2025-12-02 19:01:20 [astonbarclay.gb] INFO: Found listing with ID: 116720970
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116720970%27 HTTP/1.1" 200 None
2025-12-02 19:01:20 [astonbarclay.gb] INFO: Scrape type for 116720970: 2
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F3b0b0df4-67c5-42a6-9ebc-da3c6a761621_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/3b0b0df4-67c5-42a6-9ebc-da3c6a761621_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F0c58c09a-7dc8-4485-bbf1-a40e20c14209_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/0c58c09a-7dc8-4485-bbf1-a40e20c14209_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F0877d3ad-36f1-450d-9f9c-0cdbdbbdd59e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/0877d3ad-36f1-450d-9f9c-0cdbdbbdd59e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7b28762c-2bae-5102-9653-180e962825f3 with identifier: 117516097
2025-12-02 19:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7b28762c-2bae-5102-9653-180e962825f3 with identifier: 117516097
2025-12-02 19:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7b28762c-2bae-5102-9653-180e962825f3 with identifier: 117516097 to the API
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7b28762c-2bae-5102-9653-180e962825f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DA17JVP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117516097',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q3 ESTATE SPECIAL EDITIONS',
 'odometer': 69777,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': 'UKCGR - Trade',
 'title': 'AUDI Q3 ESTATE SPECIAL EDITIONS 2.0 TDI [184] Quattro Black Edition '
          '5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI [184] Quattro Black Edition 5dr S Tronic',
 'vin': None,
 'year': 2017}
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117516097%27 HTTP/1.1" 200 None
2025-12-02 19:01:20 [astonbarclay.gb] INFO: Saving data for 117516097: {'auction_closing_time': 1764756000.0, 'created_time': 1764270172.470739, 'last_price_update_time': 1764702080.577171}
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117516097') HTTP/1.1" 204 0
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F65b8e1e3-d2cb-4434-8215-0291b45b7082_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/65b8e1e3-d2cb-4434-8215-0291b45b7082_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252Fbe41a77d-b585-47ea-9a27-47f4073c1a1c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/be41a77d-b585-47ea-9a27-47f4073c1a1c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117639808?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117579570?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117573652?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf060ce10>
2025-12-02 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F00aa13e2-f14f-48f4-93d7-3d6c406b7e61_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00aa13e2-f14f-48f4-93d7-3d6c406b7e61_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf031d910>
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252Fab165de7-34ca-424c-be46-3d530345a0c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/ab165de7-34ca-424c-be46-3d530345a0c2_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 947e4204-0720-5876-bad2-6dad899f30d7
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090b5d0>
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252Fa6e3c591-1822-40cc-b969-4178d01d7122_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/a6e3c591-1822-40cc-b969-4178d01d7122_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ba725021-09cf-57e7-9aed-956ffee46fe6
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05fd210>
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fc3c852dc-35a4-491b-8c87-be61d14fe8fe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/c3c852dc-35a4-491b-8c87-be61d14fe8fe_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0808250>
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F9474a8b1-ded9-4e97-b769-a7fd427934d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/9474a8b1-ded9-4e97-b769-a7fd427934d8_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9fd9a40-7f20-5541-9707-6e049ae8e7da
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05fe750>
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252Ff4187a4f-ffa5-477b-996f-26133ae180da_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/f4187a4f-ffa5-477b-996f-26133ae180da_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7
2025-12-02 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WA19OEF/2025-12-02/image/643b15f2-0020-4f0c-994b-124ff3a8854b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643996?view=catalogue)
2025-12-02 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP69YFG/2025-12-01/image/9144efbc-77c4-4b5c-a1ae-b7ff87a04bec_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue)
2025-12-02 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 116509919
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116509919%27 HTTP/1.1" 200 None
2025-12-02 19:01:22 [astonbarclay.gb] INFO: Scrape type for 116509919: 2
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F50c0df84-70fe-4775-a7f7-8d5e2dfe0de9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/50c0df84-70fe-4775-a7f7-8d5e2dfe0de9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252Fde7affdb-fdea-4875-b773-400807de5351_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/de7affdb-fdea-4875-b773-400807de5351_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F31a6b343-f334-461b-a6d9-06e385e5e97e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/31a6b343-f334-461b-a6d9-06e385e5e97e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03f8c50>
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F7a559993-feb2-404e-a71a-3ec4425fd5b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/7a559993-feb2-404e-a71a-3ec4425fd5b5_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ba725021-09cf-57e7-9aed-956ffee46fe6
2025-12-02 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WA19OEF/2025-12-02/image/5bab4905-9a81-4130-9734-207c893b7f40_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643996?view=catalogue)
2025-12-02 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/6016ece5-6d6c-4401-b62e-f90bfa35405f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue)
2025-12-02 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF66YDO/2025-12-02/image/38fcfcb0-5ba9-43ec-b8c5-e27c42df719e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642583?view=catalogue)
2025-12-02 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL17KPN/2025-12-02/image/a54d3cf7-04ef-4a86-a752-43098b703503_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117645160?view=catalogue)
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F3635b566-2f38-487c-8c05-47aaf04c79c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3635b566-2f38-487c-8c05-47aaf04c79c7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0312610>
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F509da8eb-e92d-4b68-869d-a431ed1dc35f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/509da8eb-e92d-4b68-869d-a431ed1dc35f_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b7210>
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F76616079-59fe-45d0-9797-bf0ee0e5e3cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/76616079-59fe-45d0-9797-bf0ee0e5e3cf_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9fd9a40-7f20-5541-9707-6e049ae8e7da
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf041eb10>
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252Fa97e932b-2c6b-4687-9883-aaf9a24a0b77_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/a97e932b-2c6b-4687-9883-aaf9a24a0b77_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45b45be2-c558-5d93-9a39-071396d590cd
2025-12-02 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/a1aab6a2-08c1-4c0b-8052-e7a16c6749d3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue)
2025-12-02 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF66YDO/2025-12-02/image/fe88614c-d9ef-44d9-90fb-845bff623ee0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642583?view=catalogue)
2025-12-02 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117073655
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117073655%27 HTTP/1.1" 200 None
2025-12-02 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117073655: 2
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F7d391b17-afc7-4da2-8108-b0cec42f547e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/7d391b17-afc7-4da2-8108-b0cec42f547e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F498b946f-dddd-4b9d-826c-2079277a0f5d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/498b946f-dddd-4b9d-826c-2079277a0f5d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252Fd7e2af2d-785a-4a73-a287-9ced8ed4eefb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/d7e2af2d-785a-4a73-a287-9ced8ed4eefb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117639808, 'registration': 'SG17EWY', 'account': 'WBA002', 'make': 'AUDI', 'model': 'A4 SALOON', 'derivative': '1.4T FSI Sport 4dr', 'mileage': 88952, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1401, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-01-31', 'doors': 4, 'engineSize': 1395, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/SG17EWY/2025-12-02/image/ba9f8290-6de8-44ce-ab53-ddddeb51c8ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/e3b5e61a-7431-4afd-af7d-213397d32805_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/723ab968-2d3f-45f0-9168-0a5495c2d280_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/51278498-0d86-4f93-8d0b-1cde3b7b57cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/60f7bafd-5edb-400d-8c2f-75fb7f163fdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/1abeef99-a9af-4ade-8ab1-27b4b4ae797e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/99781c7f-d14b-4c91-a284-f4031f5b8716_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/6c4f1892-50f9-416f-942f-f66f087c8d9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/05efa839-8afc-401f-a978-5a9ab1b2aa38_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/09cb1655-c285-475a-8fb1-ae01397322d5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/19-4k,  07/20-19k,  02/22-34k,  11/23-53k', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES 69k 55k 45k 34k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ac5656ab-7679-44f3-9b2e-ba1a5e4a3dd9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117639808, 'registration': 'SG17EWY', 'account': 'WBA002', 'make': 'AUDI', 'model': 'A4 SALOON', 'derivative': '1.4T FSI Sport 4dr', 'mileage': 88952, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1401, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-01-31', 'doors': 4, 'engineSize': 1395, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/SG17EWY/2025-12-02/image/ba9f8290-6de8-44ce-ab53-ddddeb51c8ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/e3b5e61a-7431-4afd-af7d-213397d32805_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/723ab968-2d3f-45f0-9168-0a5495c2d280_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/51278498-0d86-4f93-8d0b-1cde3b7b57cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/60f7bafd-5edb-400d-8c2f-75fb7f163fdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/1abeef99-a9af-4ade-8ab1-27b4b4ae797e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/99781c7f-d14b-4c91-a284-f4031f5b8716_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/6c4f1892-50f9-416f-942f-f66f087c8d9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/05efa839-8afc-401f-a978-5a9ab1b2aa38_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/09cb1655-c285-475a-8fb1-ae01397322d5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/19-4k,  07/20-19k,  02/22-34k,  11/23-53k', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES 69k 55k 45k 34k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ac5656ab-7679-44f3-9b2e-ba1a5e4a3dd9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 011c1c6f-5de6-51be-aa12-9540efc6211e with identifier: 117639808
2025-12-02 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 011c1c6f-5de6-51be-aa12-9540efc6211e with scrape type 1
2025-12-02 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 011c1c6f-5de6-51be-aa12-9540efc6211e
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252Fba9f8290-6de8-44ce-ab53-ddddeb51c8ec_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/ba9f8290-6de8-44ce-ab53-ddddeb51c8ec_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117579570, 'registration': 'GX17XEK', 'account': 'SMR001', 'make': 'TOYOTA', 'model': 'PROACE VERSO DIESEL ESTATE', 'derivative': '2.0D 180 Family Compact 5dr Auto', 'mileage': 295495, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2012, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-09', 'fuel': 'Diesel', 'motExpiry': '2026-09-15', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX17XEK/2025-12-02/image/43691b00-5f83-426e-9998-22d34f883e84_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/30f7b7b1-1170-4aad-8ddc-a6197f494aab_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/ea6c69da-8dec-4dbe-b941-b36511d95368_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/4adf1c1b-bc55-4f8d-b1af-ccb0b03de3ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/664e77c7-c7a9-49b8-a90c-8f4b1d0ffc3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/bd7f1ea7-97b3-484a-8069-60435cfef49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/8af5afec-ccd9-46ce-ba4c-51d34f4ad1b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/a53495b6-5c75-4929-94a2-0c7c91a8ec57_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/60ac7ee1-c37a-426e-af48-36b27284b6cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/bab64946-a3b3-43f4-bfba-b747827103d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/a148b5c9-c958-4b9e-8f46-b06541a9b844_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/01bfeb35-54c6-49ca-8a80-8bce93b1b558_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'Ex-Private Hire', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eb4ed159-5107-45b2-8bdb-e4d809af98d9.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117579570, 'registration': 'GX17XEK', 'account': 'SMR001', 'make': 'TOYOTA', 'model': 'PROACE VERSO DIESEL ESTATE', 'derivative': '2.0D 180 Family Compact 5dr Auto', 'mileage': 295495, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2012, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-09', 'fuel': 'Diesel', 'motExpiry': '2026-09-15', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX17XEK/2025-12-02/image/43691b00-5f83-426e-9998-22d34f883e84_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/30f7b7b1-1170-4aad-8ddc-a6197f494aab_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/ea6c69da-8dec-4dbe-b941-b36511d95368_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/4adf1c1b-bc55-4f8d-b1af-ccb0b03de3ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/664e77c7-c7a9-49b8-a90c-8f4b1d0ffc3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/bd7f1ea7-97b3-484a-8069-60435cfef49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/8af5afec-ccd9-46ce-ba4c-51d34f4ad1b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/a53495b6-5c75-4929-94a2-0c7c91a8ec57_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/60ac7ee1-c37a-426e-af48-36b27284b6cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/bab64946-a3b3-43f4-bfba-b747827103d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/a148b5c9-c958-4b9e-8f46-b06541a9b844_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX17XEK/2025-12-02/image/01bfeb35-54c6-49ca-8a80-8bce93b1b558_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'Ex-Private Hire', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eb4ed159-5107-45b2-8bdb-e4d809af98d9.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c008faa-c552-5f38-9785-deb0e5cd530c with identifier: 117579570
2025-12-02 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c008faa-c552-5f38-9785-deb0e5cd530c with scrape type 2
2025-12-02 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c008faa-c552-5f38-9785-deb0e5cd530c with scrape type 2
2025-12-02 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9c008faa-c552-5f38-9785-deb0e5cd530c, identifier: 117579570
2025-12-02 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117573652, 'registration': 'BA19AOU', 'account': 'WBA002', 'make': 'AUDI', 'model': 'E-TRON ESTATE SPECIAL EDITIONS', 'derivative': '300kW 55 Quattro 95kWh Launch Edition 5dr Auto', 'mileage': 51938, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1339, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-06-20', 'fuel': 'Electric', 'motExpiry': '2026-03-10', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BA19AOU/2025-11-28/image/fad57a83-c427-4fc8-bf3d-cca5ba0b1588_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/7ade45d7-f3ac-4be1-bfb5-9e4a588a70c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/b7f98cab-0e46-4e21-9b05-ead3ba77f22c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/13b5c1b1-7f62-48f4-89b4-1edf50bf645c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/3ff5f485-1609-4758-ba71-f6ed485f6a97_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/b1884792-f06b-46ac-baf6-bfb8b9d1de53_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/0949e265-af4d-4a88-9343-ff2482988674_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/1f2025d5-2ff9-43a2-b935-e8bfd6fea011_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/542f8e40-22b8-4fb6-a97e-85a4822ccdb5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/21- 19K, 08/22- 38K, 02/23- 38K', 'remarks': 'VOSA STATES 36K, 42K, 50K, 51K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/449dbb4e-f368-448a-8c47-5d799af39867.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117573652, 'registration': 'BA19AOU', 'account': 'WBA002', 'make': 'AUDI', 'model': 'E-TRON ESTATE SPECIAL EDITIONS', 'derivative': '300kW 55 Quattro 95kWh Launch Edition 5dr Auto', 'mileage': 51938, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1339, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-06-20', 'fuel': 'Electric', 'motExpiry': '2026-03-10', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BA19AOU/2025-11-28/image/fad57a83-c427-4fc8-bf3d-cca5ba0b1588_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/7ade45d7-f3ac-4be1-bfb5-9e4a588a70c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/b7f98cab-0e46-4e21-9b05-ead3ba77f22c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/13b5c1b1-7f62-48f4-89b4-1edf50bf645c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/3ff5f485-1609-4758-ba71-f6ed485f6a97_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/b1884792-f06b-46ac-baf6-bfb8b9d1de53_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/0949e265-af4d-4a88-9343-ff2482988674_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/1f2025d5-2ff9-43a2-b935-e8bfd6fea011_removebg.jpg?w=600', 'https://abimg003.imgix.net/BA19AOU/2025-11-28/image/542f8e40-22b8-4fb6-a97e-85a4822ccdb5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/21- 19K, 08/22- 38K, 02/23- 38K', 'remarks': 'VOSA STATES 36K, 42K, 50K, 51K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/449dbb4e-f368-448a-8c47-5d799af39867.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5efed2b-4dbd-5d24-95ce-752b7e005cb0 with identifier: 117573652
2025-12-02 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5efed2b-4dbd-5d24-95ce-752b7e005cb0 with scrape type 2
2025-12-02 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5efed2b-4dbd-5d24-95ce-752b7e005cb0 with scrape type 2
2025-12-02 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f5efed2b-4dbd-5d24-95ce-752b7e005cb0, identifier: 117573652
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F9473d0ee-4e85-4f63-a9a7-bd30112caacd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9473d0ee-4e85-4f63-a9a7-bd30112caacd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9c008faa-c552-5f38-9785-deb0e5cd530c with identifier: 117579570
2025-12-02 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9c008faa-c552-5f38-9785-deb0e5cd530c with identifier: 117579570
2025-12-02 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'auction plus', 'price_includes_vat': False, 'title': 'toyota proace verso diesel estate 2.0d 180 family compact 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'toyota', 'model': 'proace verso diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 295495, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579570', 'expiration_date': '2025-12-03t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '2.0d 180 family compact 5dr auto', 'license_plate': 'gx17xek', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 151, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '9c008faa-c552-5f38-9785-deb0e5cd530c', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'toyota proace verso diesel estate', 'sanitized_make': 'toyota', 'odometer_in_km': 475551}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 151,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-03t10:00:00z',
     'fuel_type': 'diesel',
     'id': '9c008faa-c552-5f38-9785-deb0e5cd530c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gx17xek',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579570',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'toyota',
     'make_model': 'toyota proace verso diesel estate',
     'model': 'proace verso diesel estate',
     'odometer': 295495,
     'odometer_in_km': 475551,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-09',
     'sanitized_make': 'toyota',
     'seller_name': 'auction plus',
     'title': 'toyota proace verso diesel estate 2.0d 180 family compact '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '2.0d 180 family compact 5dr auto',
     'vin': None,
     'year': 2017}
2025-12-02 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 9c008faa-c552-5f38-9785-deb0e5cd530c spider: astonbarclay.gb
2025-12-02 19:01:24 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 9c008faa-c552-5f38-9785-deb0e5cd530c due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'auction plus', 'price_includes_vat': False, 'title': 'toyota proace verso diesel estate 2.0d 180 family compact 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'toyota', 'model': 'proace verso diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 295495, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579570', 'expiration_date': '2025-12-03t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '2.0d 180 family compact 5dr auto', 'license_plate': 'gx17xek', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 151, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '9c008faa-c552-5f38-9785-deb0e5cd530c', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'toyota proace verso diesel estate', 'sanitized_make': 'toyota', 'odometer_in_km': 475551}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 151,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-03t10:00:00z',
     'fuel_type': 'diesel',
     'id': '9c008faa-c552-5f38-9785-deb0e5cd530c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gx17xek',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579570',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'toyota',
     'make_model': 'toyota proace verso diesel estate',
     'model': 'proace verso diesel estate',
     'odometer': 295495,
     'odometer_in_km': 475551,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-09',
     'sanitized_make': 'toyota',
     'seller_name': 'auction plus',
     'title': 'toyota proace verso diesel estate 2.0d 180 family compact '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '2.0d 180 family compact 5dr auto',
     'vin': None,
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9c008faa-c552-5f38-9785-deb0e5cd530c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GX17XEK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579570',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'PROACE VERSO DIESEL ESTATE',
 'odometer': 295495,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-09',
 'seller_name': 'Auction Plus',
 'title': 'TOYOTA PROACE VERSO DIESEL ESTATE 2.0D 180 Family Compact 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0D 180 Family Compact 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579570%27 HTTP/1.1" 200 None
2025-12-02 19:01:24 [astonbarclay.gb] INFO: Saving data for 117579570: {'auction_closing_time': 1764756000.0, 'created_time': 1764615642.22077, 'last_price_update_time': 1764702084.599726}
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117579570') HTTP/1.1" 204 0
2025-12-02 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f5efed2b-4dbd-5d24-95ce-752b7e005cb0 with identifier: 117573652
2025-12-02 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f5efed2b-4dbd-5d24-95ce-752b7e005cb0 with identifier: 117573652
2025-12-02 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'ukcgr - premium', 'price_includes_vat': False, 'title': 'audi e-tron estate special editions 300kw 55 quattro 95kwh launch edition 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'e-tron estate special editions', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 51938, 'odometer_reading_unit': 'mi', 'registration_date': '2019-06-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573652', 'expiration_date': '2025-12-03t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '300kw 55 quattro 95kwh launch edition 5dr auto', 'license_plate': 'ba19aou', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'f5efed2b-4dbd-5d24-95ce-752b7e005cb0', 'current_year_diff': 6, 'age_in_months': 77, 'make_model': 'audi e-tron estate special editions', 'sanitized_make': 'audi', 'odometer_in_km': 83585} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 77,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t10:00:00z',
     'fuel_type': 'electric',
     'id': 'f5efed2b-4dbd-5d24-95ce-752b7e005cb0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ba19aou',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573652',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'audi',
     'make_model': 'audi e-tron estate special editions',
     'model': 'e-tron estate special editions',
     'odometer': 51938,
     'odometer_in_km': 83585,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-06-20',
     'sanitized_make': 'audi',
     'seller_name': 'ukcgr - premium',
     'title': 'audi e-tron estate special editions 300kw 55 quattro 95kwh '
              'launch edition 5dr auto',
     'transmission': 'automatic',
     'trim': '300kw 55 quattro 95kwh launch edition 5dr auto',
     'vin': None,
     'year': 2019}
2025-12-02 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: f5efed2b-4dbd-5d24-95ce-752b7e005cb0 spider: astonbarclay.gb
2025-12-02 19:01:24 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f5efed2b-4dbd-5d24-95ce-752b7e005cb0 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'ukcgr - premium', 'price_includes_vat': False, 'title': 'audi e-tron estate special editions 300kw 55 quattro 95kwh launch edition 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'e-tron estate special editions', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 51938, 'odometer_reading_unit': 'mi', 'registration_date': '2019-06-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573652', 'expiration_date': '2025-12-03t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '300kw 55 quattro 95kwh launch edition 5dr auto', 'license_plate': 'ba19aou', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'f5efed2b-4dbd-5d24-95ce-752b7e005cb0', 'current_year_diff': 6, 'age_in_months': 77, 'make_model': 'audi e-tron estate special editions', 'sanitized_make': 'audi', 'odometer_in_km': 83585} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 77,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t10:00:00z',
     'fuel_type': 'electric',
     'id': 'f5efed2b-4dbd-5d24-95ce-752b7e005cb0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ba19aou',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573652',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'audi',
     'make_model': 'audi e-tron estate special editions',
     'model': 'e-tron estate special editions',
     'odometer': 51938,
     'odometer_in_km': 83585,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-06-20',
     'sanitized_make': 'audi',
     'seller_name': 'ukcgr - premium',
     'title': 'audi e-tron estate special editions 300kw 55 quattro 95kwh '
              'launch edition 5dr auto',
     'transmission': 'automatic',
     'trim': '300kw 55 quattro 95kwh launch edition 5dr auto',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'f5efed2b-4dbd-5d24-95ce-752b7e005cb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BA19AOU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573652',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'E-TRON ESTATE SPECIAL EDITIONS',
 'odometer': 51938,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-20',
 'seller_name': 'UKCGR - Premium',
 'title': 'AUDI E-TRON ESTATE SPECIAL EDITIONS 300kW 55 Quattro 95kWh Launch '
          'Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': '300kW 55 Quattro 95kWh Launch Edition 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573652%27 HTTP/1.1" 200 None
2025-12-02 19:01:24 [astonbarclay.gb] INFO: Saving data for 117573652: {'auction_closing_time': 1764756000.0, 'created_time': 1764356611.742606, 'last_price_update_time': 1764702084.816}
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117573652') HTTP/1.1" 204 0
2025-12-02 19:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09a8390>
2025-12-02 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F643b15f2-0020-4f0c-994b-124ff3a8854b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/643b15f2-0020-4f0c-994b-124ff3a8854b_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ba725021-09cf-57e7-9aed-956ffee46fe6
2025-12-02 19:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04f7510>
2025-12-02 19:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252F9144efbc-77c4-4b5c-a1ae-b7ff87a04bec_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/9144efbc-77c4-4b5c-a1ae-b7ff87a04bec_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117641132, 'registration': 'SD70OXT', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER DIESEL ESTATE', 'derivative': '4.4 SDV8 Autobiography 4dr Auto', 'mileage': 63264, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1402, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-10-09', 'doors': 4, 'engineSize': 4367, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1ea60069-9f41-4991-9504-74f1257d8ac0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/cc95cc21-2108-42c9-af25-a10f4d0f8e6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/87fb9a66-81b7-4628-b8ce-41dcd90398d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/e4f51e70-5438-4f3d-88ec-2dce532e82a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/a3f46290-d591-4caf-96cb-a4813d62ca82_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/930d963a-c711-4993-80c5-df08980518d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/8b866140-4891-44c8-85e8-23561ea93e02_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/2e30d9b6-704d-49c9-81c4-ab550b674b70_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1deae8a0-3de2-4285-9af5-2551b2659eb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/82317581-7de4-4f1a-94cb-00f7c1238f2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/d04b4ffe-12ad-4e10-90e3-e934a3d566aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/15d2ed92-d302-489a-8235-e8472384f14e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/22-23k,  04/25-59k', 'remarks': 'VOSA STATES 62k 54k 45k - GHOST IMMOBILISER', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 285, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cc7b0bb-bde6-40f6-a4b1-5263afb9e0f1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117641132, 'registration': 'SD70OXT', 'account': 'WBA002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER DIESEL ESTATE', 'derivative': '4.4 SDV8 Autobiography 4dr Auto', 'mileage': 63264, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1402, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-10-09', 'doors': 4, 'engineSize': 4367, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1ea60069-9f41-4991-9504-74f1257d8ac0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/cc95cc21-2108-42c9-af25-a10f4d0f8e6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/87fb9a66-81b7-4628-b8ce-41dcd90398d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/e4f51e70-5438-4f3d-88ec-2dce532e82a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/a3f46290-d591-4caf-96cb-a4813d62ca82_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/930d963a-c711-4993-80c5-df08980518d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/8b866140-4891-44c8-85e8-23561ea93e02_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/2e30d9b6-704d-49c9-81c4-ab550b674b70_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1deae8a0-3de2-4285-9af5-2551b2659eb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/82317581-7de4-4f1a-94cb-00f7c1238f2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/d04b4ffe-12ad-4e10-90e3-e934a3d566aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/15d2ed92-d302-489a-8235-e8472384f14e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/22-23k,  04/25-59k', 'remarks': 'VOSA STATES 62k 54k 45k - GHOST IMMOBILISER', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 285, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cc7b0bb-bde6-40f6-a4b1-5263afb9e0f1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7966583b-79ab-5144-863e-3d33d558cfb0 with identifier: 117641132
2025-12-02 19:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7966583b-79ab-5144-863e-3d33d558cfb0 with scrape type 1
2025-12-02 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F1ea60069-9f41-4991-9504-74f1257d8ac0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1ea60069-9f41-4991-9504-74f1257d8ac0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117540360, 'registration': 'GY19OPU', 'account': 'WBA003', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '2.0 P400e HSE 5dr Auto', 'mileage': 114606, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1399, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-13', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GY19OPU/2025-11-27/image/809672b8-93a3-4d52-9df5-1cd8cccee306_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/6288ffd8-16a6-481c-800d-9e6f4baba66b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/0bcf6000-a400-44d6-8dcb-e799404c2ca3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/b1e4adb8-7a64-499e-98fd-5a85a546992a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/73f0ef04-2721-41d3-8fb6-9e2f3fc0c962_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/15783f06-e821-430f-94cd-bdb04b21e609_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3a508488-bacb-46fd-b890-3ae23e01e40c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/4b59e7be-a3b7-4d63-9447-ba1137d5d103_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/883e2812-f1a6-495e-ba48-af12406fbb45_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3c6b7816-1686-43d2-b996-3af60ede79e3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/19- 15K, 07/20- 36K, 03/21- 54K, 12/21- 73K, 11/22- 92K, 08/25- 114K', 'remarks': 'VOSA STATES 76K, 97K, 113K, 114K, SPARE KEY IN OFFICE **ghost alarm fitted, instructions in office**', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 71, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4d3855f-5277-4ff4-bcac-45cebba6c827.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117540360, 'registration': 'GY19OPU', 'account': 'WBA003', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '2.0 P400e HSE 5dr Auto', 'mileage': 114606, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1399, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-13', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GY19OPU/2025-11-27/image/809672b8-93a3-4d52-9df5-1cd8cccee306_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/6288ffd8-16a6-481c-800d-9e6f4baba66b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/0bcf6000-a400-44d6-8dcb-e799404c2ca3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/b1e4adb8-7a64-499e-98fd-5a85a546992a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/73f0ef04-2721-41d3-8fb6-9e2f3fc0c962_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/15783f06-e821-430f-94cd-bdb04b21e609_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3a508488-bacb-46fd-b890-3ae23e01e40c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/4b59e7be-a3b7-4d63-9447-ba1137d5d103_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/883e2812-f1a6-495e-ba48-af12406fbb45_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3c6b7816-1686-43d2-b996-3af60ede79e3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/19- 15K, 07/20- 36K, 03/21- 54K, 12/21- 73K, 11/22- 92K, 08/25- 114K', 'remarks': 'VOSA STATES 76K, 97K, 113K, 114K, SPARE KEY IN OFFICE **ghost alarm fitted, instructions in office**', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 71, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4d3855f-5277-4ff4-bcac-45cebba6c827.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c8cd14-732d-55e9-9c1c-96083a2168e6 with identifier: 117540360
2025-12-02 19:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c8cd14-732d-55e9-9c1c-96083a2168e6 with scrape type 2
2025-12-02 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6c8cd14-732d-55e9-9c1c-96083a2168e6 with scrape type 2
2025-12-02 19:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f6c8cd14-732d-55e9-9c1c-96083a2168e6, identifier: 117540360
2025-12-02 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL17KPN/2025-12-02/image/3b0b0df4-67c5-42a6-9ebc-da3c6a761621_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117645160?view=catalogue)
2025-12-02 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9111d2e2-980b-46c1-95a5-5228cc00836c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642729?view=catalogue)
2025-12-02 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF66YDO/2025-12-02/image/0877d3ad-36f1-450d-9f9c-0cdbdbbdd59e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642583?view=catalogue)
2025-12-02 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/0c58c09a-7dc8-4485-bbf1-a40e20c14209_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue)
2025-12-02 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL17KPN/2025-12-02/image/cb57757c-d32f-4a16-ad33-e850eafa993e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117645160?view=catalogue)
2025-12-02 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117498468
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498468%27 HTTP/1.1" 200 None
2025-12-02 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117498468: 0
2025-12-02 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117455255
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117455255%27 HTTP/1.1" 200 None
2025-12-02 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117455255: 2
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F0d55c81d-84d1-42d6-8cb6-64da9ba8da99_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/0d55c81d-84d1-42d6-8cb6-64da9ba8da99_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F59497552-ffb6-4a90-b05c-089f399cbefd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/59497552-ffb6-4a90-b05c-089f399cbefd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F6bae8ace-04cf-4379-91fc-29d6465fe85c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/6bae8ace-04cf-4379-91fc-29d6465fe85c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252Fe3b5e61a-7431-4afd-af7d-213397d32805_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/e3b5e61a-7431-4afd-af7d-213397d32805_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662891?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f6c8cd14-732d-55e9-9c1c-96083a2168e6 with identifier: 117540360
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FPlugin+Electric+Hybrid HTTP/1.1" 200 None
2025-12-02 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f6c8cd14-732d-55e9-9c1c-96083a2168e6 with identifier: 117540360
2025-12-02 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184440 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184440
2025-12-02 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f6c8cd14-732d-55e9-9c1c-96083a2168e6 spider: astonbarclay.gb
2025-12-02 19:01:25 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f6c8cd14-732d-55e9-9c1c-96083a2168e6 due to rule: high_mileage_for_country.json, error: 184440 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184440
{'auction_title': '',
 'c_o_2_emission_value': 71,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'f6c8cd14-732d-55e9-9c1c-96083a2168e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GY19OPU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117540360',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT ESTATE',
 'odometer': 114606,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-13',
 'seller_name': 'UKCGR - Select',
 'title': 'LAND ROVER RANGE ROVER SPORT ESTATE 2.0 P400e HSE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 P400e HSE 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117540360%27 HTTP/1.1" 200 None
2025-12-02 19:01:26 [astonbarclay.gb] INFO: Saving data for 117540360: {'auction_closing_time': 1764756000.0, 'created_time': 1764270412.256573, 'last_price_update_time': 1764702086.000511}
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117540360') HTTP/1.1" 204 0
2025-12-02 19:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0641b90>
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F5bab4905-9a81-4130-9734-207c893b7f40_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/5bab4905-9a81-4130-9734-207c893b7f40_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ba725021-09cf-57e7-9aed-956ffee46fe6
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0588e10>
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F6016ece5-6d6c-4401-b62e-f90bfa35405f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/6016ece5-6d6c-4401-b62e-f90bfa35405f_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05853d0>
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F38fcfcb0-5ba9-43ec-b8c5-e27c42df719e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/38fcfcb0-5ba9-43ec-b8c5-e27c42df719e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45b45be2-c558-5d93-9a39-071396d590cd
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d96a90>
2025-12-02 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252Fa54d3cf7-04ef-4a86-a752-43098b703503_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/a54d3cf7-04ef-4a86-a752-43098b703503_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9fd9a40-7f20-5541-9707-6e049ae8e7da
2025-12-02 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WA19OEF/2025-12-02/image/65b8e1e3-d2cb-4434-8215-0291b45b7082_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643996?view=catalogue)
2025-12-02 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WA19OEF/2025-12-02/image/bef26e51-a6a7-41fc-9598-2205664c081c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643996?view=catalogue)
2025-12-02 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16MZV/2025-12-02/image/be41a77d-b585-47ea-9a27-47f4073c1a1c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642729?view=catalogue)
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F32bfbbb0-a8df-4e62-b43c-196cba9998fe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/32bfbbb0-a8df-4e62-b43c-196cba9998fe_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252Fcc95cc21-2108-42c9-af25-a10f4d0f8e6e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/cc95cc21-2108-42c9-af25-a10f4d0f8e6e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf068d710>
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252Fa1aab6a2-08c1-4c0b-8052-e7a16c6749d3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/a1aab6a2-08c1-4c0b-8052-e7a16c6749d3_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06bfc10>
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252Ffe88614c-d9ef-44d9-90fb-845bff623ee0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/fe88614c-d9ef-44d9-90fb-845bff623ee0_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45b45be2-c558-5d93-9a39-071396d590cd
2025-12-02 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 116321191
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116321191%27 HTTP/1.1" 200 None
2025-12-02 19:01:27 [astonbarclay.gb] INFO: Scrape type for 116321191: 2
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F9403cec6-456e-4912-bea9-e8d744e8d9f8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/9403cec6-456e-4912-bea9-e8d744e8d9f8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F79a2d3fe-03d4-40a0-be33-0b1f732606ac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/79a2d3fe-03d4-40a0-be33-0b1f732606ac_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F723ab968-2d3f-45f0-9168-0a5495c2d280_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/723ab968-2d3f-45f0-9168-0a5495c2d280_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP69YFG/2025-12-01/image/df7075d9-cfb9-4475-b35b-89ace0c8bedd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638971?view=catalogue)
2025-12-02 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/de7affdb-fdea-4875-b773-400807de5351_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue)
2025-12-02 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF66YDO/2025-12-02/image/31a6b343-f334-461b-a6d9-06e385e5e97e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642583?view=catalogue)
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F3cf4715d-58b2-4c84-99b5-85bc6c04fd83_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3cf4715d-58b2-4c84-99b5-85bc6c04fd83_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F87fb9a66-81b7-4628-b8ce-41dcd90398d5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/87fb9a66-81b7-4628-b8ce-41dcd90398d5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06ac350>
2025-12-02 19:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F3b0b0df4-67c5-42a6-9ebc-da3c6a761621_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/3b0b0df4-67c5-42a6-9ebc-da3c6a761621_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9fd9a40-7f20-5541-9707-6e049ae8e7da
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c6e310>
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F9111d2e2-980b-46c1-95a5-5228cc00836c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9111d2e2-980b-46c1-95a5-5228cc00836c_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f21697d1-bff0-598f-b98d-5127299e6dd9
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac6290>
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F0877d3ad-36f1-450d-9f9c-0cdbdbbdd59e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/0877d3ad-36f1-450d-9f9c-0cdbdbbdd59e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45b45be2-c558-5d93-9a39-071396d590cd
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0814b10>
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F0c58c09a-7dc8-4485-bbf1-a40e20c14209_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/0c58c09a-7dc8-4485-bbf1-a40e20c14209_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06aeb90>
2025-12-02 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252Fcb57757c-d32f-4a16-ad33-e850eafa993e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/cb57757c-d32f-4a16-ad33-e850eafa993e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9fd9a40-7f20-5541-9707-6e049ae8e7da
2025-12-02 19:01:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662891, 'registration': 'BT20JYN', 'account': 'CAR001', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL SALOON', 'derivative': 'C220d AMG Line Premium 4dr 9G-Tronic', 'mileage': 76133, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2107, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-07-15', 'fuel': 'Diesel', 'motExpiry': '2026-07-06', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/BT20JYN/2025-12-02/image/fedc26bc-be09-4bd4-8876-4c4b8f261e9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cc3d9d31-51c9-48d1-8115-be7c6780c6b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/66f3d280-bead-45b8-a6a7-ce4b8ee46772_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cab85c69-b27e-4b52-9be7-5628594964a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/b119be9e-81f1-4341-99be-4957357ec7a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/2d5f664c-3736-435c-a580-38d9faa12340_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/58cbf164-b039-406c-aa07-29eb7256dce6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/a4b32e81-18f7-4411-9f42-4b61d611ce8a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/22- 21K, 11/22- 40K, 04/25- 71K', 'remarks': 'VOSA STATES 62K, 71K, 71K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ef35758f-6c6a-4540-8f3c-6df25cb57b3a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662891, 'registration': 'BT20JYN', 'account': 'CAR001', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL SALOON', 'derivative': 'C220d AMG Line Premium 4dr 9G-Tronic', 'mileage': 76133, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2107, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-07-15', 'fuel': 'Diesel', 'motExpiry': '2026-07-06', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/BT20JYN/2025-12-02/image/fedc26bc-be09-4bd4-8876-4c4b8f261e9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cc3d9d31-51c9-48d1-8115-be7c6780c6b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/66f3d280-bead-45b8-a6a7-ce4b8ee46772_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cab85c69-b27e-4b52-9be7-5628594964a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/b119be9e-81f1-4341-99be-4957357ec7a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/2d5f664c-3736-435c-a580-38d9faa12340_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/58cbf164-b039-406c-aa07-29eb7256dce6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/a4b32e81-18f7-4411-9f42-4b61d611ce8a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/22- 21K, 11/22- 40K, 04/25- 71K', 'remarks': 'VOSA STATES 62K, 71K, 71K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ef35758f-6c6a-4540-8f3c-6df25cb57b3a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47a7f053-2c4c-546b-ba03-824626d28838 with identifier: 117662891
2025-12-02 19:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a7f053-2c4c-546b-ba03-824626d28838 with scrape type 1
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 47a7f053-2c4c-546b-ba03-824626d28838
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252Ffedc26bc-be09-4bd4-8876-4c4b8f261e9f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/fedc26bc-be09-4bd4-8876-4c4b8f261e9f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SG17EWY/2025-12-02/image/ba9f8290-6de8-44ce-ab53-ddddeb51c8ec_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639808?view=catalogue)
2025-12-02 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF66YDO/2025-12-02/image/d7e2af2d-785a-4a73-a287-9ced8ed4eefb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642583?view=catalogue)
2025-12-02 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/498b946f-dddd-4b9d-826c-2079277a0f5d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue)
2025-12-02 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL17KPN/2025-12-02/image/7d391b17-afc7-4da2-8108-b0cec42f547e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117645160?view=catalogue)
2025-12-02 19:01:29 [astonbarclay.gb] INFO: Found listing with ID: 117663808
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117663808%27 HTTP/1.1" 200 None
2025-12-02 19:01:29 [astonbarclay.gb] INFO: Scrape type for 117663808: 1
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F7d1ed69c-7ccd-4fe3-9224-f71cae19918a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/7d1ed69c-7ccd-4fe3-9224-f71cae19918a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F4edd28df-7613-417d-a4cd-0bf8858f8c97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/4edd28df-7613-417d-a4cd-0bf8858f8c97_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F51278498-0d86-4f93-8d0b-1cde3b7b57cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/51278498-0d86-4f93-8d0b-1cde3b7b57cd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06466d0>
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252F65b8e1e3-d2cb-4434-8215-0291b45b7082_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/65b8e1e3-d2cb-4434-8215-0291b45b7082_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ba725021-09cf-57e7-9aed-956ffee46fe6
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c89f10>
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWA19OEF%252F2025-12-02%252Fimage%252Fbef26e51-a6a7-41fc-9598-2205664c081c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WA19OEF/2025-12-02/image/bef26e51-a6a7-41fc-9598-2205664c081c_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ba725021-09cf-57e7-9aed-956ffee46fe6
2025-12-02 19:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba725021-09cf-57e7-9aed-956ffee46fe6, skipping ID generation
2025-12-02 19:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba725021-09cf-57e7-9aed-956ffee46fe6 with scrape type 1
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ba725021-09cf-57e7-9aed-956ffee46fe6 from tracking dictionaries
2025-12-02 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba725021-09cf-57e7-9aed-956ffee46fe6 sending to next pipeline
2025-12-02 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ba725021-09cf-57e7-9aed-956ffee46fe6, identifier: 117643996
2025-12-02 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04b0ed0>
2025-12-02 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252Fbe41a77d-b585-47ea-9a27-47f4073c1a1c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/be41a77d-b585-47ea-9a27-47f4073c1a1c_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f21697d1-bff0-598f-b98d-5127299e6dd9
2025-12-02 19:01:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662789, 'registration': 'VK18HKV', 'account': 'CAR001', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d SE Business 5dr [Nav/Servotronic]', 'mileage': 95024, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2110, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-18', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK18HKV/2025-12-02/image/abc41b92-b014-4717-8dea-b02793df9c2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/17c20128-4619-465f-8a52-f33b39277578_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/30b3c443-9c0b-4174-8f7c-24cc9091b753_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/99ac4343-0099-439f-ae2c-751268e38d0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1e2ed9ad-e92a-4cd2-bf43-cfd151892995_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/548f717c-a2ea-4b05-886e-bd57d50e7da7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1adb5a1e-d0cf-49aa-ac98-4f49d8f23139_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1ca35411-ba88-46d5-9fb5-8d6de66fbc3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/ce44da85-dc4b-40ea-8001-3626f9e02071_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/d9eaeff8-f4fa-4903-8de7-841427d7bf2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/af60633e-d94e-467f-a62f-e5337a858e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/79569779-0a7c-4cb3-999c-caa52afde85b_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 07/19- 17K, 03/21- 32K', 'remarks': 'OUTSTANDING RECALL VOSA STATES 41K, 53K, 72K, 90K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff5eb868-7ca2-41fa-91f7-d4f56b84af2a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662789, 'registration': 'VK18HKV', 'account': 'CAR001', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d SE Business 5dr [Nav/Servotronic]', 'mileage': 95024, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2110, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-18', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK18HKV/2025-12-02/image/abc41b92-b014-4717-8dea-b02793df9c2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/17c20128-4619-465f-8a52-f33b39277578_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/30b3c443-9c0b-4174-8f7c-24cc9091b753_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/99ac4343-0099-439f-ae2c-751268e38d0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1e2ed9ad-e92a-4cd2-bf43-cfd151892995_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/548f717c-a2ea-4b05-886e-bd57d50e7da7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1adb5a1e-d0cf-49aa-ac98-4f49d8f23139_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1ca35411-ba88-46d5-9fb5-8d6de66fbc3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/ce44da85-dc4b-40ea-8001-3626f9e02071_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/d9eaeff8-f4fa-4903-8de7-841427d7bf2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/af60633e-d94e-467f-a62f-e5337a858e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/79569779-0a7c-4cb3-999c-caa52afde85b_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 07/19- 17K, 03/21- 32K', 'remarks': 'OUTSTANDING RECALL VOSA STATES 41K, 53K, 72K, 90K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff5eb868-7ca2-41fa-91f7-d4f56b84af2a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad2289b-de47-5f0c-a95e-00230942d029 with identifier: 117662789
2025-12-02 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad2289b-de47-5f0c-a95e-00230942d029 with scrape type 1
2025-12-02 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252Fabc41b92-b014-4717-8dea-b02793df9c2e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/abc41b92-b014-4717-8dea-b02793df9c2e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1ea60069-9f41-4991-9504-74f1257d8ac0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F98628d4b-d3d1-42ba-8b75-a8f070fe3335_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/98628d4b-d3d1-42ba-8b75-a8f070fe3335_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252Fe4f51e70-5438-4f3d-88ec-2dce532e82a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/e4f51e70-5438-4f3d-88ec-2dce532e82a9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252Fcc3d9d31-51c9-48d1-8115-be7c6780c6b7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cc3d9d31-51c9-48d1-8115-be7c6780c6b7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ba725021-09cf-57e7-9aed-956ffee46fe6 with identifier: 117643996
2025-12-02 19:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ba725021-09cf-57e7-9aed-956ffee46fe6 with identifier: 117643996
2025-12-02 19:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ba725021-09cf-57e7-9aed-956ffee46fe6 with identifier: 117643996 to the API
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/WA19OEF/2025-12-02/image/bef26e51-a6a7-41fc-9598-2205664c081c_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ba725021-09cf-57e7-9aed-956ffee46fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WA19OEF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117643996',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'KADJAR HATCHBACK',
 'odometer': 58171,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33126,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/cd89afed-1985-48bf-89d7-833c0429d62b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30060,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/02350ad5-4cbc-4224-a122-0d176485cc67_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26987,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/d6075723-ac24-45b1-bbb0-92e63cf7b04d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24334,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/15a7d715-80e9-435e-a2cf-45367fe744ac_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39680,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/a6e3c591-1822-40cc-b969-4178d01d7122_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40196,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/7a559993-feb2-404e-a71a-3ec4425fd5b5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42564,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/643b15f2-0020-4f0c-994b-124ff3a8854b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44355,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/5bab4905-9a81-4130-9734-207c893b7f40_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41715,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/bef26e51-a6a7-41fc-9598-2205664c081c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba725021-09cf-57e7-9aed-956ffee46fe6/ba725021-09cf-57e7-9aed-956ffee46fe6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53703,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WA19OEF/2025-12-02/image/65b8e1e3-d2cb-4434-8215-0291b45b7082_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-20',
 'seller_name': 'UKCGR - Premium',
 'title': 'RENAULT KADJAR HATCHBACK 1.3 TCE Dynamique S Nav 5dr',
 'transmission': 'manual',
 'trim': '1.3 TCE Dynamique S Nav 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117643996%27 HTTP/1.1" 200 None
2025-12-02 19:01:30 [astonbarclay.gb] INFO: Saving data for 117643996: {'created_time': 1764702090.798114, 'last_price_update_time': 1764702090.798125, 'auction_closing_time': 1764756000.0}
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117643996') HTTP/1.1" 204 0
2025-12-02 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9473d0ee-4e85-4f63-a9a7-bd30112caacd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642729?view=catalogue)
2025-12-02 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL17KPN/2025-12-02/image/50c0df84-70fe-4775-a7f7-8d5e2dfe0de9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117645160?view=catalogue)
2025-12-02 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3635b566-2f38-487c-8c05-47aaf04c79c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642729?view=catalogue)
2025-12-02 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117406735
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406735%27 HTTP/1.1" 200 None
2025-12-02 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117406735: 2
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F2fc081c2-f9cd-4e23-bd71-3851e4406f12_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/2fc081c2-f9cd-4e23-bd71-3851e4406f12_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F8f0bcd69-60ab-464f-b50f-de3897b191ff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/8f0bcd69-60ab-464f-b50f-de3897b191ff_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F60f7bafd-5edb-400d-8c2f-75fb7f163fdd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/60f7bafd-5edb-400d-8c2f-75fb7f163fdd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F17c20128-4619-465f-8a52-f33b39277578_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/17c20128-4619-465f-8a52-f33b39277578_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117030784?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116720970?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02e6ed0>
2025-12-02 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP69YFG%252F2025-12-01%252Fimage%252Fdf7075d9-cfb9-4475-b35b-89ace0c8bedd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP69YFG/2025-12-01/image/df7075d9-cfb9-4475-b35b-89ace0c8bedd_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6
2025-12-02 19:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84ce3049-ca46-5717-9e57-9f448ec2e2c6, skipping ID generation
2025-12-02 19:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6 with scrape type 1
2025-12-02 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 84ce3049-ca46-5717-9e57-9f448ec2e2c6 from tracking dictionaries
2025-12-02 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84ce3049-ca46-5717-9e57-9f448ec2e2c6 sending to next pipeline
2025-12-02 19:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 84ce3049-ca46-5717-9e57-9f448ec2e2c6, identifier: 117638971
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a9fad0>
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252Fde7affdb-fdea-4875-b773-400807de5351_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/de7affdb-fdea-4875-b773-400807de5351_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06404d0>
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F31a6b343-f334-461b-a6d9-06e385e5e97e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/31a6b343-f334-461b-a6d9-06e385e5e97e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45b45be2-c558-5d93-9a39-071396d590cd
2025-12-02 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SG17EWY/2025-12-02/image/e3b5e61a-7431-4afd-af7d-213397d32805_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639808?view=catalogue)
2025-12-02 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/cc95cc21-2108-42c9-af25-a10f4d0f8e6e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16MZV/2025-12-02/image/32bfbbb0-a8df-4e62-b43c-196cba9998fe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642729?view=catalogue)
2025-12-02 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF66YDO/2025-12-02/image/6bae8ace-04cf-4379-91fc-29d6465fe85c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642583?view=catalogue)
2025-12-02 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F4365e49e-8539-4417-a4e7-3a790f03be2e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/4365e49e-8539-4417-a4e7-3a790f03be2e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252Fa3f46290-d591-4caf-96cb-a4813d62ca82_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/a3f46290-d591-4caf-96cb-a4813d62ca82_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252F66f3d280-bead-45b8-a6a7-ce4b8ee46772_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/66f3d280-bead-45b8-a6a7-ce4b8ee46772_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 84ce3049-ca46-5717-9e57-9f448ec2e2c6 with identifier: 117638971
2025-12-02 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 84ce3049-ca46-5717-9e57-9f448ec2e2c6 with identifier: 117638971
2025-12-02 19:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 84ce3049-ca46-5717-9e57-9f448ec2e2c6 with identifier: 117638971 to the API
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YP69YFG/2025-12-01/image/df7075d9-cfb9-4475-b35b-89ace0c8bedd_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '84ce3049-ca46-5717-9e57-9f448ec2e2c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YP69YFG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638971',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': 'X4 DIESEL ESTATE',
 'odometer': 29480,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27254,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/37e0a56a-26bd-4db0-aca3-3f0d74b6e858_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27776,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/e7607686-8b00-46e0-a44d-abf95ccd44f4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29843,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/92c521cc-6197-471b-b442-9056f4096ef9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28303,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/aa7a08dd-bd7c-40f5-8772-fb7111786647_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42829,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/d7e5d628-1e1d-4f16-9e0b-6702d6f220ca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44576,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/fc85f602-0e9a-4311-9f3e-ad417516254a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49949,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/729e2884-c49f-45bb-b938-a82471f9596e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41310,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00ad56d2-9141-4e15-85e3-0e9433238a7a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48494,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/00aa13e2-f14f-48f4-93d7-3d6c406b7e61_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39382,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/df7075d9-cfb9-4475-b35b-89ace0c8bedd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ce3049-ca46-5717-9e57-9f448ec2e2c6/84ce3049-ca46-5717-9e57-9f448ec2e2c6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46646,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP69YFG/2025-12-01/image/9144efbc-77c4-4b5c-a1ae-b7ff87a04bec_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seller_name': 'UKCGR - Premium',
 'title': 'BMW X4 DIESEL ESTATE xDrive20d M Sport 5dr Step Auto',
 'transmission': 'automatic',
 'trim': 'xDrive20d M Sport 5dr Step Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638971%27 HTTP/1.1" 200 None
2025-12-02 19:01:32 [astonbarclay.gb] INFO: Saving data for 117638971: {'created_time': 1764702092.403788, 'last_price_update_time': 1764702092.403798, 'auction_closing_time': 1764756000.0}
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117638971') HTTP/1.1" 204 0
2025-12-02 19:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0498b90>
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252Fba9f8290-6de8-44ce-ab53-ddddeb51c8ec_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/ba9f8290-6de8-44ce-ab53-ddddeb51c8ec_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 011c1c6f-5de6-51be-aa12-9540efc6211e
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04f9890>
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252Fd7e2af2d-785a-4a73-a287-9ced8ed4eefb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/d7e2af2d-785a-4a73-a287-9ced8ed4eefb_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45b45be2-c558-5d93-9a39-071396d590cd
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0498190>
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F498b946f-dddd-4b9d-826c-2079277a0f5d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/498b946f-dddd-4b9d-826c-2079277a0f5d_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b6850>
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F7d391b17-afc7-4da2-8108-b0cec42f547e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/7d391b17-afc7-4da2-8108-b0cec42f547e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9fd9a40-7f20-5541-9707-6e049ae8e7da
2025-12-02 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SG17EWY/2025-12-02/image/723ab968-2d3f-45f0-9168-0a5495c2d280_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639808?view=catalogue)
2025-12-02 19:01:33 [astonbarclay.gb] INFO: Found listing with ID: 117621114
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621114%27 HTTP/1.1" 200 None
2025-12-02 19:01:33 [astonbarclay.gb] INFO: Scrape type for 117621114: 0
2025-12-02 19:01:33 [astonbarclay.gb] INFO: Found listing with ID: 117515973
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515973%27 HTTP/1.1" 200 None
2025-12-02 19:01:33 [astonbarclay.gb] INFO: Scrape type for 117515973: 2
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F8f635196-23e7-4804-8ee6-6d291cfbc345_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/8f635196-23e7-4804-8ee6-6d291cfbc345_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F1abeef99-a9af-4ade-8ab1-27b4b4ae797e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/1abeef99-a9af-4ade-8ab1-27b4b4ae797e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F30b3c443-9c0b-4174-8f7c-24cc9091b753_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/30b3c443-9c0b-4174-8f7c-24cc9091b753_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf099ba50>
2025-12-02 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F1ea60069-9f41-4991-9504-74f1257d8ac0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1ea60069-9f41-4991-9504-74f1257d8ac0_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF66YDO/2025-12-02/image/79a2d3fe-03d4-40a0-be33-0b1f732606ac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642583?view=catalogue)
2025-12-02 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT20JYN/2025-12-02/image/fedc26bc-be09-4bd4-8876-4c4b8f261e9f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662891?view=catalogue)
2025-12-02 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/9403cec6-456e-4912-bea9-e8d744e8d9f8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue)
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252Fb191f662-90c7-48bf-8092-462dfdd79258_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/b191f662-90c7-48bf-8092-462dfdd79258_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F930d963a-c711-4993-80c5-df08980518d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/930d963a-c711-4993-80c5-df08980518d7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252Fcab85c69-b27e-4b52-9be7-5628594964a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cab85c69-b27e-4b52-9be7-5628594964a4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0605450>
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F9473d0ee-4e85-4f63-a9a7-bd30112caacd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9473d0ee-4e85-4f63-a9a7-bd30112caacd_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f21697d1-bff0-598f-b98d-5127299e6dd9
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02e15d0>
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F50c0df84-70fe-4775-a7f7-8d5e2dfe0de9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/50c0df84-70fe-4775-a7f7-8d5e2dfe0de9_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9fd9a40-7f20-5541-9707-6e049ae8e7da
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aabd50>
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F3635b566-2f38-487c-8c05-47aaf04c79c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3635b566-2f38-487c-8c05-47aaf04c79c7_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f21697d1-bff0-598f-b98d-5127299e6dd9
2025-12-02 19:01:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117663364, 'registration': 'DX66TBV', 'account': 'CAR001', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d M Sport 3dr [Nav]', 'mileage': 90362, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2105, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-01', 'fuel': 'Diesel', 'motExpiry': '2026-12-03', 'doors': 3, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DX66TBV/2025-12-02/image/894b04d8-9a5d-4370-a276-c40c5cf54421_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/e7729a77-e2b1-481e-b10d-85154c4835a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/c2ff7a06-97b9-49de-8560-58852469dc06_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/b40c5dee-e917-4ca7-a2d2-b910e49aeaa5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/13349572-a66d-486b-9c9b-9173b9f74eef_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/2104af92-c472-408e-b888-0ab01bf1c895_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/8c8efd27-e24b-4ed4-9a36-b2938a1bd38d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/74ef6988-4700-452a-b483-8da6586facd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/97df7d72-ce40-4bb2-b103-9c92474169af_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/3aad8e9d-89ba-4d1e-a915-cbe745892c2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/cfecf107-c04c-4436-9e90-32c5561a85cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/87e96be2-7866-41e4-a134-655580bbc2f3_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/17 16k- 08/18 33k- 02/19 41k- 08/19 51k- 12/22 74k - 05/24 83k 05/24- 83K', 'remarks': 'VOSA STATES 74K, 79K, 85K, 90K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e96e7fab-448b-4895-9446-1dfbd842d220.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117663364, 'registration': 'DX66TBV', 'account': 'CAR001', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d M Sport 3dr [Nav]', 'mileage': 90362, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2105, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-01', 'fuel': 'Diesel', 'motExpiry': '2026-12-03', 'doors': 3, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DX66TBV/2025-12-02/image/894b04d8-9a5d-4370-a276-c40c5cf54421_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/e7729a77-e2b1-481e-b10d-85154c4835a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/c2ff7a06-97b9-49de-8560-58852469dc06_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/b40c5dee-e917-4ca7-a2d2-b910e49aeaa5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/13349572-a66d-486b-9c9b-9173b9f74eef_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/2104af92-c472-408e-b888-0ab01bf1c895_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/8c8efd27-e24b-4ed4-9a36-b2938a1bd38d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/74ef6988-4700-452a-b483-8da6586facd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/97df7d72-ce40-4bb2-b103-9c92474169af_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/3aad8e9d-89ba-4d1e-a915-cbe745892c2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/cfecf107-c04c-4436-9e90-32c5561a85cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/87e96be2-7866-41e4-a134-655580bbc2f3_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/17 16k- 08/18 33k- 02/19 41k- 08/19 51k- 12/22 74k - 05/24 83k 05/24- 83K', 'remarks': 'VOSA STATES 74K, 79K, 85K, 90K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e96e7fab-448b-4895-9446-1dfbd842d220.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7078d07-d2a5-5ae6-a64e-05e7a6016d13 with identifier: 117663364
2025-12-02 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13 with scrape type 1
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F894b04d8-9a5d-4370-a276-c40c5cf54421_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/894b04d8-9a5d-4370-a276-c40c5cf54421_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117030784, 'registration': 'ST70WLA', 'account': 'CAR001', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '1.5 T3 [163] R DESIGN 5dr', 'mileage': 76966, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2117, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-12-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-06', 'doors': 5, 'engineSize': 1477, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ST70WLA/2025-11-19/image/e0fd21b1-5518-4780-b188-055da44210b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/92b8ecf8-e605-4023-b0cc-4178716aecc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/27c5c98e-cf0f-4a81-978e-494de7f66fa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/3c565299-eabc-4f0a-aede-dafa87335c97_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/280d930c-dc40-40a5-b31c-d682e17ddc4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/c59e42a1-c799-4034-9cbd-4313776f9421_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/8e92044c-4db1-4c4f-8b72-733704d27bbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/d3f1333c-090f-44e0-b703-ac2a9ac4aa21_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/c1dc4613-1082-409a-b0c3-6146bda6c24f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/28e60581-2fd9-433d-9e13-795a332a4127_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/22- 18K, 01/23- 35K', 'remarks': 'VOSA STATES 50K, 67K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 160, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f400b6f6-ec7f-468b-b235-71abe0d98dba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117030784, 'registration': 'ST70WLA', 'account': 'CAR001', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '1.5 T3 [163] R DESIGN 5dr', 'mileage': 76966, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2117, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-12-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-06', 'doors': 5, 'engineSize': 1477, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ST70WLA/2025-11-19/image/e0fd21b1-5518-4780-b188-055da44210b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/92b8ecf8-e605-4023-b0cc-4178716aecc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/27c5c98e-cf0f-4a81-978e-494de7f66fa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/3c565299-eabc-4f0a-aede-dafa87335c97_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/280d930c-dc40-40a5-b31c-d682e17ddc4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/c59e42a1-c799-4034-9cbd-4313776f9421_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/8e92044c-4db1-4c4f-8b72-733704d27bbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/d3f1333c-090f-44e0-b703-ac2a9ac4aa21_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/c1dc4613-1082-409a-b0c3-6146bda6c24f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/28e60581-2fd9-433d-9e13-795a332a4127_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/22- 18K, 01/23- 35K', 'remarks': 'VOSA STATES 50K, 67K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 160, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f400b6f6-ec7f-468b-b235-71abe0d98dba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b40d4a1-d927-531c-a055-ec0df601d776 with identifier: 117030784
2025-12-02 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b40d4a1-d927-531c-a055-ec0df601d776 with scrape type 2
2025-12-02 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b40d4a1-d927-531c-a055-ec0df601d776 with scrape type 2
2025-12-02 19:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8b40d4a1-d927-531c-a055-ec0df601d776, identifier: 117030784
2025-12-02 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116720970, 'registration': 'NJ66GZF', 'account': 'CAR001', 'make': 'NISSAN', 'model': 'NOTE HATCHBACK', 'derivative': '1.2 DiG-S Tekna 5dr', 'mileage': 113051, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2119, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-11-09', 'fuel': 'Petrol', 'motExpiry': '2025-11-23', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/e67dab0b-db4c-409c-a414-16085ae9594a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/128706e8-04e2-4306-884e-b842e0009f78_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/37d8a20b-06ec-4b07-a472-be920622be87_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/c3e31e50-df5d-4a4c-b512-c455ab7c32ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/0930d0b0-1426-41f5-91f8-026e0e863e87_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/50334efa-730f-4912-b3c2-c86ec193366b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/123b6f21-7c6b-4266-b0c5-446d79475a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/c3d8fb08-7596-4e35-8524-a122f2112aad_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/a553ad2e-ba79-4c5c-9bfe-35409d49d6af_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/ee6aabc2-bd7b-4dff-8df1-4abaaf001645_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/943e1df3-57a1-4158-99b6-b49c7c828414_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 85K, 101K, 105K, 108K, SPARE KEY IN OFFICE, SD CARD IN OFFICE ** DUAL CONTROLS FITTED BUYER TO REMOVE **', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/74117156-9dbe-4a55-a088-675337469665.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116720970, 'registration': 'NJ66GZF', 'account': 'CAR001', 'make': 'NISSAN', 'model': 'NOTE HATCHBACK', 'derivative': '1.2 DiG-S Tekna 5dr', 'mileage': 113051, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2119, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-11-09', 'fuel': 'Petrol', 'motExpiry': '2025-11-23', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/e67dab0b-db4c-409c-a414-16085ae9594a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/128706e8-04e2-4306-884e-b842e0009f78_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/37d8a20b-06ec-4b07-a472-be920622be87_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/c3e31e50-df5d-4a4c-b512-c455ab7c32ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/0930d0b0-1426-41f5-91f8-026e0e863e87_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/50334efa-730f-4912-b3c2-c86ec193366b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/123b6f21-7c6b-4266-b0c5-446d79475a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/c3d8fb08-7596-4e35-8524-a122f2112aad_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/a553ad2e-ba79-4c5c-9bfe-35409d49d6af_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/ee6aabc2-bd7b-4dff-8df1-4abaaf001645_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ66GZF/2025-10-28/image/943e1df3-57a1-4158-99b6-b49c7c828414_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 85K, 101K, 105K, 108K, SPARE KEY IN OFFICE, SD CARD IN OFFICE ** DUAL CONTROLS FITTED BUYER TO REMOVE **', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/74117156-9dbe-4a55-a088-675337469665.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d92bfcd-184e-5e46-a91d-abbcddae8d59 with identifier: 116720970
2025-12-02 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d92bfcd-184e-5e46-a91d-abbcddae8d59 with scrape type 2
2025-12-02 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d92bfcd-184e-5e46-a91d-abbcddae8d59 with scrape type 2
2025-12-02 19:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6d92bfcd-184e-5e46-a91d-abbcddae8d59, identifier: 116720970
2025-12-02 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/abc41b92-b014-4717-8dea-b02793df9c2e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF66YDO/2025-12-02/image/4edd28df-7613-417d-a4cd-0bf8858f8c97_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642583?view=catalogue)
2025-12-02 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SG17EWY/2025-12-02/image/51278498-0d86-4f93-8d0b-1cde3b7b57cd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639808?view=catalogue)
2025-12-02 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117609197
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609197%27 HTTP/1.1" 200 None
2025-12-02 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117609197: 2
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F99781c7f-d14b-4c91-a284-f4031f5b8716_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/99781c7f-d14b-4c91-a284-f4031f5b8716_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F99ac4343-0099-439f-ae2c-751268e38d0d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/99ac4343-0099-439f-ae2c-751268e38d0d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8b40d4a1-d927-531c-a055-ec0df601d776 with identifier: 117030784
2025-12-02 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8b40d4a1-d927-531c-a055-ec0df601d776 with identifier: 117030784
2025-12-02 19:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8b40d4a1-d927-531c-a055-ec0df601d776 with identifier: 117030784 to the API
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117030784?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8b40d4a1-d927-531c-a055-ec0df601d776',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ST70WLA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117030784',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLVO',
 'model': 'XC40 ESTATE',
 'odometer': 76966,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-30',
 'seller_name': 'CarGiant',
 'title': 'VOLVO XC40 ESTATE 1.5 T3 [163] R DESIGN 5dr',
 'transmission': 'manual',
 'trim': '1.5 T3 [163] R DESIGN 5dr',
 'vin': None,
 'year': 2020}
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117030784%27 HTTP/1.1" 200 None
2025-12-02 19:01:35 [astonbarclay.gb] INFO: Saving data for 117030784: {'auction_closing_time': 1764756000.0, 'created_time': 1762542317.504287, 'last_price_update_time': 1764702095.51441}
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117030784') HTTP/1.1" 204 0
2025-12-02 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6d92bfcd-184e-5e46-a91d-abbcddae8d59 with identifier: 116720970
2025-12-02 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6d92bfcd-184e-5e46-a91d-abbcddae8d59 with identifier: 116720970
2025-12-02 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181937 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181937
2025-12-02 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6d92bfcd-184e-5e46-a91d-abbcddae8d59 spider: astonbarclay.gb
2025-12-02 19:01:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6d92bfcd-184e-5e46-a91d-abbcddae8d59 due to rule: high_mileage_for_country.json, error: 181937 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181937
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6d92bfcd-184e-5e46-a91d-abbcddae8d59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NJ66GZF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116720970',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'NOTE HATCHBACK',
 'odometer': 113051,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': 'CarGiant',
 'title': 'NISSAN NOTE HATCHBACK 1.2 DiG-S Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-S Tekna 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116720970%27 HTTP/1.1" 200 None
2025-12-02 19:01:35 [astonbarclay.gb] INFO: Saving data for 116720970: {'auction_closing_time': 1764756000.0, 'created_time': 1761678083.828214, 'last_price_update_time': 1764702095.719787}
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116720970') HTTP/1.1" 204 0
2025-12-02 19:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d4c690>
2025-12-02 19:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252Fe3b5e61a-7431-4afd-af7d-213397d32805_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/e3b5e61a-7431-4afd-af7d-213397d32805_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 011c1c6f-5de6-51be-aa12-9540efc6211e
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05097d0>
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252Fcc95cc21-2108-42c9-af25-a10f4d0f8e6e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/cc95cc21-2108-42c9-af25-a10f4d0f8e6e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf093cd90>
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F32bfbbb0-a8df-4e62-b43c-196cba9998fe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/32bfbbb0-a8df-4e62-b43c-196cba9998fe_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f21697d1-bff0-598f-b98d-5127299e6dd9
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf11f7a90>
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F6bae8ace-04cf-4379-91fc-29d6465fe85c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/6bae8ace-04cf-4379-91fc-29d6465fe85c_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45b45be2-c558-5d93-9a39-071396d590cd
2025-12-02 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/e4f51e70-5438-4f3d-88ec-2dce532e82a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cc3d9d31-51c9-48d1-8115-be7c6780c6b7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662891?view=catalogue)
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F52cfcde6-c75c-4ed9-b860-3f71e9b0c027_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/52cfcde6-c75c-4ed9-b860-3f71e9b0c027_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F8b866140-4891-44c8-85e8-23561ea93e02_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/8b866140-4891-44c8-85e8-23561ea93e02_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252Fb119be9e-81f1-4341-99be-4957357ec7a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/b119be9e-81f1-4341-99be-4957357ec7a7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252Fe7729a77-e2b1-481e-b10d-85154c4835a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/e7729a77-e2b1-481e-b10d-85154c4835a6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf37e2b90>
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F723ab968-2d3f-45f0-9168-0a5495c2d280_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/723ab968-2d3f-45f0-9168-0a5495c2d280_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 011c1c6f-5de6-51be-aa12-9540efc6211e
2025-12-02 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16MZV/2025-12-02/image/98628d4b-d3d1-42ba-8b75-a8f070fe3335_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642729?view=catalogue)
2025-12-02 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/87fb9a66-81b7-4628-b8ce-41dcd90398d5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/7d1ed69c-7ccd-4fe3-9224-f71cae19918a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue)
2025-12-02 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117576484
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576484%27 HTTP/1.1" 200 None
2025-12-02 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117576484: 0
2025-12-02 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117590106
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590106%27 HTTP/1.1" 200 None
2025-12-02 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117590106: 2
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F6c4f1892-50f9-416f-942f-f66f087c8d9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/6c4f1892-50f9-416f-942f-f66f087c8d9e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F1e2ed9ad-e92a-4cd2-bf43-cfd151892995_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1e2ed9ad-e92a-4cd2-bf43-cfd151892995_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0968a10>
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F79a2d3fe-03d4-40a0-be33-0b1f732606ac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/79a2d3fe-03d4-40a0-be33-0b1f732606ac_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45b45be2-c558-5d93-9a39-071396d590cd
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06d4610>
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252Ffedc26bc-be09-4bd4-8876-4c4b8f261e9f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/fedc26bc-be09-4bd4-8876-4c4b8f261e9f_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47a7f053-2c4c-546b-ba03-824626d28838
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1eca010>
2025-12-02 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F9403cec6-456e-4912-bea9-e8d744e8d9f8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/9403cec6-456e-4912-bea9-e8d744e8d9f8_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3cf4715d-58b2-4c84-99b5-85bc6c04fd83_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642729?view=catalogue)
2025-12-02 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/17c20128-4619-465f-8a52-f33b39277578_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT20JYN/2025-12-02/image/66f3d280-bead-45b8-a6a7-ce4b8ee46772_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662891?view=catalogue)
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F2e30d9b6-704d-49c9-81c4-ab550b674b70_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/2e30d9b6-704d-49c9-81c4-ab550b674b70_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252F2d5f664c-3736-435c-a580-38d9faa12340_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/2d5f664c-3736-435c-a580-38d9faa12340_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252Fc2ff7a06-97b9-49de-8560-58852469dc06_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/c2ff7a06-97b9-49de-8560-58852469dc06_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf061f310>
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252Fabc41b92-b014-4717-8dea-b02793df9c2e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/abc41b92-b014-4717-8dea-b02793df9c2e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0681ed0>
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F4edd28df-7613-417d-a4cd-0bf8858f8c97_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/4edd28df-7613-417d-a4cd-0bf8858f8c97_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45b45be2-c558-5d93-9a39-071396d590cd
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf067de10>
2025-12-02 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F51278498-0d86-4f93-8d0b-1cde3b7b57cd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/51278498-0d86-4f93-8d0b-1cde3b7b57cd_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 011c1c6f-5de6-51be-aa12-9540efc6211e
2025-12-02 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/a3f46290-d591-4caf-96cb-a4813d62ca82_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16MZV/2025-12-02/image/4365e49e-8539-4417-a4e7-3a790f03be2e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642729?view=catalogue)
2025-12-02 19:01:39 [astonbarclay.gb] INFO: Found listing with ID: 117546506
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546506%27 HTTP/1.1" 200 None
2025-12-02 19:01:39 [astonbarclay.gb] INFO: Scrape type for 117546506: 0
2025-12-02 19:01:39 [astonbarclay.gb] INFO: Found listing with ID: 117514797
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514797%27 HTTP/1.1" 200 None
2025-12-02 19:01:39 [astonbarclay.gb] INFO: Scrape type for 117514797: 0
2025-12-02 19:01:39 [astonbarclay.gb] INFO: Found listing with ID: 117590193
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590193%27 HTTP/1.1" 200 None
2025-12-02 19:01:39 [astonbarclay.gb] INFO: Scrape type for 117590193: 2
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F05efa839-8afc-401f-a978-5a9ab1b2aa38_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/05efa839-8afc-401f-a978-5a9ab1b2aa38_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F548f717c-a2ea-4b05-886e-bd57d50e7da7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/548f717c-a2ea-4b05-886e-bd57d50e7da7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f07710>
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252Fe4f51e70-5438-4f3d-88ec-2dce532e82a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/e4f51e70-5438-4f3d-88ec-2dce532e82a9_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06a2690>
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252Fcc3d9d31-51c9-48d1-8115-be7c6780c6b7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cc3d9d31-51c9-48d1-8115-be7c6780c6b7_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47a7f053-2c4c-546b-ba03-824626d28838
2025-12-02 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/30b3c443-9c0b-4174-8f7c-24cc9091b753_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/8f635196-23e7-4804-8ee6-6d291cfbc345_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue)
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F1deae8a0-3de2-4285-9af5-2551b2659eb6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1deae8a0-3de2-4285-9af5-2551b2659eb6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252F58cbf164-b039-406c-aa07-29eb7256dce6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/58cbf164-b039-406c-aa07-29eb7256dce6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252Fb40c5dee-e917-4ca7-a2d2-b910e49aeaa5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/b40c5dee-e917-4ca7-a2d2-b910e49aeaa5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117663808?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117073655?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aa2a90>
2025-12-02 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F98628d4b-d3d1-42ba-8b75-a8f070fe3335_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/98628d4b-d3d1-42ba-8b75-a8f070fe3335_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f21697d1-bff0-598f-b98d-5127299e6dd9
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098a150>
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F87fb9a66-81b7-4628-b8ce-41dcd90398d5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/87fb9a66-81b7-4628-b8ce-41dcd90398d5_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05e6e10>
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F7d1ed69c-7ccd-4fe3-9224-f71cae19918a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/7d1ed69c-7ccd-4fe3-9224-f71cae19918a_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/894b04d8-9a5d-4370-a276-c40c5cf54421_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cab85c69-b27e-4b52-9be7-5628594964a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662891?view=catalogue)
2025-12-02 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/99ac4343-0099-439f-ae2c-751268e38d0d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SG17EWY/2025-12-02/image/1abeef99-a9af-4ade-8ab1-27b4b4ae797e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639808?view=catalogue)
2025-12-02 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117546419
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546419%27 HTTP/1.1" 200 None
2025-12-02 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117546419: 0
2025-12-02 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117590147
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590147%27 HTTP/1.1" 200 None
2025-12-02 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117590147: 2
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F09cb1655-c285-475a-8fb1-ae01397322d5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/09cb1655-c285-475a-8fb1-ae01397322d5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F1adb5a1e-d0cf-49aa-ac98-4f49d8f23139_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1adb5a1e-d0cf-49aa-ac98-4f49d8f23139_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116321191?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098aa10>
2025-12-02 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F3cf4715d-58b2-4c84-99b5-85bc6c04fd83_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3cf4715d-58b2-4c84-99b5-85bc6c04fd83_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f21697d1-bff0-598f-b98d-5127299e6dd9
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0588b90>
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F17c20128-4619-465f-8a52-f33b39277578_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/17c20128-4619-465f-8a52-f33b39277578_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0588cd0>
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252F66f3d280-bead-45b8-a6a7-ce4b8ee46772_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/66f3d280-bead-45b8-a6a7-ce4b8ee46772_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47a7f053-2c4c-546b-ba03-824626d28838
2025-12-02 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/e7729a77-e2b1-481e-b10d-85154c4835a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SG17EWY/2025-12-02/image/99781c7f-d14b-4c91-a284-f4031f5b8716_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639808?view=catalogue)
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F82317581-7de4-4f1a-94cb-00f7c1238f2d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/82317581-7de4-4f1a-94cb-00f7c1238f2d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252Fa4b32e81-18f7-4411-9f42-4b61d611ce8a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/a4b32e81-18f7-4411-9f42-4b61d611ce8a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F13349572-a66d-486b-9c9b-9173b9f74eef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/13349572-a66d-486b-9c9b-9173b9f74eef_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ab9910>
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252Fa3f46290-d591-4caf-96cb-a4813d62ca82_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/a3f46290-d591-4caf-96cb-a4813d62ca82_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c6c290>
2025-12-02 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F4365e49e-8539-4417-a4e7-3a790f03be2e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/4365e49e-8539-4417-a4e7-3a790f03be2e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f21697d1-bff0-598f-b98d-5127299e6dd9
2025-12-02 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT20JYN/2025-12-02/image/b119be9e-81f1-4341-99be-4957357ec7a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662891?view=catalogue)
2025-12-02 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/8b866140-4891-44c8-85e8-23561ea93e02_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117609113
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609113%27 HTTP/1.1" 200 None
2025-12-02 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117609113: 2
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F1ca35411-ba88-46d5-9fb5-8d6de66fbc3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1ca35411-ba88-46d5-9fb5-8d6de66fbc3d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f33690>
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F30b3c443-9c0b-4174-8f7c-24cc9091b753_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/30b3c443-9c0b-4174-8f7c-24cc9091b753_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f317d0>
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F8f635196-23e7-4804-8ee6-6d291cfbc345_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/8f635196-23e7-4804-8ee6-6d291cfbc345_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:01:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117663808, 'registration': 'EK17LLM', 'account': 'CAR001', 'make': 'HYUNDAI', 'model': 'TUCSON DIESEL ESTATE', 'derivative': '1.7 CRDi Blue Drive SE 5dr 2WD', 'mileage': 67586, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2129, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-27', 'fuel': 'Diesel', 'motExpiry': '2026-04-28', 'doors': 5, 'engineSize': 1685, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EK17LLM/2025-12-02/image/26776408-5143-4ddc-b685-0606ed23af97_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/f6cf3a44-c791-4de0-9d0c-2b2bda78386c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/c3d16984-fdc8-4d4d-8acb-4b688a1e81e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/b43fe5dd-e0cf-4ba0-af79-f17ed2659bb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/e99ee64f-3f2b-4b37-93e8-37f6370fb50b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/7fc5f18a-90c0-4176-a586-ba7ee8c1dd94_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/01367e53-d5b8-4409-8074-8f3b54f92422_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/3b0cde01-2071-4403-b0e3-7d514d8ed9ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/9cfc69fe-c39f-47e1-a181-dc905732ce18_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/19- 16K, 03/20- 26K, 04/21- 35K', 'remarks': 'VOSA STATES 41K, 56K, 63K, 66K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a8944a1-be5f-4e6e-bfca-dde2679e191c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117663808, 'registration': 'EK17LLM', 'account': 'CAR001', 'make': 'HYUNDAI', 'model': 'TUCSON DIESEL ESTATE', 'derivative': '1.7 CRDi Blue Drive SE 5dr 2WD', 'mileage': 67586, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2129, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-27', 'fuel': 'Diesel', 'motExpiry': '2026-04-28', 'doors': 5, 'engineSize': 1685, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EK17LLM/2025-12-02/image/26776408-5143-4ddc-b685-0606ed23af97_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/f6cf3a44-c791-4de0-9d0c-2b2bda78386c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/c3d16984-fdc8-4d4d-8acb-4b688a1e81e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/b43fe5dd-e0cf-4ba0-af79-f17ed2659bb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/e99ee64f-3f2b-4b37-93e8-37f6370fb50b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/7fc5f18a-90c0-4176-a586-ba7ee8c1dd94_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/01367e53-d5b8-4409-8074-8f3b54f92422_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/3b0cde01-2071-4403-b0e3-7d514d8ed9ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/9cfc69fe-c39f-47e1-a181-dc905732ce18_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/19- 16K, 03/20- 26K, 04/21- 35K', 'remarks': 'VOSA STATES 41K, 56K, 63K, 66K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a8944a1-be5f-4e6e-bfca-dde2679e191c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa36cd5a-98a8-58ce-9bca-476386eec90c with identifier: 117663808
2025-12-02 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa36cd5a-98a8-58ce-9bca-476386eec90c with scrape type 1
2025-12-02 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item aa36cd5a-98a8-58ce-9bca-476386eec90c
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252F26776408-5143-4ddc-b685-0606ed23af97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/26776408-5143-4ddc-b685-0606ed23af97_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117073655, 'registration': 'LR17FME', 'account': 'CAR001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E220d AMG Line 4dr 9G-Tronic', 'mileage': 86916, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2121, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LR17FME/2025-11-10/image/30231d22-18e1-4b78-9d49-c0add20dc67f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/2fb04e9f-a99e-4c08-967c-9ee854f5e4d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/81666646-91c1-4aac-8e08-ad65ea9c9484_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/301fec2f-6884-4dd8-bbf7-04fe0b3ba3ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/0455dfca-9238-45a9-81aa-040be8160091_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/3a4cb515-52c8-42c6-8713-417f895335ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/c1570bb2-96e1-40c0-8888-2ee371e0928c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/a3cc2049-28a2-43cd-993e-49730283b134_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/8ecac017-507c-4a2b-b889-af01b5a9d68f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/19- 10K', 'remarks': 'OUTSTANDING RECALL, VOSA STATES 55K, 65K, 73K, 81K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/74aec3d1-e7ee-4e7f-8d9f-1e3102041104.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117073655, 'registration': 'LR17FME', 'account': 'CAR001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E220d AMG Line 4dr 9G-Tronic', 'mileage': 86916, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2121, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LR17FME/2025-11-10/image/30231d22-18e1-4b78-9d49-c0add20dc67f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/2fb04e9f-a99e-4c08-967c-9ee854f5e4d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/81666646-91c1-4aac-8e08-ad65ea9c9484_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/301fec2f-6884-4dd8-bbf7-04fe0b3ba3ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/0455dfca-9238-45a9-81aa-040be8160091_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/3a4cb515-52c8-42c6-8713-417f895335ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/c1570bb2-96e1-40c0-8888-2ee371e0928c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/a3cc2049-28a2-43cd-993e-49730283b134_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/8ecac017-507c-4a2b-b889-af01b5a9d68f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/19- 10K', 'remarks': 'OUTSTANDING RECALL, VOSA STATES 55K, 65K, 73K, 81K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/74aec3d1-e7ee-4e7f-8d9f-1e3102041104.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35d60169-d726-52bd-b98f-9f6199229852 with identifier: 117073655
2025-12-02 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35d60169-d726-52bd-b98f-9f6199229852 with scrape type 2
2025-12-02 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35d60169-d726-52bd-b98f-9f6199229852 with scrape type 2
2025-12-02 19:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 35d60169-d726-52bd-b98f-9f6199229852, identifier: 117073655
2025-12-02 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1e2ed9ad-e92a-4cd2-bf43-cfd151892995_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT20JYN/2025-12-02/image/2d5f664c-3736-435c-a580-38d9faa12340_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662891?view=catalogue)
2025-12-02 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SG17EWY/2025-12-02/image/6c4f1892-50f9-416f-942f-f66f087c8d9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639808?view=catalogue)
2025-12-02 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/c2ff7a06-97b9-49de-8560-58852469dc06_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252Fd04b4ffe-12ad-4e10-90e3-e934a3d566aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/d04b4ffe-12ad-4e10-90e3-e934a3d566aa_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F2104af92-c472-408e-b888-0ab01bf1c895_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/2104af92-c472-408e-b888-0ab01bf1c895_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 35d60169-d726-52bd-b98f-9f6199229852 with identifier: 117073655
2025-12-02 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 35d60169-d726-52bd-b98f-9f6199229852 with identifier: 117073655
2025-12-02 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 35d60169-d726-52bd-b98f-9f6199229852 with identifier: 117073655 to the API
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2735d60169-d726-52bd-b98f-9f6199229852%27 HTTP/1.1" 200 None
2025-12-02 19:01:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 35d60169-d726-52bd-b98f-9f6199229852: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:01:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117073655?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '35d60169-d726-52bd-b98f-9f6199229852',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LR17FME',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117073655',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS DIESEL SALOON',
 'odometer': 86916,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': 'CarGiant',
 'title': 'MERCEDES-BENZ E CLASS DIESEL SALOON E220d AMG Line 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'E220d AMG Line 4dr 9G-Tronic',
 'vin': None,
 'year': 2017}
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117073655%27 HTTP/1.1" 200 None
2025-12-02 19:01:43 [astonbarclay.gb] INFO: Saving data for 117073655: {'auction_closing_time': 1764756000.0, 'created_time': 1762801242.760563, 'last_price_update_time': 1764702103.432911}
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117073655') HTTP/1.1" 204 0
2025-12-02 19:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098ab10>
2025-12-02 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F894b04d8-9a5d-4370-a276-c40c5cf54421_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/894b04d8-9a5d-4370-a276-c40c5cf54421_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0360ed0>
2025-12-02 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252Fcab85c69-b27e-4b52-9be7-5628594964a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cab85c69-b27e-4b52-9be7-5628594964a4_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47a7f053-2c4c-546b-ba03-824626d28838
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f32ad0>
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F99ac4343-0099-439f-ae2c-751268e38d0d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/99ac4343-0099-439f-ae2c-751268e38d0d_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0721fd0>
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F1abeef99-a9af-4ade-8ab1-27b4b4ae797e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/1abeef99-a9af-4ade-8ab1-27b4b4ae797e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 011c1c6f-5de6-51be-aa12-9540efc6211e
2025-12-02 19:01:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116321191, 'registration': 'LX67OHF', 'account': 'CAR001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 67410, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2124, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-10-20', 'fuel': 'Petrol', 'motExpiry': '2026-08-27', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX67OHF/2025-10-13/image/1c7cd0f4-33f8-4c88-8a4a-91d937a7e941_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/92c016f6-99f5-4abe-bc7f-7b56370305b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/e5636665-c183-4062-9f82-6ae981bf6c43_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/92c2cf61-ddf2-43fc-b860-881462473eea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/7fc7e5e3-1af3-4ed6-a5df-bf53326ceec0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/b2acc92d-75b8-4147-995c-6fb9f3d5b8f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/e466c6a1-4d88-4847-a65b-2c4bc304921f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/244497cc-daab-4d2c-9f14-7e6778570fb8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service print and book 10/18 9K - 09/19 20K - 05/25 63K', 'remarks': 'VOSA STATES 39K - 48K - 55K- 66K - SPARE KEY IN OFFICE - SD CARD IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4230553-9a9e-4e45-9181-443571c2fe9d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116321191, 'registration': 'LX67OHF', 'account': 'CAR001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 67410, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2124, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-10-20', 'fuel': 'Petrol', 'motExpiry': '2026-08-27', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX67OHF/2025-10-13/image/1c7cd0f4-33f8-4c88-8a4a-91d937a7e941_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/92c016f6-99f5-4abe-bc7f-7b56370305b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/e5636665-c183-4062-9f82-6ae981bf6c43_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/92c2cf61-ddf2-43fc-b860-881462473eea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/7fc7e5e3-1af3-4ed6-a5df-bf53326ceec0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/b2acc92d-75b8-4147-995c-6fb9f3d5b8f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/e466c6a1-4d88-4847-a65b-2c4bc304921f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/244497cc-daab-4d2c-9f14-7e6778570fb8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service print and book 10/18 9K - 09/19 20K - 05/25 63K', 'remarks': 'VOSA STATES 39K - 48K - 55K- 66K - SPARE KEY IN OFFICE - SD CARD IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4230553-9a9e-4e45-9181-443571c2fe9d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac21a38-f398-5169-b45f-470ca282fee2 with identifier: 116321191
2025-12-02 19:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac21a38-f398-5169-b45f-470ca282fee2 with scrape type 2
2025-12-02 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ac21a38-f398-5169-b45f-470ca282fee2 with scrape type 2
2025-12-02 19:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6ac21a38-f398-5169-b45f-470ca282fee2, identifier: 116321191
2025-12-02 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/548f717c-a2ea-4b05-886e-bd57d50e7da7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SG17EWY/2025-12-02/image/05efa839-8afc-401f-a978-5a9ab1b2aa38_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639808?view=catalogue)
2025-12-02 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117546439
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546439%27 HTTP/1.1" 200 None
2025-12-02 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117546439: 0
2025-12-02 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117576508
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576508%27 HTTP/1.1" 200 None
2025-12-02 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117576508: 0
2025-12-02 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117576494
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576494%27 HTTP/1.1" 200 None
2025-12-02 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117576494: 0
2025-12-02 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117609158
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609158%27 HTTP/1.1" 200 None
2025-12-02 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117609158: 2
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252Fce44da85-dc4b-40ea-8001-3626f9e02071_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/ce44da85-dc4b-40ea-8001-3626f9e02071_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252Ff6cf3a44-c791-4de0-9d0c-2b2bda78386c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/f6cf3a44-c791-4de0-9d0c-2b2bda78386c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6ac21a38-f398-5169-b45f-470ca282fee2 with identifier: 116321191
2025-12-02 19:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6ac21a38-f398-5169-b45f-470ca282fee2 with identifier: 116321191
2025-12-02 19:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6ac21a38-f398-5169-b45f-470ca282fee2 with identifier: 116321191 to the API
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276ac21a38-f398-5169-b45f-470ca282fee2%27 HTTP/1.1" 200 None
2025-12-02 19:01:45 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6ac21a38-f398-5169-b45f-470ca282fee2: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:01:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116321191?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6ac21a38-f398-5169-b45f-470ca282fee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX67OHF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116321191',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 67410,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-20',
 'seller_name': 'CarGiant',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Connecta 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116321191%27 HTTP/1.1" 200 None
2025-12-02 19:01:45 [astonbarclay.gb] INFO: Saving data for 116321191: {'auction_closing_time': 1764756000.0, 'created_time': 1760382270.363496, 'last_price_update_time': 1764702105.020768}
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116321191') HTTP/1.1" 204 0
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0840d50>
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252Fe7729a77-e2b1-481e-b10d-85154c4835a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/e7729a77-e2b1-481e-b10d-85154c4835a6_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08cfe50>
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F99781c7f-d14b-4c91-a284-f4031f5b8716_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/99781c7f-d14b-4c91-a284-f4031f5b8716_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 011c1c6f-5de6-51be-aa12-9540efc6211e
2025-12-02 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/2e30d9b6-704d-49c9-81c4-ab550b674b70_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16MZV/2025-12-02/image/52cfcde6-c75c-4ed9-b860-3f71e9b0c027_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642729?view=catalogue)
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F15d2ed92-d302-489a-8235-e8472384f14e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/15d2ed92-d302-489a-8235-e8472384f14e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F8c8efd27-e24b-4ed4-9a36-b2938a1bd38d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/8c8efd27-e24b-4ed4-9a36-b2938a1bd38d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0672e50>
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252Fb119be9e-81f1-4341-99be-4957357ec7a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/b119be9e-81f1-4341-99be-4957357ec7a7_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47a7f053-2c4c-546b-ba03-824626d28838
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf085f790>
2025-12-02 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F8b866140-4891-44c8-85e8-23561ea93e02_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/8b866140-4891-44c8-85e8-23561ea93e02_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/b40c5dee-e917-4ca7-a2d2-b910e49aeaa5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1deae8a0-3de2-4285-9af5-2551b2659eb6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1adb5a1e-d0cf-49aa-ac98-4f49d8f23139_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT20JYN/2025-12-02/image/58cbf164-b039-406c-aa07-29eb7256dce6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662891?view=catalogue)
2025-12-02 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117576566
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576566%27 HTTP/1.1" 200 None
2025-12-02 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117576566: 0
2025-12-02 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117590132
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590132%27 HTTP/1.1" 200 None
2025-12-02 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117590132: 2
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252Fd9eaeff8-f4fa-4903-8de7-841427d7bf2c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/d9eaeff8-f4fa-4903-8de7-841427d7bf2c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252Fc3d16984-fdc8-4d4d-8acb-4b688a1e81e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/c3d16984-fdc8-4d4d-8acb-4b688a1e81e5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117609197?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07f3550>
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F1e2ed9ad-e92a-4cd2-bf43-cfd151892995_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1e2ed9ad-e92a-4cd2-bf43-cfd151892995_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06abbd0>
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252F2d5f664c-3736-435c-a580-38d9faa12340_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/2d5f664c-3736-435c-a580-38d9faa12340_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47a7f053-2c4c-546b-ba03-824626d28838
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf095e4d0>
2025-12-02 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F6c4f1892-50f9-416f-942f-f66f087c8d9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/6c4f1892-50f9-416f-942f-f66f087c8d9e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 011c1c6f-5de6-51be-aa12-9540efc6211e
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0abb250>
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252Fc2ff7a06-97b9-49de-8560-58852469dc06_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/c2ff7a06-97b9-49de-8560-58852469dc06_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/13349572-a66d-486b-9c9b-9173b9f74eef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F74ef6988-4700-452a-b483-8da6586facd7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/74ef6988-4700-452a-b483-8da6586facd7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04b0f90>
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F548f717c-a2ea-4b05-886e-bd57d50e7da7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/548f717c-a2ea-4b05-886e-bd57d50e7da7_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08cea90>
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F05efa839-8afc-401f-a978-5a9ab1b2aa38_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/05efa839-8afc-401f-a978-5a9ab1b2aa38_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 011c1c6f-5de6-51be-aa12-9540efc6211e
2025-12-02 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT20JYN/2025-12-02/image/a4b32e81-18f7-4411-9f42-4b61d611ce8a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662891?view=catalogue)
2025-12-02 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/82317581-7de4-4f1a-94cb-00f7c1238f2d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SG17EWY/2025-12-02/image/09cb1655-c285-475a-8fb1-ae01397322d5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639808?view=catalogue)
2025-12-02 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117546474
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546474%27 HTTP/1.1" 200 None
2025-12-02 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117546474: 0
2025-12-02 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 116802225
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116802225%27 HTTP/1.1" 200 None
2025-12-02 19:01:47 [astonbarclay.gb] INFO: Scrape type for 116802225: 0
2025-12-02 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117514825
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514825%27 HTTP/1.1" 200 None
2025-12-02 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117514825: 0
2025-12-02 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 116674717
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116674717%27 HTTP/1.1" 200 None
2025-12-02 19:01:47 [astonbarclay.gb] INFO: Scrape type for 116674717: 2
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252Faf60633e-d94e-467f-a62f-e5337a858e03_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/af60633e-d94e-467f-a62f-e5337a858e03_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252Fb43fe5dd-e0cf-4ba0-af79-f17ed2659bb3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/b43fe5dd-e0cf-4ba0-af79-f17ed2659bb3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04655d0>
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F2e30d9b6-704d-49c9-81c4-ab550b674b70_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/2e30d9b6-704d-49c9-81c4-ab550b674b70_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08cc850>
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252F52cfcde6-c75c-4ed9-b860-3f71e9b0c027_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/52cfcde6-c75c-4ed9-b860-3f71e9b0c027_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f21697d1-bff0-598f-b98d-5127299e6dd9
2025-12-02 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17LLM/2025-12-02/image/26776408-5143-4ddc-b685-0606ed23af97_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663808?view=catalogue)
2025-12-02 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1ca35411-ba88-46d5-9fb5-8d6de66fbc3d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/d04b4ffe-12ad-4e10-90e3-e934a3d566aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/2104af92-c472-408e-b888-0ab01bf1c895_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F97df7d72-ce40-4bb2-b103-9c92474169af_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/97df7d72-ce40-4bb2-b103-9c92474169af_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0312b10>
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252Fb40c5dee-e917-4ca7-a2d2-b910e49aeaa5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/b40c5dee-e917-4ca7-a2d2-b910e49aeaa5_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf060fb90>
2025-12-02 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F1deae8a0-3de2-4285-9af5-2551b2659eb6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1deae8a0-3de2-4285-9af5-2551b2659eb6_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06e6210>
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F1adb5a1e-d0cf-49aa-ac98-4f49d8f23139_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1adb5a1e-d0cf-49aa-ac98-4f49d8f23139_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07ff8d0>
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252F58cbf164-b039-406c-aa07-29eb7256dce6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/58cbf164-b039-406c-aa07-29eb7256dce6_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47a7f053-2c4c-546b-ba03-824626d28838
2025-12-02 19:01:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117609197, 'registration': 'WR18OVO', 'account': 'GAT023', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.0 PHEV GX5h 5dr Auto', 'mileage': 54971, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2200, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-04-12', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-03-04', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WR18OVO/2025-11-29/image/d87dc68a-a0fa-41bb-b820-eaa49604e475_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/8ac3e109-efc7-4ac8-9cdd-d2bb55e83667_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/02f471ee-5c9f-4b8d-9911-6c44eec6ee38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/dcf339bd-5f31-4c71-b47d-ef4c80aff51d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/31f64e34-d602-44fc-b68d-cc50598fcee1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/6b187ef4-40ba-4afc-9abd-0d0f6a8bd685_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/e5a10ab4-438c-48cc-8c6f-7059a0634c9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/17b4c9f4-e103-4c3e-8b7d-48798f646ff0_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/b2547d58-2052-4487-a4db-b50a6535e196_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/19 1K - 02/20 2K - 11/21 14K - 10/22 25K - ?? 32K - 02/25 47K', 'remarks': 'VOSA STATES, 18K, 29K, 38K, 47K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 41, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b85b5c5b-0a67-4843-8733-c2addd805e30.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117609197, 'registration': 'WR18OVO', 'account': 'GAT023', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.0 PHEV GX5h 5dr Auto', 'mileage': 54971, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2200, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-04-12', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-03-04', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WR18OVO/2025-11-29/image/d87dc68a-a0fa-41bb-b820-eaa49604e475_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/8ac3e109-efc7-4ac8-9cdd-d2bb55e83667_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/02f471ee-5c9f-4b8d-9911-6c44eec6ee38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/dcf339bd-5f31-4c71-b47d-ef4c80aff51d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/31f64e34-d602-44fc-b68d-cc50598fcee1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/6b187ef4-40ba-4afc-9abd-0d0f6a8bd685_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/e5a10ab4-438c-48cc-8c6f-7059a0634c9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/17b4c9f4-e103-4c3e-8b7d-48798f646ff0_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR18OVO/2025-11-29/image/b2547d58-2052-4487-a4db-b50a6535e196_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/19 1K - 02/20 2K - 11/21 14K - 10/22 25K - ?? 32K - 02/25 47K', 'remarks': 'VOSA STATES, 18K, 29K, 38K, 47K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 41, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b85b5c5b-0a67-4843-8733-c2addd805e30.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb4f55c-aadb-5a86-9615-3e111ad77a1c with identifier: 117609197
2025-12-02 19:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb4f55c-aadb-5a86-9615-3e111ad77a1c with scrape type 2
2025-12-02 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb4f55c-aadb-5a86-9615-3e111ad77a1c with scrape type 2
2025-12-02 19:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: acb4f55c-aadb-5a86-9615-3e111ad77a1c, identifier: 117609197
2025-12-02 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17LLM/2025-12-02/image/f6cf3a44-c791-4de0-9d0c-2b2bda78386c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663808?view=catalogue)
2025-12-02 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117514835
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514835%27 HTTP/1.1" 200 None
2025-12-02 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117514835: 0
2025-12-02 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117546520
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546520%27 HTTP/1.1" 200 None
2025-12-02 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117546520: 0
2025-12-02 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117245171
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117245171%27 HTTP/1.1" 200 None
2025-12-02 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117245171: 2
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F79569779-0a7c-4cb3-999c-caa52afde85b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/79569779-0a7c-4cb3-999c-caa52afde85b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252Fe99ee64f-3f2b-4b37-93e8-37f6370fb50b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/e99ee64f-3f2b-4b37-93e8-37f6370fb50b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: acb4f55c-aadb-5a86-9615-3e111ad77a1c with identifier: 117609197
2025-12-02 19:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: acb4f55c-aadb-5a86-9615-3e111ad77a1c with identifier: 117609197
2025-12-02 19:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: acb4f55c-aadb-5a86-9615-3e111ad77a1c with identifier: 117609197 to the API
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27acb4f55c-aadb-5a86-9615-3e111ad77a1c%27 HTTP/1.1" 200 None
2025-12-02 19:01:50 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id acb4f55c-aadb-5a86-9615-3e111ad77a1c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:01:49 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117609197?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'acb4f55c-aadb-5a86-9615-3e111ad77a1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WR18OVO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609197',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER ESTATE',
 'odometer': 54971,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-12',
 'seller_name': 'Gates Group',
 'title': 'MITSUBISHI OUTLANDER ESTATE 2.0 PHEV GX5h 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 PHEV GX5h 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609197%27 HTTP/1.1" 200 None
2025-12-02 19:01:50 [astonbarclay.gb] INFO: Saving data for 117609197: {'auction_closing_time': 1764756000.0, 'created_time': 1764356560.391784, 'last_price_update_time': 1764702110.356343}
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117609197') HTTP/1.1" 204 0
2025-12-02 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06e2fd0>
2025-12-02 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F13349572-a66d-486b-9c9b-9173b9f74eef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/13349572-a66d-486b-9c9b-9173b9f74eef_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/ce44da85-dc4b-40ea-8001-3626f9e02071_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/15d2ed92-d302-489a-8235-e8472384f14e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/8c8efd27-e24b-4ed4-9a36-b2938a1bd38d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F3aad8e9d-89ba-4d1e-a915-cbe745892c2d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/3aad8e9d-89ba-4d1e-a915-cbe745892c2d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ffb950>
2025-12-02 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT20JYN%252F2025-12-02%252Fimage%252Fa4b32e81-18f7-4411-9f42-4b61d611ce8a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT20JYN/2025-12-02/image/a4b32e81-18f7-4411-9f42-4b61d611ce8a_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47a7f053-2c4c-546b-ba03-824626d28838
2025-12-02 19:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47a7f053-2c4c-546b-ba03-824626d28838, skipping ID generation
2025-12-02 19:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a7f053-2c4c-546b-ba03-824626d28838 with scrape type 1
2025-12-02 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 47a7f053-2c4c-546b-ba03-824626d28838 from tracking dictionaries
2025-12-02 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47a7f053-2c4c-546b-ba03-824626d28838 sending to next pipeline
2025-12-02 19:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 47a7f053-2c4c-546b-ba03-824626d28838, identifier: 117662891
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06bb1d0>
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F82317581-7de4-4f1a-94cb-00f7c1238f2d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/82317581-7de4-4f1a-94cb-00f7c1238f2d_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf060f350>
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F09cb1655-c285-475a-8fb1-ae01397322d5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/09cb1655-c285-475a-8fb1-ae01397322d5_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 011c1c6f-5de6-51be-aa12-9540efc6211e
2025-12-02 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17LLM/2025-12-02/image/c3d16984-fdc8-4d4d-8acb-4b688a1e81e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663808?view=catalogue)
2025-12-02 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/d9eaeff8-f4fa-4903-8de7-841427d7bf2c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117579407
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579407%27 HTTP/1.1" 200 None
2025-12-02 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117579407: 0
2025-12-02 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 116409684
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116409684%27 HTTP/1.1" 200 None
2025-12-02 19:01:51 [astonbarclay.gb] INFO: Scrape type for 116409684: 2
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252F7fc5f18a-90c0-4176-a586-ba7ee8c1dd94_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/7fc5f18a-90c0-4176-a586-ba7ee8c1dd94_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 47a7f053-2c4c-546b-ba03-824626d28838 with identifier: 117662891
2025-12-02 19:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 47a7f053-2c4c-546b-ba03-824626d28838 with identifier: 117662891
2025-12-02 19:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 47a7f053-2c4c-546b-ba03-824626d28838 with identifier: 117662891 to the API
2025-12-02 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BT20JYN/2025-12-02/image/a4b32e81-18f7-4411-9f42-4b61d611ce8a_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '47a7f053-2c4c-546b-ba03-824626d28838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BT20JYN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662891',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS DIESEL SALOON',
 'odometer': 76133,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31026,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/fedc26bc-be09-4bd4-8876-4c4b8f261e9f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30848,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cc3d9d31-51c9-48d1-8115-be7c6780c6b7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29188,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/66f3d280-bead-45b8-a6a7-ce4b8ee46772_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31011,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/cab85c69-b27e-4b52-9be7-5628594964a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51173,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/b119be9e-81f1-4341-99be-4957357ec7a7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45592,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/2d5f664c-3736-435c-a580-38d9faa12340_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50916,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/58cbf164-b039-406c-aa07-29eb7256dce6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a7f053-2c4c-546b-ba03-824626d28838/47a7f053-2c4c-546b-ba03-824626d28838_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27264,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT20JYN/2025-12-02/image/a4b32e81-18f7-4411-9f42-4b61d611ce8a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-15',
 'seller_name': 'CarGiant',
 'title': 'MERCEDES-BENZ C CLASS DIESEL SALOON C220d AMG Line Premium 4dr '
          '9G-Tronic',
 'transmission': 'automatic',
 'trim': 'C220d AMG Line Premium 4dr 9G-Tronic',
 'vin': None,
 'year': 2020}
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662891%27 HTTP/1.1" 200 None
2025-12-02 19:01:52 [astonbarclay.gb] INFO: Saving data for 117662891: {'created_time': 1764702112.130992, 'last_price_update_time': 1764702112.131002, 'auction_closing_time': 1764756000.0}
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662891') HTTP/1.1" 204 0
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06e7dd0>
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252F26776408-5143-4ddc-b685-0606ed23af97_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/26776408-5143-4ddc-b685-0606ed23af97_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa36cd5a-98a8-58ce-9bca-476386eec90c
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0689190>
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F1ca35411-ba88-46d5-9fb5-8d6de66fbc3d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1ca35411-ba88-46d5-9fb5-8d6de66fbc3d_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0823610>
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252Fd04b4ffe-12ad-4e10-90e3-e934a3d566aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/d04b4ffe-12ad-4e10-90e3-e934a3d566aa_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aae050>
2025-12-02 19:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F2104af92-c472-408e-b888-0ab01bf1c895_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/2104af92-c472-408e-b888-0ab01bf1c895_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/74ef6988-4700-452a-b483-8da6586facd7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16MZV/2025-12-02/image/b191f662-90c7-48bf-8092-462dfdd79258_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642729?view=catalogue)
2025-12-02 19:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD70OXT/2025-12-02/image/930d963a-c711-4993-80c5-df08980518d7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117641132?view=catalogue)
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252Fcfecf107-c04c-4436-9e90-32c5561a85cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/cfecf107-c04c-4436-9e90-32c5561a85cc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117590193?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b3950>
2025-12-02 19:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252Ff6cf3a44-c791-4de0-9d0c-2b2bda78386c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/f6cf3a44-c791-4de0-9d0c-2b2bda78386c_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa36cd5a-98a8-58ce-9bca-476386eec90c
2025-12-02 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17LLM/2025-12-02/image/b43fe5dd-e0cf-4ba0-af79-f17ed2659bb3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663808?view=catalogue)
2025-12-02 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 117576471
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576471%27 HTTP/1.1" 200 None
2025-12-02 19:01:54 [astonbarclay.gb] INFO: Scrape type for 117576471: 0
2025-12-02 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 117546450
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546450%27 HTTP/1.1" 200 None
2025-12-02 19:01:54 [astonbarclay.gb] INFO: Scrape type for 117546450: 0
2025-12-02 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 116859641
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859641%27 HTTP/1.1" 200 None
2025-12-02 19:01:54 [astonbarclay.gb] INFO: Scrape type for 116859641: 2
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252F01367e53-d5b8-4409-8074-8f3b54f92422_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/01367e53-d5b8-4409-8074-8f3b54f92422_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117609158?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117609113?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac8550>
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252Fce44da85-dc4b-40ea-8001-3626f9e02071_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/ce44da85-dc4b-40ea-8001-3626f9e02071_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08746d0>
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_11.jpg HTTP/1.1" 201 0
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F15d2ed92-d302-489a-8235-e8472384f14e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/15d2ed92-d302-489a-8235-e8472384f14e_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06a3490>
2025-12-02 19:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F8c8efd27-e24b-4ed4-9a36-b2938a1bd38d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/8c8efd27-e24b-4ed4-9a36-b2938a1bd38d_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/af60633e-d94e-467f-a62f-e5337a858e03_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/97df7d72-ce40-4bb2-b103-9c92474169af_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F87e96be2-7866-41e4-a134-655580bbc2f3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/87e96be2-7866-41e4-a134-655580bbc2f3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117590147?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a88810>
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252Fc3d16984-fdc8-4d4d-8acb-4b688a1e81e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/c3d16984-fdc8-4d4d-8acb-4b688a1e81e5_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa36cd5a-98a8-58ce-9bca-476386eec90c
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0462150>
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252Fd9eaeff8-f4fa-4903-8de7-841427d7bf2c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/d9eaeff8-f4fa-4903-8de7-841427d7bf2c_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17LLM/2025-12-02/image/e99ee64f-3f2b-4b37-93e8-37f6370fb50b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663808?view=catalogue)
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Found listing with ID: 117514787
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514787%27 HTTP/1.1" 200 None
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Scrape type for 117514787: 0
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Found listing with ID: 117483520
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117483520%27 HTTP/1.1" 200 None
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Scrape type for 117483520: 0
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Found listing with ID: 116857256
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116857256%27 HTTP/1.1" 200 None
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Scrape type for 116857256: 0
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Found listing with ID: 117514806
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514806%27 HTTP/1.1" 200 None
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Scrape type for 117514806: 0
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Found listing with ID: 117576544
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576544%27 HTTP/1.1" 200 None
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Scrape type for 117576544: 0
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Found listing with ID: 116377459
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116377459%27 HTTP/1.1" 200 None
2025-12-02 19:01:55 [astonbarclay.gb] INFO: Scrape type for 116377459: 2
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252F3b0cde01-2071-4403-b0e3-7d514d8ed9ef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/3b0cde01-2071-4403-b0e3-7d514d8ed9ef_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf207eed0>
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F74ef6988-4700-452a-b483-8da6586facd7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/74ef6988-4700-452a-b483-8da6586facd7_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1cc98d0>
2025-12-02 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16MZV%252F2025-12-02%252Fimage%252Fb191f662-90c7-48bf-8092-462dfdd79258_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16MZV/2025-12-02/image/b191f662-90c7-48bf-8092-462dfdd79258_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f21697d1-bff0-598f-b98d-5127299e6dd9
2025-12-02 19:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f21697d1-bff0-598f-b98d-5127299e6dd9, skipping ID generation
2025-12-02 19:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f21697d1-bff0-598f-b98d-5127299e6dd9 with scrape type 1
2025-12-02 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f21697d1-bff0-598f-b98d-5127299e6dd9 from tracking dictionaries
2025-12-02 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f21697d1-bff0-598f-b98d-5127299e6dd9 sending to next pipeline
2025-12-02 19:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f21697d1-bff0-598f-b98d-5127299e6dd9, identifier: 117642729
2025-12-02 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06a3290>
2025-12-02 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD70OXT%252F2025-12-02%252Fimage%252F930d963a-c711-4993-80c5-df08980518d7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD70OXT/2025-12-02/image/930d963a-c711-4993-80c5-df08980518d7_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7966583b-79ab-5144-863e-3d33d558cfb0
2025-12-02 19:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7966583b-79ab-5144-863e-3d33d558cfb0, skipping ID generation
2025-12-02 19:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7966583b-79ab-5144-863e-3d33d558cfb0 with scrape type 1
2025-12-02 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7966583b-79ab-5144-863e-3d33d558cfb0 from tracking dictionaries
2025-12-02 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7966583b-79ab-5144-863e-3d33d558cfb0 sending to next pipeline
2025-12-02 19:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7966583b-79ab-5144-863e-3d33d558cfb0, identifier: 117641132
2025-12-02 19:01:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117590193, 'registration': 'EJ70BNY', 'account': 'GAT001', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line 5dr', 'mileage': 46788, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2206, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-12-10', 'fuel': 'Petrol', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/b412ccbc-8bdd-4931-a94b-64cb59fc2c7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/90ac871c-cde3-4283-9f14-db3859ef7ee7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/f6b3b8da-36dc-4c85-9d1a-98791179d608_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/5a7aca90-55ca-4d49-bfd1-383483da3ee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/f1f131e1-6d0d-4da6-ac54-97e7b81fa7b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/5bb38f17-444b-4118-bdc1-c88272c2fc0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/47bf0419-269a-4298-8dbd-448a2ef33a83_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/6f407f84-9808-417e-96a9-d429e9350800_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/2e7ff08e-99c3-49d6-9510-4a7ca6081a3a_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES, 22K, 32K, 44K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60856e58-650f-4ec3-8043-47bfc6ac88cd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117590193, 'registration': 'EJ70BNY', 'account': 'GAT001', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line 5dr', 'mileage': 46788, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2206, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-12-10', 'fuel': 'Petrol', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/b412ccbc-8bdd-4931-a94b-64cb59fc2c7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/90ac871c-cde3-4283-9f14-db3859ef7ee7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/f6b3b8da-36dc-4c85-9d1a-98791179d608_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/5a7aca90-55ca-4d49-bfd1-383483da3ee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/f1f131e1-6d0d-4da6-ac54-97e7b81fa7b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/5bb38f17-444b-4118-bdc1-c88272c2fc0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/47bf0419-269a-4298-8dbd-448a2ef33a83_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/6f407f84-9808-417e-96a9-d429e9350800_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/2e7ff08e-99c3-49d6-9510-4a7ca6081a3a_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES, 22K, 32K, 44K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60856e58-650f-4ec3-8043-47bfc6ac88cd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d779f7d-23f1-5eab-ae80-24405f2c959b with identifier: 117590193
2025-12-02 19:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d779f7d-23f1-5eab-ae80-24405f2c959b with scrape type 2
2025-12-02 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d779f7d-23f1-5eab-ae80-24405f2c959b with scrape type 2
2025-12-02 19:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d779f7d-23f1-5eab-ae80-24405f2c959b, identifier: 117590193
2025-12-02 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SG17EWY/2025-12-02/image/60f7bafd-5edb-400d-8c2f-75fb7f163fdd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639808?view=catalogue)
2025-12-02 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/3aad8e9d-89ba-4d1e-a915-cbe745892c2d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VK18HKV/2025-12-02/image/79569779-0a7c-4cb3-999c-caa52afde85b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue)
2025-12-02 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117590106?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f21697d1-bff0-598f-b98d-5127299e6dd9 with identifier: 117642729
2025-12-02 19:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f21697d1-bff0-598f-b98d-5127299e6dd9 with identifier: 117642729
2025-12-02 19:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f21697d1-bff0-598f-b98d-5127299e6dd9 with identifier: 117642729 to the API
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/HN16MZV/2025-12-02/image/b191f662-90c7-48bf-8092-462dfdd79258_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f21697d1-bff0-598f-b98d-5127299e6dd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HN16MZV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117642729',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'CLIO HATCHBACK',
 'odometer': 8231,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39788,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9111d2e2-980b-46c1-95a5-5228cc00836c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35507,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/be41a77d-b585-47ea-9a27-47f4073c1a1c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34979,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3635b566-2f38-487c-8c05-47aaf04c79c7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35690,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/9473d0ee-4e85-4f63-a9a7-bd30112caacd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52436,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/32bfbbb0-a8df-4e62-b43c-196cba9998fe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51684,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/3cf4715d-58b2-4c84-99b5-85bc6c04fd83_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49105,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/98628d4b-d3d1-42ba-8b75-a8f070fe3335_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56169,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/4365e49e-8539-4417-a4e7-3a790f03be2e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52505,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/b191f662-90c7-48bf-8092-462dfdd79258_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f21697d1-bff0-598f-b98d-5127299e6dd9/f21697d1-bff0-598f-b98d-5127299e6dd9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52266,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16MZV/2025-12-02/image/52cfcde6-c75c-4ed9-b860-3f71e9b0c027_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'UKCGR - Premium',
 'title': 'RENAULT CLIO HATCHBACK 0.9 TCE 90 Dynamique S Nav 5dr',
 'transmission': 'manual',
 'trim': '0.9 TCE 90 Dynamique S Nav 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117642729%27 HTTP/1.1" 200 None
2025-12-02 19:01:57 [astonbarclay.gb] INFO: Saving data for 117642729: {'created_time': 1764702117.30919, 'last_price_update_time': 1764702117.309202, 'auction_closing_time': 1764756000.0}
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117642729') HTTP/1.1" 204 0
2025-12-02 19:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7966583b-79ab-5144-863e-3d33d558cfb0 with identifier: 117641132
2025-12-02 19:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7966583b-79ab-5144-863e-3d33d558cfb0 with identifier: 117641132
2025-12-02 19:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7966583b-79ab-5144-863e-3d33d558cfb0 with identifier: 117641132 to the API
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SD70OXT/2025-12-02/image/930d963a-c711-4993-80c5-df08980518d7_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 285,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '4.4L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7966583b-79ab-5144-863e-3d33d558cfb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SD70OXT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117641132',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER DIESEL ESTATE',
 'odometer': 63264,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36251,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1ea60069-9f41-4991-9504-74f1257d8ac0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35650,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/cc95cc21-2108-42c9-af25-a10f4d0f8e6e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38888,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/87fb9a66-81b7-4628-b8ce-41dcd90398d5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39270,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/e4f51e70-5438-4f3d-88ec-2dce532e82a9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35678,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/a3f46290-d591-4caf-96cb-a4813d62ca82_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56739,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/930d963a-c711-4993-80c5-df08980518d7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25157,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/8b866140-4891-44c8-85e8-23561ea93e02_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34062,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/2e30d9b6-704d-49c9-81c4-ab550b674b70_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53030,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/1deae8a0-3de2-4285-9af5-2551b2659eb6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46228,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/82317581-7de4-4f1a-94cb-00f7c1238f2d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39228,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/d04b4ffe-12ad-4e10-90e3-e934a3d566aa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7966583b-79ab-5144-863e-3d33d558cfb0/7966583b-79ab-5144-863e-3d33d558cfb0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53796,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD70OXT/2025-12-02/image/15d2ed92-d302-489a-8235-e8472384f14e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seller_name': 'UKCGR - Premium',
 'title': 'LAND ROVER RANGE ROVER DIESEL ESTATE 4.4 SDV8 Autobiography 4dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '4.4 SDV8 Autobiography 4dr Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117641132%27 HTTP/1.1" 200 None
2025-12-02 19:01:57 [astonbarclay.gb] INFO: Saving data for 117641132: {'created_time': 1764702117.837847, 'last_price_update_time': 1764702117.837858, 'auction_closing_time': 1764756000.0}
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117641132') HTTP/1.1" 204 0
2025-12-02 19:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d779f7d-23f1-5eab-ae80-24405f2c959b with identifier: 117590193
2025-12-02 19:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d779f7d-23f1-5eab-ae80-24405f2c959b with identifier: 117590193
2025-12-02 19:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0d779f7d-23f1-5eab-ae80-24405f2c959b with identifier: 117590193 to the API
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270d779f7d-23f1-5eab-ae80-24405f2c959b%27 HTTP/1.1" 200 None
2025-12-02 19:01:58 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0d779f7d-23f1-5eab-ae80-24405f2c959b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:01:56 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117590193?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0d779f7d-23f1-5eab-ae80-24405f2c959b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EJ70BNY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117590193',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 46788,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seller_name': 'Gates Group',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV ST-Line 5dr',
 'vin': None,
 'year': 2020}
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590193%27 HTTP/1.1" 200 None
2025-12-02 19:01:58 [astonbarclay.gb] INFO: Saving data for 117590193: {'auction_closing_time': 1764756000.0, 'created_time': 1764356622.175458, 'last_price_update_time': 1764702118.109664}
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117590193') HTTP/1.1" 204 0
2025-12-02 19:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0690950>
2025-12-02 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252Fb43fe5dd-e0cf-4ba0-af79-f17ed2659bb3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/b43fe5dd-e0cf-4ba0-af79-f17ed2659bb3_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa36cd5a-98a8-58ce-9bca-476386eec90c
2025-12-02 19:01:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117609158, 'registration': 'ML69UPW', 'account': 'GAT023', 'make': 'MERCEDES-BENZ', 'model': 'GLE DIESEL ESTATE', 'derivative': 'GLE 300d 4Matic AMG Line 5dr 9G-Tronic [7 Seat]', 'mileage': 51815, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2215, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-12-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-09', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ML69UPW/2025-11-29/image/c1bf88e9-21c3-4fcb-8649-78e1b8712225_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/b7cccfdc-0474-4331-88d7-c129592a7aae_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/ce012f87-c279-490a-919a-f54c3736c4d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/a984f3f7-ac8a-40aa-880b-f8bc89471af5_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/bdfd7009-244c-48ee-b63c-c54921591f56_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/b0779335-5a61-469e-a1ac-71d0da99ae7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/91242c53-53d3-4047-baf5-f8945876cace_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/d4923f30-b6e9-4619-bd29-2926790694c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/78ef6682-7060-4c33-a458-b58da91c2873_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/c9e35a48-1b90-4f44-8b2e-32d4d1a434be_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/20 3K', 'remarks': 'VOSA STATES, 26K, 42K', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd6b5a58-2769-4705-b26a-9aff2e2da536.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117609158, 'registration': 'ML69UPW', 'account': 'GAT023', 'make': 'MERCEDES-BENZ', 'model': 'GLE DIESEL ESTATE', 'derivative': 'GLE 300d 4Matic AMG Line 5dr 9G-Tronic [7 Seat]', 'mileage': 51815, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2215, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-12-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-09', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ML69UPW/2025-11-29/image/c1bf88e9-21c3-4fcb-8649-78e1b8712225_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/b7cccfdc-0474-4331-88d7-c129592a7aae_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/ce012f87-c279-490a-919a-f54c3736c4d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/a984f3f7-ac8a-40aa-880b-f8bc89471af5_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/bdfd7009-244c-48ee-b63c-c54921591f56_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/b0779335-5a61-469e-a1ac-71d0da99ae7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/91242c53-53d3-4047-baf5-f8945876cace_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/d4923f30-b6e9-4619-bd29-2926790694c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/78ef6682-7060-4c33-a458-b58da91c2873_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML69UPW/2025-11-29/image/c9e35a48-1b90-4f44-8b2e-32d4d1a434be_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/20 3K', 'remarks': 'VOSA STATES, 26K, 42K', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd6b5a58-2769-4705-b26a-9aff2e2da536.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21f77570-0fd2-5628-8213-5b7a3847e873 with identifier: 117609158
2025-12-02 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f77570-0fd2-5628-8213-5b7a3847e873 with scrape type 2
2025-12-02 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21f77570-0fd2-5628-8213-5b7a3847e873 with scrape type 2
2025-12-02 19:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 21f77570-0fd2-5628-8213-5b7a3847e873, identifier: 117609158
2025-12-02 19:01:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117609113, 'registration': 'LD66OPJ', 'account': 'GAT021', 'make': 'FORD', 'model': 'FOCUS DIESEL HATCHBACK', 'derivative': '1.5 TDCi 120 Titanium 5dr', 'mileage': 66702, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2209, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-01-30', 'fuel': 'Diesel', 'motExpiry': '2025-12-23', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/484ccb58-6c9b-4691-b5ca-4365f92b3bb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/88e7da73-2698-4a2f-b059-71bb4e81455a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/c517a117-6812-4e33-8e5d-ee99a232ea86_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/af80484a-ae3b-4b03-97d4-bbfd66b3011e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/b35206e2-bdd5-4e51-866a-eb9a31a243f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/482c8f48-cc63-43d2-a346-449dc296e8cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/91f01363-fe78-4ff5-bf72-ecfccd4fd087_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/0e297c1d-9057-446a-a425-305eddea53c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/2bf691cb-9d2a-4667-ad4b-56671d7a34a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/173de4f2-8985-4ffa-92e8-8e9fe0e61c04_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/19 17K - 06/21 31K - 07/22 40K - 08/23 48K - 08/23 48K - 07/24 54K - 08/25 64K', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 36K, 44K, 50K, 58K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b8b6ddb-80ca-45f4-86a8-7ddde24d82dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117609113, 'registration': 'LD66OPJ', 'account': 'GAT021', 'make': 'FORD', 'model': 'FOCUS DIESEL HATCHBACK', 'derivative': '1.5 TDCi 120 Titanium 5dr', 'mileage': 66702, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2209, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-01-30', 'fuel': 'Diesel', 'motExpiry': '2025-12-23', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/484ccb58-6c9b-4691-b5ca-4365f92b3bb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/88e7da73-2698-4a2f-b059-71bb4e81455a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/c517a117-6812-4e33-8e5d-ee99a232ea86_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/af80484a-ae3b-4b03-97d4-bbfd66b3011e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/b35206e2-bdd5-4e51-866a-eb9a31a243f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/482c8f48-cc63-43d2-a346-449dc296e8cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/91f01363-fe78-4ff5-bf72-ecfccd4fd087_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/0e297c1d-9057-446a-a425-305eddea53c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/2bf691cb-9d2a-4667-ad4b-56671d7a34a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD66OPJ/2025-12-01/image/173de4f2-8985-4ffa-92e8-8e9fe0e61c04_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/19 17K - 06/21 31K - 07/22 40K - 08/23 48K - 08/23 48K - 07/24 54K - 08/25 64K', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 36K, 44K, 50K, 58K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b8b6ddb-80ca-45f4-86a8-7ddde24d82dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22c29a90-5490-53d7-8fb7-2dc8c9f22a7f with identifier: 117609113
2025-12-02 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22c29a90-5490-53d7-8fb7-2dc8c9f22a7f with scrape type 2
2025-12-02 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22c29a90-5490-53d7-8fb7-2dc8c9f22a7f with scrape type 2
2025-12-02 19:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 22c29a90-5490-53d7-8fb7-2dc8c9f22a7f, identifier: 117609113
2025-12-02 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17LLM/2025-12-02/image/7fc5f18a-90c0-4176-a586-ba7ee8c1dd94_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663808?view=catalogue)
2025-12-02 19:01:58 [astonbarclay.gb] INFO: Found listing with ID: 117215946
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215946%27 HTTP/1.1" 200 None
2025-12-02 19:01:58 [astonbarclay.gb] INFO: Scrape type for 117215946: 2
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252F9cfc69fe-c39f-47e1-a181-dc905732ce18_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/9cfc69fe-c39f-47e1-a181-dc905732ce18_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117590132?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 21f77570-0fd2-5628-8213-5b7a3847e873 with identifier: 117609158
2025-12-02 19:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 21f77570-0fd2-5628-8213-5b7a3847e873 with identifier: 117609158
2025-12-02 19:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 21f77570-0fd2-5628-8213-5b7a3847e873 with identifier: 117609158 to the API
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2721f77570-0fd2-5628-8213-5b7a3847e873%27 HTTP/1.1" 200 None
2025-12-02 19:01:58 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 21f77570-0fd2-5628-8213-5b7a3847e873: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:01:57 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117609158?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '21f77570-0fd2-5628-8213-5b7a3847e873',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ML69UPW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609158',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLE DIESEL ESTATE',
 'odometer': 51815,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-30',
 'seller_name': 'Gates Group',
 'title': 'MERCEDES-BENZ GLE DIESEL ESTATE GLE 300d 4Matic AMG Line 5dr '
          '9G-Tronic [7 Seat]',
 'transmission': 'automatic',
 'trim': 'GLE 300d 4Matic AMG Line 5dr 9G-Tronic [7 Seat]',
 'vin': None,
 'year': 2019}
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609158%27 HTTP/1.1" 200 None
2025-12-02 19:01:58 [astonbarclay.gb] INFO: Saving data for 117609158: {'auction_closing_time': 1764756000.0, 'created_time': 1764356624.949103, 'last_price_update_time': 1764702118.982383}
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117609158') HTTP/1.1" 204 0
2025-12-02 19:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 22c29a90-5490-53d7-8fb7-2dc8c9f22a7f with identifier: 117609113
2025-12-02 19:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 22c29a90-5490-53d7-8fb7-2dc8c9f22a7f with identifier: 117609113
2025-12-02 19:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 22c29a90-5490-53d7-8fb7-2dc8c9f22a7f with identifier: 117609113 to the API
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2722c29a90-5490-53d7-8fb7-2dc8c9f22a7f%27 HTTP/1.1" 200 None
2025-12-02 19:01:59 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 22c29a90-5490-53d7-8fb7-2dc8c9f22a7f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:01:58 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117609113?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '22c29a90-5490-53d7-8fb7-2dc8c9f22a7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LD66OPJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609113',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS DIESEL HATCHBACK',
 'odometer': 66702,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-30',
 'seller_name': 'Gates Group',
 'title': 'FORD FOCUS DIESEL HATCHBACK 1.5 TDCi 120 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi 120 Titanium 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609113%27 HTTP/1.1" 200 None
2025-12-02 19:01:59 [astonbarclay.gb] INFO: Saving data for 117609113: {'auction_closing_time': 1764756000.0, 'created_time': 1764356622.55015, 'last_price_update_time': 1764702119.270644}
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117609113') HTTP/1.1" 204 0
2025-12-02 19:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0667790>
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252Faf60633e-d94e-467f-a62f-e5337a858e03_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/af60633e-d94e-467f-a62f-e5337a858e03_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03fbf50>
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F97df7d72-ce40-4bb2-b103-9c92474169af_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/97df7d72-ce40-4bb2-b103-9c92474169af_removebg.jpg?w=600 saved to cache
2025-12-02 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:01:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117590147, 'registration': 'EJ17KVF', 'account': 'GAT021', 'make': 'FORD', 'model': 'EDGE VIGNALE DIESEL ESTATE', 'derivative': '2.0 TDCi 210 5dr Powershift', 'mileage': 61007, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2208, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-05-06', 'fuel': 'Diesel', 'motExpiry': '2026-02-10', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/e4fd6932-6800-4517-a6fc-e9962cec5f27_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/58d640c9-bf77-4f8a-93e3-eb2b577b6cce_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/a0422895-08e1-4cb8-af1e-532011321263_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/ddcbe145-2bab-450c-8aac-c0f22fcd4c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/1eae0c49-67fc-4fad-8850-172212f72657_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/f1f91a74-f1ab-4329-9e79-215e1f8c2aec_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/b7e4b5bb-7d1e-49d5-a18b-dbd877c9a634_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/63a70c7c-4498-40a1-a276-338deb679d87_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/9ae68dc0-5d42-47a1-a269-b289020fd146_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/19 25K - 02/20 31K - 02/22 45K - 01/24 55K - 01/25 57K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 45K, 51K, 55K, 57K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/723ad96f-38e1-4e4c-a601-a44cc5814ba9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117590147, 'registration': 'EJ17KVF', 'account': 'GAT021', 'make': 'FORD', 'model': 'EDGE VIGNALE DIESEL ESTATE', 'derivative': '2.0 TDCi 210 5dr Powershift', 'mileage': 61007, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2208, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-05-06', 'fuel': 'Diesel', 'motExpiry': '2026-02-10', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/e4fd6932-6800-4517-a6fc-e9962cec5f27_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/58d640c9-bf77-4f8a-93e3-eb2b577b6cce_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/a0422895-08e1-4cb8-af1e-532011321263_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/ddcbe145-2bab-450c-8aac-c0f22fcd4c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/1eae0c49-67fc-4fad-8850-172212f72657_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/f1f91a74-f1ab-4329-9e79-215e1f8c2aec_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/b7e4b5bb-7d1e-49d5-a18b-dbd877c9a634_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/63a70c7c-4498-40a1-a276-338deb679d87_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ17KVF/2025-11-28/image/9ae68dc0-5d42-47a1-a269-b289020fd146_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/19 25K - 02/20 31K - 02/22 45K - 01/24 55K - 01/25 57K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 45K, 51K, 55K, 57K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/723ad96f-38e1-4e4c-a601-a44cc5814ba9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97a4bb02-669a-5243-b6e6-6873acdba7c0 with identifier: 117590147
2025-12-02 19:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97a4bb02-669a-5243-b6e6-6873acdba7c0 with scrape type 2
2025-12-02 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97a4bb02-669a-5243-b6e6-6873acdba7c0 with scrape type 2
2025-12-02 19:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 97a4bb02-669a-5243-b6e6-6873acdba7c0, identifier: 117590147
2025-12-02 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/cfecf107-c04c-4436-9e90-32c5561a85cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF66YDO/2025-12-02/image/8f0bcd69-60ab-464f-b50f-de3897b191ff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117642583?view=catalogue)
2025-12-02 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/2fc081c2-f9cd-4e23-bd71-3851e4406f12_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue)
2025-12-02 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117515973?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 97a4bb02-669a-5243-b6e6-6873acdba7c0 with identifier: 117590147
2025-12-02 19:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 97a4bb02-669a-5243-b6e6-6873acdba7c0 with identifier: 117590147
2025-12-02 19:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 97a4bb02-669a-5243-b6e6-6873acdba7c0 with identifier: 117590147 to the API
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117590147?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '97a4bb02-669a-5243-b6e6-6873acdba7c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EJ17KVF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117590147',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'EDGE VIGNALE DIESEL ESTATE',
 'odometer': 61007,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-06',
 'seller_name': 'Gates Group',
 'title': 'FORD EDGE VIGNALE DIESEL ESTATE 2.0 TDCi 210 5dr Powershift',
 'transmission': 'automatic',
 'trim': '2.0 TDCi 210 5dr Powershift',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590147%27 HTTP/1.1" 200 None
2025-12-02 19:02:00 [astonbarclay.gb] INFO: Saving data for 117590147: {'auction_closing_time': 1764756000.0, 'created_time': 1764356601.78165, 'last_price_update_time': 1764702120.20892}
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117590147') HTTP/1.1" 204 0
2025-12-02 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06ac7d0>
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252Fe99ee64f-3f2b-4b37-93e8-37f6370fb50b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/e99ee64f-3f2b-4b37-93e8-37f6370fb50b_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa36cd5a-98a8-58ce-9bca-476386eec90c
2025-12-02 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17LLM/2025-12-02/image/01367e53-d5b8-4409-8074-8f3b54f92422_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663808?view=catalogue)
2025-12-02 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117507636
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507636%27 HTTP/1.1" 200 None
2025-12-02 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117507636: 2
2025-12-02 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08f80d0>
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSG17EWY%252F2025-12-02%252Fimage%252F60f7bafd-5edb-400d-8c2f-75fb7f163fdd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SG17EWY/2025-12-02/image/60f7bafd-5edb-400d-8c2f-75fb7f163fdd_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 011c1c6f-5de6-51be-aa12-9540efc6211e
2025-12-02 19:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 011c1c6f-5de6-51be-aa12-9540efc6211e, skipping ID generation
2025-12-02 19:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 011c1c6f-5de6-51be-aa12-9540efc6211e with scrape type 1
2025-12-02 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 011c1c6f-5de6-51be-aa12-9540efc6211e from tracking dictionaries
2025-12-02 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 011c1c6f-5de6-51be-aa12-9540efc6211e sending to next pipeline
2025-12-02 19:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 011c1c6f-5de6-51be-aa12-9540efc6211e, identifier: 117639808
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06ce010>
2025-12-02 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F3aad8e9d-89ba-4d1e-a915-cbe745892c2d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/3aad8e9d-89ba-4d1e-a915-cbe745892c2d_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07fe290>
2025-12-02 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_11.jpg HTTP/1.1" 201 0
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVK18HKV%252F2025-12-02%252Fimage%252F79569779-0a7c-4cb3-999c-caa52afde85b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VK18HKV/2025-12-02/image/79569779-0a7c-4cb3-999c-caa52afde85b_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4ad2289b-de47-5f0c-a95e-00230942d029
2025-12-02 19:02:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ad2289b-de47-5f0c-a95e-00230942d029, skipping ID generation
2025-12-02 19:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad2289b-de47-5f0c-a95e-00230942d029 with scrape type 1
2025-12-02 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4ad2289b-de47-5f0c-a95e-00230942d029 from tracking dictionaries
2025-12-02 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ad2289b-de47-5f0c-a95e-00230942d029 sending to next pipeline
2025-12-02 19:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4ad2289b-de47-5f0c-a95e-00230942d029, identifier: 117662789
2025-12-02 19:02:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117590106, 'registration': 'EF66GNP', 'account': 'GAT013', 'make': 'FORD', 'model': 'FOCUS RS HATCHBACK', 'derivative': '2.3 EcoBoost 5dr', 'mileage': 38173, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2203, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-01-14', 'fuel': 'Petrol', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': 2261, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF66GNP/2025-11-28/image/b82bed1c-74c6-4502-bb88-888e5c0a9acd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/f3f661f4-6889-4ba8-a0cd-c54c4980a9cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/9304f936-b6ef-415f-ac22-82d56b00f29f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/d6eb57fb-efef-42cd-b1ed-4f661dde44d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/7253ce06-f2b3-47e7-bfe6-3336fd39b470_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/7d23e757-7694-4bf7-9458-bf2152b7300d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/60b9147f-5693-4eb8-b654-cd70e4355953_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/6cb39757-c4fa-45c5-81b8-e3b9cb61e7ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/8ee06130-4ebf-4e9c-bd27-c3c31e7c2641_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES, 33K, 35K, 36K, 37K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 175, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ccc5c0dc-364f-4712-af57-2ff8d2b2f8b9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117590106, 'registration': 'EF66GNP', 'account': 'GAT013', 'make': 'FORD', 'model': 'FOCUS RS HATCHBACK', 'derivative': '2.3 EcoBoost 5dr', 'mileage': 38173, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2203, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-01-14', 'fuel': 'Petrol', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': 2261, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF66GNP/2025-11-28/image/b82bed1c-74c6-4502-bb88-888e5c0a9acd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/f3f661f4-6889-4ba8-a0cd-c54c4980a9cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/9304f936-b6ef-415f-ac22-82d56b00f29f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/d6eb57fb-efef-42cd-b1ed-4f661dde44d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/7253ce06-f2b3-47e7-bfe6-3336fd39b470_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/7d23e757-7694-4bf7-9458-bf2152b7300d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/60b9147f-5693-4eb8-b654-cd70e4355953_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/6cb39757-c4fa-45c5-81b8-e3b9cb61e7ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF66GNP/2025-11-28/image/8ee06130-4ebf-4e9c-bd27-c3c31e7c2641_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES, 33K, 35K, 36K, 37K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 175, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ccc5c0dc-364f-4712-af57-2ff8d2b2f8b9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fa9ceac-3c9b-554c-9708-60243cfca0dd with identifier: 117590106
2025-12-02 19:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fa9ceac-3c9b-554c-9708-60243cfca0dd with scrape type 2
2025-12-02 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fa9ceac-3c9b-554c-9708-60243cfca0dd with scrape type 2
2025-12-02 19:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3fa9ceac-3c9b-554c-9708-60243cfca0dd, identifier: 117590106
2025-12-02 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL17KPN/2025-12-02/image/0d55c81d-84d1-42d6-8cb6-64da9ba8da99_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117645160?view=catalogue)
2025-12-02 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DX66TBV/2025-12-02/image/87e96be2-7866-41e4-a134-655580bbc2f3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663364?view=catalogue)
2025-12-02 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116674717?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 011c1c6f-5de6-51be-aa12-9540efc6211e with identifier: 117639808
2025-12-02 19:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 011c1c6f-5de6-51be-aa12-9540efc6211e with identifier: 117639808
2025-12-02 19:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 011c1c6f-5de6-51be-aa12-9540efc6211e with identifier: 117639808 to the API
2025-12-02 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SG17EWY/2025-12-02/image/60f7bafd-5edb-400d-8c2f-75fb7f163fdd_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '011c1c6f-5de6-51be-aa12-9540efc6211e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SG17EWY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117639808',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A4 SALOON',
 'odometer': 88952,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26408,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/ba9f8290-6de8-44ce-ab53-ddddeb51c8ec_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26846,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/e3b5e61a-7431-4afd-af7d-213397d32805_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27543,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/723ab968-2d3f-45f0-9168-0a5495c2d280_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26972,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/51278498-0d86-4f93-8d0b-1cde3b7b57cd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46896,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/60f7bafd-5edb-400d-8c2f-75fb7f163fdd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78706,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/1abeef99-a9af-4ade-8ab1-27b4b4ae797e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45794,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/99781c7f-d14b-4c91-a284-f4031f5b8716_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35104,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/6c4f1892-50f9-416f-942f-f66f087c8d9e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46742,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/05efa839-8afc-401f-a978-5a9ab1b2aa38_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011c1c6f-5de6-51be-aa12-9540efc6211e/011c1c6f-5de6-51be-aa12-9540efc6211e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77177,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/SG17EWY/2025-12-02/image/09cb1655-c285-475a-8fb1-ae01397322d5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': 'UKCGR - Premium',
 'title': 'AUDI A4 SALOON 1.4T FSI Sport 4dr',
 'transmission': 'manual',
 'trim': '1.4T FSI Sport 4dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639808%27 HTTP/1.1" 200 None
2025-12-02 19:02:02 [astonbarclay.gb] INFO: Saving data for 117639808: {'created_time': 1764702122.247129, 'last_price_update_time': 1764702122.24714, 'auction_closing_time': 1764756000.0}
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117639808') HTTP/1.1" 204 0
2025-12-02 19:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4ad2289b-de47-5f0c-a95e-00230942d029 with identifier: 117662789
2025-12-02 19:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4ad2289b-de47-5f0c-a95e-00230942d029 with identifier: 117662789
2025-12-02 19:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152925 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152925
2025-12-02 19:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4ad2289b-de47-5f0c-a95e-00230942d029 spider: astonbarclay.gb
2025-12-02 19:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4ad2289b-de47-5f0c-a95e-00230942d029 due to rule: high_mileage_for_country.json, error: 152925 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152925
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '4ad2289b-de47-5f0c-a95e-00230942d029',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VK18HKV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662789',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 95024,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32498,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/abc41b92-b014-4717-8dea-b02793df9c2e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36414,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/17c20128-4619-465f-8a52-f33b39277578_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37675,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/30b3c443-9c0b-4174-8f7c-24cc9091b753_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36613,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/99ac4343-0099-439f-ae2c-751268e38d0d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59507,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1e2ed9ad-e92a-4cd2-bf43-cfd151892995_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45414,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/548f717c-a2ea-4b05-886e-bd57d50e7da7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39095,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1adb5a1e-d0cf-49aa-ac98-4f49d8f23139_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54546,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1ca35411-ba88-46d5-9fb5-8d6de66fbc3d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49178,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/ce44da85-dc4b-40ea-8001-3626f9e02071_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47951,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/d9eaeff8-f4fa-4903-8de7-841427d7bf2c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61451,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/af60633e-d94e-467f-a62f-e5337a858e03_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2289b-de47-5f0c-a95e-00230942d029/4ad2289b-de47-5f0c-a95e-00230942d029_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107876,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/79569779-0a7c-4cb3-999c-caa52afde85b_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': 'CarGiant',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 116d SE Business 5dr '
          '[Nav/Servotronic]',
 'transmission': 'manual',
 'trim': '116d SE Business 5dr [Nav/Servotronic]',
 'vin': None,
 'year': 2018}
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662789%27 HTTP/1.1" 200 None
2025-12-02 19:02:02 [astonbarclay.gb] INFO: Saving data for 117662789: {'created_time': 1764702122.476574, 'last_price_update_time': 1764702122.476585, 'auction_closing_time': 1764756000.0}
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662789') HTTP/1.1" 204 0
2025-12-02 19:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3fa9ceac-3c9b-554c-9708-60243cfca0dd with identifier: 117590106
2025-12-02 19:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3fa9ceac-3c9b-554c-9708-60243cfca0dd with identifier: 117590106
2025-12-02 19:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3fa9ceac-3c9b-554c-9708-60243cfca0dd with identifier: 117590106 to the API
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117590106?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3fa9ceac-3c9b-554c-9708-60243cfca0dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EF66GNP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117590106',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS RS HATCHBACK',
 'odometer': 38173,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-14',
 'seller_name': 'Gates Group',
 'title': 'FORD FOCUS RS HATCHBACK 2.3 EcoBoost 5dr',
 'transmission': 'manual',
 'trim': '2.3 EcoBoost 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590106%27 HTTP/1.1" 200 None
2025-12-02 19:02:02 [astonbarclay.gb] INFO: Saving data for 117590106: {'auction_closing_time': 1764756000.0, 'created_time': 1764356642.500596, 'last_price_update_time': 1764702122.763568}
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117590106') HTTP/1.1" 204 0
2025-12-02 19:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07abc90>
2025-12-02 19:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252F7fc5f18a-90c0-4176-a586-ba7ee8c1dd94_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/7fc5f18a-90c0-4176-a586-ba7ee8c1dd94_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa36cd5a-98a8-58ce-9bca-476386eec90c
2025-12-02 19:02:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117590132, 'registration': 'KP20YUG', 'account': 'GAT001', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 83 Flair Plus 5dr', 'mileage': 64650, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2221, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-26', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KP20YUG/2025-12-01/image/f8d1759e-68ca-45ee-a3a7-f1dc33f7dee1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/93cdd414-7c41-4d14-9bb9-2c6098b51bbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/30b710da-2efd-412d-833f-9d1cd3a84575_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/2e04e44a-7dff-4dca-831b-b19aee9075b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/2250cb08-ee11-4885-aa7a-c0058ce4ff56_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/53cc86a3-2be3-4f2e-ba91-46cf242e5375_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/b3b34068-0c54-4cff-9f8a-b57a11a70c63_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/fd97593a-3fbc-4b15-8e0b-ec6c2cd60b04_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/455dcb78-6c11-476e-838b-1706b120087a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/f4904a11-9eec-45f2-abce-167ed7fbde89_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print EMPTY SERVICE BOOK - 03/25 60K', 'remarks': 'VOSA STATES, 51K, 55K, 60K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7f912753-e6c3-4850-ab2f-ac72c50960a5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117590132, 'registration': 'KP20YUG', 'account': 'GAT001', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 83 Flair Plus 5dr', 'mileage': 64650, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2221, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-26', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KP20YUG/2025-12-01/image/f8d1759e-68ca-45ee-a3a7-f1dc33f7dee1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/93cdd414-7c41-4d14-9bb9-2c6098b51bbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/30b710da-2efd-412d-833f-9d1cd3a84575_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/2e04e44a-7dff-4dca-831b-b19aee9075b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/2250cb08-ee11-4885-aa7a-c0058ce4ff56_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/53cc86a3-2be3-4f2e-ba91-46cf242e5375_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/b3b34068-0c54-4cff-9f8a-b57a11a70c63_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/fd97593a-3fbc-4b15-8e0b-ec6c2cd60b04_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/455dcb78-6c11-476e-838b-1706b120087a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP20YUG/2025-12-01/image/f4904a11-9eec-45f2-abce-167ed7fbde89_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print EMPTY SERVICE BOOK - 03/25 60K', 'remarks': 'VOSA STATES, 51K, 55K, 60K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7f912753-e6c3-4850-ab2f-ac72c50960a5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 880eb8a7-8e62-5dac-92d7-f19d05c47d02 with identifier: 117590132
2025-12-02 19:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 880eb8a7-8e62-5dac-92d7-f19d05c47d02 with scrape type 2
2025-12-02 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 880eb8a7-8e62-5dac-92d7-f19d05c47d02 with scrape type 2
2025-12-02 19:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 880eb8a7-8e62-5dac-92d7-f19d05c47d02, identifier: 117590132
2025-12-02 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17LLM/2025-12-02/image/3b0cde01-2071-4403-b0e3-7d514d8ed9ef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663808?view=catalogue)
2025-12-02 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/59497552-ffb6-4a90-b05c-089f399cbefd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117643292?view=catalogue)
2025-12-02 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117592979
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117592979%27 HTTP/1.1" 200 None
2025-12-02 19:02:03 [astonbarclay.gb] INFO: Scrape type for 117592979: 2
2025-12-02 19:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 880eb8a7-8e62-5dac-92d7-f19d05c47d02 with identifier: 117590132
2025-12-02 19:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 880eb8a7-8e62-5dac-92d7-f19d05c47d02 with identifier: 117590132
2025-12-02 19:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 880eb8a7-8e62-5dac-92d7-f19d05c47d02 with identifier: 117590132 to the API
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27880eb8a7-8e62-5dac-92d7-f19d05c47d02%27 HTTP/1.1" 200 None
2025-12-02 19:02:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 880eb8a7-8e62-5dac-92d7-f19d05c47d02: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117590132?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '880eb8a7-8e62-5dac-92d7-f19d05c47d02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KP20YUG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117590132',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'CITROEN',
 'model': 'C3 HATCHBACK',
 'odometer': 64650,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seller_name': 'Gates Group',
 'title': 'CITROEN C3 HATCHBACK 1.2 PureTech 83 Flair Plus 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 83 Flair Plus 5dr',
 'vin': None,
 'year': 2020}
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590132%27 HTTP/1.1" 200 None
2025-12-02 19:02:03 [astonbarclay.gb] INFO: Saving data for 117590132: {'auction_closing_time': 1764756000.0, 'created_time': 1764356625.561257, 'last_price_update_time': 1764702123.484106}
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117590132') HTTP/1.1" 204 0
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09cd4d0>
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252Fcfecf107-c04c-4436-9e90-32c5561a85cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/cfecf107-c04c-4436-9e90-32c5561a85cc_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04dc610>
2025-12-02 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF66YDO%252F2025-12-02%252Fimage%252F8f0bcd69-60ab-464f-b50f-de3897b191ff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF66YDO/2025-12-02/image/8f0bcd69-60ab-464f-b50f-de3897b191ff_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45b45be2-c558-5d93-9a39-071396d590cd
2025-12-02 19:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45b45be2-c558-5d93-9a39-071396d590cd, skipping ID generation
2025-12-02 19:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45b45be2-c558-5d93-9a39-071396d590cd with scrape type 1
2025-12-02 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 45b45be2-c558-5d93-9a39-071396d590cd from tracking dictionaries
2025-12-02 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45b45be2-c558-5d93-9a39-071396d590cd sending to next pipeline
2025-12-02 19:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 45b45be2-c558-5d93-9a39-071396d590cd, identifier: 117642583
2025-12-02 19:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf336cc10>
2025-12-02 19:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F2fc081c2-f9cd-4e23-bd71-3851e4406f12_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/2fc081c2-f9cd-4e23-bd71-3851e4406f12_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:02:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117515973, 'registration': 'GJ17XMO', 'account': 'CAR001', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.4 TSI 125 S 5dr', 'mileage': 161017, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2133, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-06-12', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/57688e26-ad3c-480f-870b-194b2d8e1628_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/6421c72d-72c0-4a79-afda-2b2f40f76985_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/c03d717a-9504-4a18-b067-2b83f06dbe11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/1cdbac46-1137-41a0-b357-41848d6b6e44_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/220b5c0c-3069-4104-a4da-1646e6a4c955_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/e1a6ea0b-db8e-4ba2-b485-ccc56743515b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/5c408507-a1bd-4798-bde2-e7f8241f7465_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/d45be747-f309-4580-bd16-ae7bd095b01e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES, 105K, 127K, 145K, 158K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa47ca87-0bf6-441d-a793-d9f4711420be.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117515973, 'registration': 'GJ17XMO', 'account': 'CAR001', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.4 TSI 125 S 5dr', 'mileage': 161017, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2133, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-06-12', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/57688e26-ad3c-480f-870b-194b2d8e1628_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/6421c72d-72c0-4a79-afda-2b2f40f76985_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/c03d717a-9504-4a18-b067-2b83f06dbe11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/1cdbac46-1137-41a0-b357-41848d6b6e44_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/220b5c0c-3069-4104-a4da-1646e6a4c955_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/e1a6ea0b-db8e-4ba2-b485-ccc56743515b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/5c408507-a1bd-4798-bde2-e7f8241f7465_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/d45be747-f309-4580-bd16-ae7bd095b01e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES, 105K, 127K, 145K, 158K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa47ca87-0bf6-441d-a793-d9f4711420be.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8040e1d-d9df-5738-a043-035b26f47b96 with identifier: 117515973
2025-12-02 19:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8040e1d-d9df-5738-a043-035b26f47b96 with scrape type 2
2025-12-02 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8040e1d-d9df-5738-a043-035b26f47b96 with scrape type 2
2025-12-02 19:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a8040e1d-d9df-5738-a043-035b26f47b96, identifier: 117515973
2025-12-02 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LG18XNU/2025-12-02/image/514ec32c-d084-4af5-accd-5b2b63485551_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600033?view=catalogue)
2025-12-02 19:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 45b45be2-c558-5d93-9a39-071396d590cd with identifier: 117642583
2025-12-02 19:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 45b45be2-c558-5d93-9a39-071396d590cd with identifier: 117642583
2025-12-02 19:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 45b45be2-c558-5d93-9a39-071396d590cd with identifier: 117642583 to the API
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EF66YDO/2025-12-02/image/8f0bcd69-60ab-464f-b50f-de3897b191ff_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '45b45be2-c558-5d93-9a39-071396d590cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EF66YDO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117642583',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 56528,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42708,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/a97e932b-2c6b-4687-9883-aaf9a24a0b77_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43579,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/38fcfcb0-5ba9-43ec-b8c5-e27c42df719e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42715,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/fe88614c-d9ef-44d9-90fb-845bff623ee0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46165,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/0877d3ad-36f1-450d-9f9c-0cdbdbbdd59e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49796,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/31a6b343-f334-461b-a6d9-06e385e5e97e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61735,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/d7e2af2d-785a-4a73-a287-9ced8ed4eefb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48003,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/6bae8ace-04cf-4379-91fc-29d6465fe85c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60168,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/79a2d3fe-03d4-40a0-be33-0b1f732606ac_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58603,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/4edd28df-7613-417d-a4cd-0bf8858f8c97_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b45be2-c558-5d93-9a39-071396d590cd/45b45be2-c558-5d93-9a39-071396d590cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50719,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF66YDO/2025-12-02/image/8f0bcd69-60ab-464f-b50f-de3897b191ff_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-23',
 'seller_name': 'UKCGR - Premium',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 HSE Dynamic '
          '5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 HSE Dynamic 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117642583%27 HTTP/1.1" 200 None
2025-12-02 19:02:04 [astonbarclay.gb] INFO: Saving data for 117642583: {'created_time': 1764702124.980017, 'last_price_update_time': 1764702124.98003, 'auction_closing_time': 1764756000.0}
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117642583') HTTP/1.1" 204 0
2025-12-02 19:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a8040e1d-d9df-5738-a043-035b26f47b96 with identifier: 117515973
2025-12-02 19:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a8040e1d-d9df-5738-a043-035b26f47b96 with identifier: 117515973
2025-12-02 19:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'cargiant', 'price_includes_vat': False, 'title': 'volkswagen golf hatchback 1.4 tsi 125 s 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'golf hatchback', 'transmission': 'manual', 'engine': '1.4l', 'fuel_type': 'petrol', 'odometer': 161017, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515973', 'expiration_date': '2025-12-03t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '1.4 tsi 125 s 5dr', 'license_plate': 'gj17xmo', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 120, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'a8040e1d-d9df-5738-a043-035b26f47b96', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'volkswagen golf hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 259131}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.4l',
     'expiration_date': '2025-12-03t10:00:00z',
     'fuel_type': 'petrol',
     'id': 'a8040e1d-d9df-5738-a043-035b26f47b96',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gj17xmo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515973',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen golf hatchback',
     'model': 'golf hatchback',
     'odometer': 161017,
     'odometer_in_km': 259131,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-24',
     'sanitized_make': 'volkswagen',
     'seller_name': 'cargiant',
     'title': 'volkswagen golf hatchback 1.4 tsi 125 s 5dr',
     'transmission': 'manual',
     'trim': '1.4 tsi 125 s 5dr',
     'vin': None,
     'year': 2017}
2025-12-02 19:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: a8040e1d-d9df-5738-a043-035b26f47b96 spider: astonbarclay.gb
2025-12-02 19:02:05 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a8040e1d-d9df-5738-a043-035b26f47b96 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'cargiant', 'price_includes_vat': False, 'title': 'volkswagen golf hatchback 1.4 tsi 125 s 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'golf hatchback', 'transmission': 'manual', 'engine': '1.4l', 'fuel_type': 'petrol', 'odometer': 161017, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515973', 'expiration_date': '2025-12-03t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '1.4 tsi 125 s 5dr', 'license_plate': 'gj17xmo', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 120, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'a8040e1d-d9df-5738-a043-035b26f47b96', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'volkswagen golf hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 259131}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.4l',
     'expiration_date': '2025-12-03t10:00:00z',
     'fuel_type': 'petrol',
     'id': 'a8040e1d-d9df-5738-a043-035b26f47b96',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gj17xmo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515973',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen golf hatchback',
     'model': 'golf hatchback',
     'odometer': 161017,
     'odometer_in_km': 259131,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-24',
     'sanitized_make': 'volkswagen',
     'seller_name': 'cargiant',
     'title': 'volkswagen golf hatchback 1.4 tsi 125 s 5dr',
     'transmission': 'manual',
     'trim': '1.4 tsi 125 s 5dr',
     'vin': None,
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a8040e1d-d9df-5738-a043-035b26f47b96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GJ17XMO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515973',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 161017,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-24',
 'seller_name': 'CarGiant',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.4 TSI 125 S 5dr',
 'transmission': 'manual',
 'trim': '1.4 TSI 125 S 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515973%27 HTTP/1.1" 200 None
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Saving data for 117515973: {'auction_closing_time': 1764756000.0, 'created_time': 1764184074.856442, 'last_price_update_time': 1764702125.196792}
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117515973') HTTP/1.1" 204 0
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1e52b90>
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252F01367e53-d5b8-4409-8074-8f3b54f92422_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/01367e53-d5b8-4409-8074-8f3b54f92422_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa36cd5a-98a8-58ce-9bca-476386eec90c
2025-12-02 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17LLM/2025-12-02/image/9cfc69fe-c39f-47e1-a181-dc905732ce18_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117663808?view=catalogue)
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Found listing with ID: 117596913
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117596913%27 HTTP/1.1" 200 None
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Scrape type for 117596913: 0
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Found listing with ID: 117545534
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117545534%27 HTTP/1.1" 200 None
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Scrape type for 117545534: 0
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Found listing with ID: 117535067
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117535067%27 HTTP/1.1" 200 None
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Scrape type for 117535067: 0
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Found listing with ID: 117420774
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420774%27 HTTP/1.1" 200 None
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Scrape type for 117420774: 0
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Found listing with ID: 117061078
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117061078%27 HTTP/1.1" 200 None
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Scrape type for 117061078: 0
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Found listing with ID: 117024373
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024373%27 HTTP/1.1" 200 None
2025-12-02 19:02:05 [astonbarclay.gb] INFO: Scrape type for 117024373: 2
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066b4d0>
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL17KPN%252F2025-12-02%252Fimage%252F0d55c81d-84d1-42d6-8cb6-64da9ba8da99_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL17KPN/2025-12-02/image/0d55c81d-84d1-42d6-8cb6-64da9ba8da99_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9fd9a40-7f20-5541-9707-6e049ae8e7da
2025-12-02 19:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9fd9a40-7f20-5541-9707-6e049ae8e7da, skipping ID generation
2025-12-02 19:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9fd9a40-7f20-5541-9707-6e049ae8e7da with scrape type 1
2025-12-02 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c9fd9a40-7f20-5541-9707-6e049ae8e7da from tracking dictionaries
2025-12-02 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9fd9a40-7f20-5541-9707-6e049ae8e7da sending to next pipeline
2025-12-02 19:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c9fd9a40-7f20-5541-9707-6e049ae8e7da, identifier: 117645160
2025-12-02 19:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d4f790>
2025-12-02 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_11.jpg HTTP/1.1" 201 0
2025-12-02 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDX66TBV%252F2025-12-02%252Fimage%252F87e96be2-7866-41e4-a134-655580bbc2f3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DX66TBV/2025-12-02/image/87e96be2-7866-41e4-a134-655580bbc2f3_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13
2025-12-02 19:02:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7078d07-d2a5-5ae6-a64e-05e7a6016d13, skipping ID generation
2025-12-02 19:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13 with scrape type 1
2025-12-02 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c7078d07-d2a5-5ae6-a64e-05e7a6016d13 from tracking dictionaries
2025-12-02 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7078d07-d2a5-5ae6-a64e-05e7a6016d13 sending to next pipeline
2025-12-02 19:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c7078d07-d2a5-5ae6-a64e-05e7a6016d13, identifier: 117663364
2025-12-02 19:02:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116674717, 'registration': 'EA72XPU', 'account': 'GAT019', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost ST-Line 5dr', 'mileage': 14869, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2228, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-02-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA72XPU/2025-10-27/image/6d59ce6b-a42a-44d4-9d51-1f493e848d69_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/c944c0af-5518-410c-8490-c5d8dfc1c71b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/1639dcda-1691-4a9f-bdfb-85da0681ef7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/7d5878b7-a1d5-4a80-8583-d353a2866fc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/062af1ee-8570-4b86-b625-aa7aa96e6831_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/fbc6a3c3-fbb3-40da-8044-8145a6c30fbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/30363d9c-7b98-458f-b565-6b9620534bf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/d764efcc-9bfd-45d8-8ab1-e4ec0bdebb48_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/05d532d4-883f-4352-a83c-3b808e40b00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/0ed9e36e-66ee-48d6-9f30-b53d511cc8ed_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad1540df-89e7-4422-841d-614ca3154249.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116674717, 'registration': 'EA72XPU', 'account': 'GAT019', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost ST-Line 5dr', 'mileage': 14869, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2228, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-02-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA72XPU/2025-10-27/image/6d59ce6b-a42a-44d4-9d51-1f493e848d69_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/c944c0af-5518-410c-8490-c5d8dfc1c71b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/1639dcda-1691-4a9f-bdfb-85da0681ef7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/7d5878b7-a1d5-4a80-8583-d353a2866fc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/062af1ee-8570-4b86-b625-aa7aa96e6831_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/fbc6a3c3-fbb3-40da-8044-8145a6c30fbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/30363d9c-7b98-458f-b565-6b9620534bf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/d764efcc-9bfd-45d8-8ab1-e4ec0bdebb48_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/05d532d4-883f-4352-a83c-3b808e40b00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/0ed9e36e-66ee-48d6-9f30-b53d511cc8ed_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad1540df-89e7-4422-841d-614ca3154249.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 900535d2-2611-5814-b900-1bb4692d1313 with identifier: 116674717
2025-12-02 19:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 900535d2-2611-5814-b900-1bb4692d1313 with scrape type 2
2025-12-02 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 900535d2-2611-5814-b900-1bb4692d1313 with scrape type 2
2025-12-02 19:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 900535d2-2611-5814-b900-1bb4692d1313, identifier: 116674717
2025-12-02 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67WSL/2025-12-02/image/8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507965?view=catalogue)
2025-12-02 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/c1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507988?view=catalogue)
2025-12-02 19:02:06 [scrapy.extensions.logstats] INFO: Crawled 90 pages (at 29 pages/min), scraped 39 items (at 22 items/min)
2025-12-02 19:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c9fd9a40-7f20-5541-9707-6e049ae8e7da with identifier: 117645160
2025-12-02 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:02:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FElectric+Hybrid HTTP/1.1" 200 None
2025-12-02 19:02:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c9fd9a40-7f20-5541-9707-6e049ae8e7da with identifier: 117645160
2025-12-02 19:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c9fd9a40-7f20-5541-9707-6e049ae8e7da with identifier: 117645160 to the API
2025-12-02 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FL17KPN/2025-12-02/image/0d55c81d-84d1-42d6-8cb6-64da9ba8da99_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'c9fd9a40-7f20-5541-9707-6e049ae8e7da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FL17KPN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117645160',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'NIRO ESTATE',
 'odometer': 15898,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38011,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/f2c067c8-06f9-4c78-8af4-371636b7c1d7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40822,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/d0724b01-407f-472a-87ce-ad16c59997a8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43901,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/9474a8b1-ded9-4e97-b769-a7fd427934d8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40673,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/76616079-59fe-45d0-9797-bf0ee0e5e3cf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49434,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/a54d3cf7-04ef-4a86-a752-43098b703503_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66898,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/cb57757c-d32f-4a16-ad33-e850eafa993e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46104,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/3b0b0df4-67c5-42a6-9ebc-da3c6a761621_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56931,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/50c0df84-70fe-4775-a7f7-8d5e2dfe0de9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46253,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/7d391b17-afc7-4da2-8108-b0cec42f547e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fd9a40-7f20-5541-9707-6e049ae8e7da/c9fd9a40-7f20-5541-9707-6e049ae8e7da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61334,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL17KPN/2025-12-02/image/0d55c81d-84d1-42d6-8cb6-64da9ba8da99_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-04',
 'seller_name': 'UKCGR - Premium',
 'title': 'KIA NIRO ESTATE 1.6 GDi Hybrid 3 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.6 GDi Hybrid 3 5dr DCT',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117645160%27 HTTP/1.1" 200 None
2025-12-02 19:02:07 [astonbarclay.gb] INFO: Saving data for 117645160: {'created_time': 1764702127.207919, 'last_price_update_time': 1764702127.207929, 'auction_closing_time': 1764756000.0}
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117645160') HTTP/1.1" 204 0
2025-12-02 19:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c7078d07-d2a5-5ae6-a64e-05e7a6016d13 with identifier: 117663364
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2025-12-02 19:02:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c7078d07-d2a5-5ae6-a64e-05e7a6016d13 with identifier: 117663364
2025-12-02 19:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c7078d07-d2a5-5ae6-a64e-05e7a6016d13 with identifier: 117663364 to the API
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DX66TBV/2025-12-02/image/87e96be2-7866-41e4-a134-655580bbc2f3_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c7078d07-d2a5-5ae6-a64e-05e7a6016d13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DX66TBV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117663364',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 90362,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40423,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/894b04d8-9a5d-4370-a276-c40c5cf54421_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37972,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/e7729a77-e2b1-481e-b10d-85154c4835a6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41792,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/c2ff7a06-97b9-49de-8560-58852469dc06_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35838,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/b40c5dee-e917-4ca7-a2d2-b910e49aeaa5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60652,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/13349572-a66d-486b-9c9b-9173b9f74eef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34701,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/2104af92-c472-408e-b888-0ab01bf1c895_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38895,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/8c8efd27-e24b-4ed4-9a36-b2938a1bd38d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37723,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/74ef6988-4700-452a-b483-8da6586facd7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53766,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/97df7d72-ce40-4bb2-b103-9c92474169af_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55900,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/3aad8e9d-89ba-4d1e-a915-cbe745892c2d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42094,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/cfecf107-c04c-4436-9e90-32c5561a85cc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7078d07-d2a5-5ae6-a64e-05e7a6016d13/c7078d07-d2a5-5ae6-a64e-05e7a6016d13_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48725,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DX66TBV/2025-12-02/image/87e96be2-7866-41e4-a134-655580bbc2f3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-01',
 'seller_name': 'CarGiant',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 116d M Sport 3dr [Nav]',
 'transmission': 'manual',
 'trim': '116d M Sport 3dr [Nav]',
 'vin': None,
 'year': 2016}
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117663364%27 HTTP/1.1" 200 None
2025-12-02 19:02:07 [astonbarclay.gb] INFO: Saving data for 117663364: {'created_time': 1764702127.703178, 'last_price_update_time': 1764702127.703189, 'auction_closing_time': 1764756000.0}
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117663364') HTTP/1.1" 204 0
2025-12-02 19:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 900535d2-2611-5814-b900-1bb4692d1313 with identifier: 116674717
2025-12-02 19:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 900535d2-2611-5814-b900-1bb4692d1313 with identifier: 116674717
2025-12-02 19:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 900535d2-2611-5814-b900-1bb4692d1313 with identifier: 116674717 to the API
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27900535d2-2611-5814-b900-1bb4692d1313%27 HTTP/1.1" 200 None
2025-12-02 19:02:07 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 900535d2-2611-5814-b900-1bb4692d1313: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:06 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116674717?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '900535d2-2611-5814-b900-1bb4692d1313',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA72XPU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116674717',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 14869,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-24',
 'seller_name': 'Gates Group',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost ST-Line 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116674717%27 HTTP/1.1" 200 None
2025-12-02 19:02:07 [astonbarclay.gb] INFO: Saving data for 116674717: {'auction_closing_time': 1764756000.0, 'created_time': 1761332486.83566, 'last_price_update_time': 1764702127.991407}
2025-12-02 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116674717') HTTP/1.1" 204 0
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08cc710>
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252F3b0cde01-2071-4403-b0e3-7d514d8ed9ef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/3b0cde01-2071-4403-b0e3-7d514d8ed9ef_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa36cd5a-98a8-58ce-9bca-476386eec90c
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0372a10>
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCX19KFZ%252F2025-12-02%252Fimage%252F59497552-ffb6-4a90-b05c-089f399cbefd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/59497552-ffb6-4a90-b05c-089f399cbefd_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd
2025-12-02 19:02:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f6d669f-3c5d-5b4d-88a6-7e28667084cd, skipping ID generation
2025-12-02 19:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd with scrape type 1
2025-12-02 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd from tracking dictionaries
2025-12-02 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f6d669f-3c5d-5b4d-88a6-7e28667084cd sending to next pipeline
2025-12-02 19:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9f6d669f-3c5d-5b4d-88a6-7e28667084cd, identifier: 117643292
2025-12-02 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK16VHA/2025-12-02/image/53781a91-2e19-4ff8-b24a-04a2d0b4252f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634478?view=catalogue)
2025-12-02 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WF69LTY/2025-12-02/image/ebba9d94-d048-40ae-ae2c-02dce2f59879_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue)
2025-12-02 19:02:08 [astonbarclay.gb] INFO: Found listing with ID: 117631646
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631646%27 HTTP/1.1" 200 None
2025-12-02 19:02:08 [astonbarclay.gb] INFO: Scrape type for 117631646: 1
2025-12-02 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116377459?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9f6d669f-3c5d-5b4d-88a6-7e28667084cd with identifier: 117643292
2025-12-02 19:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9f6d669f-3c5d-5b4d-88a6-7e28667084cd with identifier: 117643292
2025-12-02 19:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9f6d669f-3c5d-5b4d-88a6-7e28667084cd with identifier: 117643292 to the API
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/59497552-ffb6-4a90-b05c-089f399cbefd_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9f6d669f-3c5d-5b4d-88a6-7e28667084cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CX19KFZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117643292',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 77911,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34359,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/509da8eb-e92d-4b68-869d-a431ed1dc35f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35799,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/6016ece5-6d6c-4401-b62e-f90bfa35405f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37494,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/a1aab6a2-08c1-4c0b-8052-e7a16c6749d3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35325,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/0c58c09a-7dc8-4485-bbf1-a40e20c14209_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41587,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/de7affdb-fdea-4875-b773-400807de5351_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55210,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/498b946f-dddd-4b9d-826c-2079277a0f5d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109485,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/59497552-ffb6-4a90-b05c-089f399cbefd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49886,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/9403cec6-456e-4912-bea9-e8d744e8d9f8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43089,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/7d1ed69c-7ccd-4fe3-9224-f71cae19918a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45076,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/2fc081c2-f9cd-4e23-bd71-3851e4406f12_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6d669f-3c5d-5b4d-88a6-7e28667084cd/9f6d669f-3c5d-5b4d-88a6-7e28667084cd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32902,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/CX19KFZ/2025-12-02/image/8f635196-23e7-4804-8ee6-6d291cfbc345_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-01',
 'seller_name': 'UKCGR - Premium',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 HSE Dynamic '
          '5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 HSE Dynamic 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117643292%27 HTTP/1.1" 200 None
2025-12-02 19:02:09 [astonbarclay.gb] INFO: Saving data for 117643292: {'created_time': 1764702129.017328, 'last_price_update_time': 1764702129.017339, 'auction_closing_time': 1764756000.0}
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117643292') HTTP/1.1" 204 0
2025-12-02 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06e2b90>
2025-12-02 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLG18XNU%252F2025-12-02%252Fimage%252F514ec32c-d084-4af5-accd-5b2b63485551_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LG18XNU/2025-12-02/image/514ec32c-d084-4af5-accd-5b2b63485551_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac
2025-12-02 19:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b091cd87-d12e-5c8f-9314-65e89b8dc3ac, skipping ID generation
2025-12-02 19:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac with scrape type 1
2025-12-02 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b091cd87-d12e-5c8f-9314-65e89b8dc3ac from tracking dictionaries
2025-12-02 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b091cd87-d12e-5c8f-9314-65e89b8dc3ac sending to next pipeline
2025-12-02 19:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b091cd87-d12e-5c8f-9314-65e89b8dc3ac, identifier: 117600033
2025-12-02 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX69OMA/2025-12-02/image/5869601d-16f8-4079-b6f5-fb53fd74ee3c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634427?view=catalogue)
2025-12-02 19:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117455255?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117245171?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b091cd87-d12e-5c8f-9314-65e89b8dc3ac with identifier: 117600033
2025-12-02 19:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b091cd87-d12e-5c8f-9314-65e89b8dc3ac with identifier: 117600033
2025-12-02 19:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b091cd87-d12e-5c8f-9314-65e89b8dc3ac with identifier: 117600033 to the API
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LG18XNU/2025-12-02/image/514ec32c-d084-4af5-accd-5b2b63485551_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'b091cd87-d12e-5c8f-9314-65e89b8dc3ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LG18XNU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600033',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FIAT',
 'model': '500 HATCHBACK',
 'odometer': 53009,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31428,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/514ec32c-d084-4af5-accd-5b2b63485551_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32934,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/36eab235-5216-4ff7-b08c-64ea7e7dc5bf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32963,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/0db97c86-0e25-4dab-ba9b-9bf0306f70c9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31171,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/ef0963f0-8c1c-44d1-a99f-63c58ea64049_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76062,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/58f39e7f-9914-4196-9253-2b99e603c9fd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42146,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/d731dbf0-8ef8-443e-afb2-7a9b2feb19a0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57135,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/1d649000-b062-4b26-9035-2de748b37738_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40838,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/e1a8cede-7758-49aa-bad4-bae423261dff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b091cd87-d12e-5c8f-9314-65e89b8dc3ac/b091cd87-d12e-5c8f-9314-65e89b8dc3ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39006,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LG18XNU/2025-12-02/image/fe521320-6e60-4dc2-b4a0-a4b7dd7f440f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-28',
 'seller_name': 'Wilsons',
 'title': 'FIAT 500 HATCHBACK 1.2 Pop 3dr',
 'transmission': 'manual',
 'trim': '1.2 Pop 3dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600033%27 HTTP/1.1" 200 None
2025-12-02 19:02:09 [astonbarclay.gb] INFO: Saving data for 117600033: {'created_time': 1764702129.760376, 'last_price_update_time': 1764702129.760387, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117600033') HTTP/1.1" 204 0
2025-12-02 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf051dad0>
2025-12-02 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17LLM%252F2025-12-02%252Fimage%252F9cfc69fe-c39f-47e1-a181-dc905732ce18_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17LLM/2025-12-02/image/9cfc69fe-c39f-47e1-a181-dc905732ce18_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa36cd5a-98a8-58ce-9bca-476386eec90c
2025-12-02 19:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa36cd5a-98a8-58ce-9bca-476386eec90c, skipping ID generation
2025-12-02 19:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa36cd5a-98a8-58ce-9bca-476386eec90c with scrape type 1
2025-12-02 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aa36cd5a-98a8-58ce-9bca-476386eec90c from tracking dictionaries
2025-12-02 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa36cd5a-98a8-58ce-9bca-476386eec90c sending to next pipeline
2025-12-02 19:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aa36cd5a-98a8-58ce-9bca-476386eec90c, identifier: 117663808
2025-12-02 19:02:10 [astonbarclay.gb] INFO: Found listing with ID: 117522663
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117522663%27 HTTP/1.1" 200 None
2025-12-02 19:02:10 [astonbarclay.gb] INFO: Scrape type for 117522663: 2
2025-12-02 19:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116509919?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aa36cd5a-98a8-58ce-9bca-476386eec90c with identifier: 117663808
2025-12-02 19:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aa36cd5a-98a8-58ce-9bca-476386eec90c with identifier: 117663808
2025-12-02 19:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: aa36cd5a-98a8-58ce-9bca-476386eec90c with identifier: 117663808 to the API
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EK17LLM/2025-12-02/image/9cfc69fe-c39f-47e1-a181-dc905732ce18_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'aa36cd5a-98a8-58ce-9bca-476386eec90c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK17LLM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117663808',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'TUCSON DIESEL ESTATE',
 'odometer': 67586,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39599,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/26776408-5143-4ddc-b685-0606ed23af97_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42245,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/f6cf3a44-c791-4de0-9d0c-2b2bda78386c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40168,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/c3d16984-fdc8-4d4d-8acb-4b688a1e81e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40552,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/b43fe5dd-e0cf-4ba0-af79-f17ed2659bb3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38410,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/e99ee64f-3f2b-4b37-93e8-37f6370fb50b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56154,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/7fc5f18a-90c0-4176-a586-ba7ee8c1dd94_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46643,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/01367e53-d5b8-4409-8074-8f3b54f92422_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45250,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/3b0cde01-2071-4403-b0e3-7d514d8ed9ef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa36cd5a-98a8-58ce-9bca-476386eec90c/aa36cd5a-98a8-58ce-9bca-476386eec90c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43796,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17LLM/2025-12-02/image/9cfc69fe-c39f-47e1-a181-dc905732ce18_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-27',
 'seller_name': 'CarGiant',
 'title': 'HYUNDAI TUCSON DIESEL ESTATE 1.7 CRDi Blue Drive SE 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.7 CRDi Blue Drive SE 5dr 2WD',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117663808%27 HTTP/1.1" 200 None
2025-12-02 19:02:10 [astonbarclay.gb] INFO: Saving data for 117663808: {'created_time': 1764702130.560684, 'last_price_update_time': 1764702130.560695, 'auction_closing_time': 1764756000.0}
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117663808') HTTP/1.1" 204 0
2025-12-02 19:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0956490>
2025-12-02 19:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67WSL%252F2025-12-02%252Fimage%252F8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67WSL/2025-12-02/image/8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddf82103-8962-573a-a369-6a474c10af32
2025-12-02 19:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddf82103-8962-573a-a369-6a474c10af32, skipping ID generation
2025-12-02 19:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddf82103-8962-573a-a369-6a474c10af32 with scrape type 1
2025-12-02 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ddf82103-8962-573a-a369-6a474c10af32 from tracking dictionaries
2025-12-02 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ddf82103-8962-573a-a369-6a474c10af32 sending to next pipeline
2025-12-02 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ddf82103-8962-573a-a369-6a474c10af32, identifier: 117507965
2025-12-02 19:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf093efd0>
2025-12-02 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16PZZ%252F2025-12-02%252Fimage%252Fc1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/c1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 357b359d-a312-5739-8e8e-89d273bf3234
2025-12-02 19:02:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 357b359d-a312-5739-8e8e-89d273bf3234, skipping ID generation
2025-12-02 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 357b359d-a312-5739-8e8e-89d273bf3234 with scrape type 1
2025-12-02 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 357b359d-a312-5739-8e8e-89d273bf3234 from tracking dictionaries
2025-12-02 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 357b359d-a312-5739-8e8e-89d273bf3234 sending to next pipeline
2025-12-02 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 357b359d-a312-5739-8e8e-89d273bf3234, identifier: 117507988
2025-12-02 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19EOB/2025-12-02/image/96e1bdc1-e777-490e-8d10-8846db4f4257_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue)
2025-12-02 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD70MVG/2025-12-02/image/55b525a7-1d87-475a-a34c-015eb1c9d665_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue)
2025-12-02 19:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116409684?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116859641?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ddf82103-8962-573a-a369-6a474c10af32 with identifier: 117507965
2025-12-02 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ddf82103-8962-573a-a369-6a474c10af32 with identifier: 117507965
2025-12-02 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 11, 'seller_name': 'wilsons', 'price_includes_vat': False, 'title': 'bmw i3 hatchback 125kw 33kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i3 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 69400, 'odometer_reading_unit': 'mi', 'registration_date': '2017-11-17', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507965', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '125kw 33kwh 5dr auto', 'license_plate': 'ky67wsl', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ddf82103-8962-573a-a369-6a474c10af32', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29073}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31749}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34333}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30544}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 76093}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 69650}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/b8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54071}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54876}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36605}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33532}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27799}], 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'bmw i3 hatchback', 'sanitized_make': 'bmw', 'odometer_in_km': 111688} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': 'ddf82103-8962-573a-a369-6a474c10af32',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ky67wsl',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507965',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'bmw',
     'make_model': 'bmw i3 hatchback',
     'model': 'i3 hatchback',
     'odometer': 69400,
     'odometer_in_km': 111688,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 11,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29073,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31749,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34333,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30544,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76093,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69650,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54071,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/b8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54876,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36605,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33532,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27799,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-11-17',
     'sanitized_make': 'bmw',
     'seller_name': 'wilsons',
     'title': 'bmw i3 hatchback 125kw 33kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '125kw 33kwh 5dr auto',
     'vin': None,
     'year': 2017}
2025-12-02 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: ddf82103-8962-573a-a369-6a474c10af32 spider: astonbarclay.gb
2025-12-02 19:02:11 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ddf82103-8962-573a-a369-6a474c10af32 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 11, 'seller_name': 'wilsons', 'price_includes_vat': False, 'title': 'bmw i3 hatchback 125kw 33kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i3 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 69400, 'odometer_reading_unit': 'mi', 'registration_date': '2017-11-17', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507965', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '125kw 33kwh 5dr auto', 'license_plate': 'ky67wsl', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ddf82103-8962-573a-a369-6a474c10af32', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29073}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31749}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34333}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30544}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 76093}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 69650}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/b8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54071}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54876}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36605}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33532}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27799}], 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'bmw i3 hatchback', 'sanitized_make': 'bmw', 'odometer_in_km': 111688} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': 'ddf82103-8962-573a-a369-6a474c10af32',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ky67wsl',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507965',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'bmw',
     'make_model': 'bmw i3 hatchback',
     'model': 'i3 hatchback',
     'odometer': 69400,
     'odometer_in_km': 111688,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 11,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29073,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31749,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34333,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30544,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76093,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69650,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54071,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/b8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54876,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36605,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33532,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27799,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-11-17',
     'sanitized_make': 'bmw',
     'seller_name': 'wilsons',
     'title': 'bmw i3 hatchback 125kw 33kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '125kw 33kwh 5dr auto',
     'vin': None,
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'ddf82103-8962-573a-a369-6a474c10af32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KY67WSL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507965',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'BMW',
 'model': 'I3 HATCHBACK',
 'odometer': 69400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29073,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/8ad8d44a-38ed-4b11-9c59-5ec5214ac9f8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31749,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/2d9654be-4b01-4f0f-b68e-929127cb3e72_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34333,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/1726ae59-355e-4a46-a6f7-dbd89d866676_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30544,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d6732360-fa71-4c16-a5a9-26d89b313456_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76093,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c2bb3633-804e-435c-8c7b-efb0bbf11a0f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69650,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/68cf0a1b-4342-4ca6-aa97-c1ee70214876_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54071,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/b8c665de-48c6-417b-aee3-f4b3b02a3f22_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54876,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/d666470c-a595-46f3-a580-c2a912c39fd1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36605,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/77c9d157-d603-464e-8a1c-0488e0a6e334_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33532,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/c964c6d8-5917-46e8-9a50-55193a2b1a8a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddf82103-8962-573a-a369-6a474c10af32/ddf82103-8962-573a-a369-6a474c10af32_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27799,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67WSL/2025-12-02/image/6c6a9266-40c4-4cd2-a78b-95c66c5e80c6_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-17',
 'seller_name': 'Wilsons',
 'title': 'BMW I3 HATCHBACK 125kW 33kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '125kW 33kWh 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507965%27 HTTP/1.1" 200 None
2025-12-02 19:02:11 [astonbarclay.gb] INFO: Saving data for 117507965: {'created_time': 1764702131.680316, 'last_price_update_time': 1764702131.680326, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507965') HTTP/1.1" 204 0
2025-12-02 19:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 357b359d-a312-5739-8e8e-89d273bf3234 with identifier: 117507988
2025-12-02 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 357b359d-a312-5739-8e8e-89d273bf3234 with identifier: 117507988
2025-12-02 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 11, 'seller_name': 'wilsons', 'price_includes_vat': False, 'title': 'bmw i3 hatchback 125kw 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i3 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 40333, 'odometer_reading_unit': 'mi', 'registration_date': '2016-04-22', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507988', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '125kw 5dr auto', 'license_plate': 'hn16pzz', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '357b359d-a312-5739-8e8e-89d273bf3234', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/c1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27741}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/cb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33158}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30445}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28096}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 77149}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 84291}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52718}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/d22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36809}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38828}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39239}], 'current_year_diff': 9, 'age_in_months': 115, 'make_model': 'bmw i3 hatchback', 'sanitized_make': 'bmw', 'odometer_in_km': 64909} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 115,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': '357b359d-a312-5739-8e8e-89d273bf3234',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'hn16pzz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507988',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'bmw',
     'make_model': 'bmw i3 hatchback',
     'model': 'i3 hatchback',
     'odometer': 40333,
     'odometer_in_km': 64909,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 11,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27741,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/c1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33158,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/cb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30445,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28096,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 77149,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 84291,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52718,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48035,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36809,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/d22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38828,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39239,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-04-22',
     'sanitized_make': 'bmw',
     'seller_name': 'wilsons',
     'title': 'bmw i3 hatchback 125kw 5dr auto',
     'transmission': 'automatic',
     'trim': '125kw 5dr auto',
     'vin': None,
     'year': 2016}
2025-12-02 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 357b359d-a312-5739-8e8e-89d273bf3234 spider: astonbarclay.gb
2025-12-02 19:02:11 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 357b359d-a312-5739-8e8e-89d273bf3234 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 11, 'seller_name': 'wilsons', 'price_includes_vat': False, 'title': 'bmw i3 hatchback 125kw 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i3 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 40333, 'odometer_reading_unit': 'mi', 'registration_date': '2016-04-22', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507988', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '125kw 5dr auto', 'license_plate': 'hn16pzz', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '357b359d-a312-5739-8e8e-89d273bf3234', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/c1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27741}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/cb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33158}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30445}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28096}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 77149}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg?w=600', 'Width': 600, 'Height': 800, 'Extension': 'jpg', 'FileSizeInBytes': 84291}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52718}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/d22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36809}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38828}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39239}], 'current_year_diff': 9, 'age_in_months': 115, 'make_model': 'bmw i3 hatchback', 'sanitized_make': 'bmw', 'odometer_in_km': 64909} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 115,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': '357b359d-a312-5739-8e8e-89d273bf3234',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'hn16pzz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507988',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'bmw',
     'make_model': 'bmw i3 hatchback',
     'model': 'i3 hatchback',
     'odometer': 40333,
     'odometer_in_km': 64909,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 11,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27741,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/c1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33158,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/cb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30445,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28096,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 77149,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 84291,
                 'Height': 800,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52718,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48035,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36809,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/d22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38828,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39239,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-04-22',
     'sanitized_make': 'bmw',
     'seller_name': 'wilsons',
     'title': 'bmw i3 hatchback 125kw 5dr auto',
     'transmission': 'automatic',
     'trim': '125kw 5dr auto',
     'vin': None,
     'year': 2016}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '357b359d-a312-5739-8e8e-89d273bf3234',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HN16PZZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507988',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'BMW',
 'model': 'I3 HATCHBACK',
 'odometer': 40333,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27741,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/c1d4769e-7907-491b-ab50-bc07db0e6cb0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33158,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/cb1a48fc-0019-4f2a-ae1c-5be857b93aaa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30445,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/64b6d7b5-4c80-4c02-98b8-a422534838ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28096,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/1fa3fcbe-c948-4e62-ad44-63263204f822_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77149,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/86859ae1-b962-4dfb-9dea-e2629e4d4235_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84291,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bb8bf8c6-362a-4a7c-9d2b-a4fb94cd0221_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52718,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/bbd7dea2-5adb-4850-9fa4-73dce16a125d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48035,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/46391d67-61c6-4a39-994e-68f4fd2ea268_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36809,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/d22aacca-a2fc-45d8-ac36-841a0f28a6bb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38828,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/28ac5b53-4e61-4cc9-9b28-5ea677c560d5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357b359d-a312-5739-8e8e-89d273bf3234/357b359d-a312-5739-8e8e-89d273bf3234_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39239,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16PZZ/2025-12-02/image/5359ea61-c769-41a3-b3fe-42f11c21a9b0_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-22',
 'seller_name': 'Wilsons',
 'title': 'BMW I3 HATCHBACK 125kW 5dr Auto',
 'transmission': 'automatic',
 'trim': '125kW 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507988%27 HTTP/1.1" 200 None
2025-12-02 19:02:11 [astonbarclay.gb] INFO: Saving data for 117507988: {'created_time': 1764702131.932403, 'last_price_update_time': 1764702131.932414, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507988') HTTP/1.1" 204 0
2025-12-02 19:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf093cc50>
2025-12-02 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK16VHA%252F2025-12-02%252Fimage%252F53781a91-2e19-4ff8-b24a-04a2d0b4252f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK16VHA/2025-12-02/image/53781a91-2e19-4ff8-b24a-04a2d0b4252f_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf502d3f-3084-5f78-b546-5e0d0e94ab79
2025-12-02 19:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf502d3f-3084-5f78-b546-5e0d0e94ab79, skipping ID generation
2025-12-02 19:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf502d3f-3084-5f78-b546-5e0d0e94ab79 with scrape type 1
2025-12-02 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf502d3f-3084-5f78-b546-5e0d0e94ab79 from tracking dictionaries
2025-12-02 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf502d3f-3084-5f78-b546-5e0d0e94ab79 sending to next pipeline
2025-12-02 19:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cf502d3f-3084-5f78-b546-5e0d0e94ab79, identifier: 117634478
2025-12-02 19:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0690750>
2025-12-02 19:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWF69LTY%252F2025-12-02%252Fimage%252Febba9d94-d048-40ae-ae2c-02dce2f59879_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WF69LTY/2025-12-02/image/ebba9d94-d048-40ae-ae2c-02dce2f59879_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fe52d45-63a2-53ab-8319-e0b8532403ce
2025-12-02 19:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fe52d45-63a2-53ab-8319-e0b8532403ce, skipping ID generation
2025-12-02 19:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fe52d45-63a2-53ab-8319-e0b8532403ce with scrape type 1
2025-12-02 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4fe52d45-63a2-53ab-8319-e0b8532403ce from tracking dictionaries
2025-12-02 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fe52d45-63a2-53ab-8319-e0b8532403ce sending to next pipeline
2025-12-02 19:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4fe52d45-63a2-53ab-8319-e0b8532403ce, identifier: 117507998
2025-12-02 19:02:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116377459, 'registration': 'YN22UBF', 'account': 'GAT023', 'make': 'MERCEDES-BENZ', 'model': 'CLA SHOOTING BRAKE', 'derivative': 'CLA 200 AMG Line Premium 5dr Tip Auto', 'mileage': 33224, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2243, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-03-29', 'fuel': 'Petrol', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN22UBF/2025-10-15/image/581da0e2-6014-4a34-b205-6ac52121d56e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/f6401829-5971-41c1-8371-8ee88f156ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/cd75b584-e8bd-4895-965e-dfbbed0b255d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/77f4e35d-8bab-43f9-825f-b56877343d71_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/3d89823f-5165-444d-bd6d-9acae49d0269_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/634d1bc8-c3c6-44eb-a281-2d1028374f49_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/fdb19e15-215a-4604-bde7-1786df39b695_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/fe86b970-ce11-4ff0-b9cb-4a044472a1dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/267e5f94-3a6e-45a8-83ca-d36a0cb4bb6f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service print 03/25 31K', 'remarks': 'VOSA STATES, 31K', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1bbac135-a147-49b8-9b55-dbfc588e4f46.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116377459, 'registration': 'YN22UBF', 'account': 'GAT023', 'make': 'MERCEDES-BENZ', 'model': 'CLA SHOOTING BRAKE', 'derivative': 'CLA 200 AMG Line Premium 5dr Tip Auto', 'mileage': 33224, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2243, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-03-29', 'fuel': 'Petrol', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN22UBF/2025-10-15/image/581da0e2-6014-4a34-b205-6ac52121d56e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/f6401829-5971-41c1-8371-8ee88f156ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/cd75b584-e8bd-4895-965e-dfbbed0b255d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/77f4e35d-8bab-43f9-825f-b56877343d71_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/3d89823f-5165-444d-bd6d-9acae49d0269_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/634d1bc8-c3c6-44eb-a281-2d1028374f49_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/fdb19e15-215a-4604-bde7-1786df39b695_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/fe86b970-ce11-4ff0-b9cb-4a044472a1dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/267e5f94-3a6e-45a8-83ca-d36a0cb4bb6f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service print 03/25 31K', 'remarks': 'VOSA STATES, 31K', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1bbac135-a147-49b8-9b55-dbfc588e4f46.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4fb1890-db3b-5070-a865-7abec315cd47 with identifier: 116377459
2025-12-02 19:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4fb1890-db3b-5070-a865-7abec315cd47 with scrape type 2
2025-12-02 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4fb1890-db3b-5070-a865-7abec315cd47 with scrape type 2
2025-12-02 19:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c4fb1890-db3b-5070-a865-7abec315cd47, identifier: 116377459
2025-12-02 19:02:12 [astonbarclay.gb] INFO: Found listing with ID: 117605293
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605293%27 HTTP/1.1" 200 None
2025-12-02 19:02:12 [astonbarclay.gb] INFO: Scrape type for 117605293: 1
2025-12-02 19:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117558544?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cf502d3f-3084-5f78-b546-5e0d0e94ab79 with identifier: 117634478
2025-12-02 19:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cf502d3f-3084-5f78-b546-5e0d0e94ab79 with identifier: 117634478
2025-12-02 19:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cf502d3f-3084-5f78-b546-5e0d0e94ab79 with identifier: 117634478 to the API
2025-12-02 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YK16VHA/2025-12-02/image/53781a91-2e19-4ff8-b24a-04a2d0b4252f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'cf502d3f-3084-5f78-b546-5e0d0e94ab79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YK16VHA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117634478',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'PEUGEOT',
 'model': '108 HATCHBACK',
 'odometer': 28078,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26130,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/53781a91-2e19-4ff8-b24a-04a2d0b4252f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27199,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/e6b915f7-c1c6-489e-b833-fe7f408acf6b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27620,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/56839c9f-ed79-4986-9789-bc4e53f28fe0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25042,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/6b7f3635-b050-478a-938e-a2137ebf2984_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27566,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/2e638dff-170f-4acc-a160-24f93fd48d2f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46756,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/83947f5e-e6cf-42e0-9105-7cb241d3b39e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf502d3f-3084-5f78-b546-5e0d0e94ab79/cf502d3f-3084-5f78-b546-5e0d0e94ab79_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68029,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/YK16VHA/2025-12-02/image/06659b41-2032-478d-bc81-59901621a370_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-25',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'PEUGEOT 108 HATCHBACK 1.2 PureTech Allure 3dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure 3dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634478%27 HTTP/1.1" 200 None
2025-12-02 19:02:13 [astonbarclay.gb] INFO: Saving data for 117634478: {'created_time': 1764702133.138698, 'last_price_update_time': 1764702133.13871, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117634478') HTTP/1.1" 204 0
2025-12-02 19:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4fe52d45-63a2-53ab-8319-e0b8532403ce with identifier: 117507998
2025-12-02 19:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4fe52d45-63a2-53ab-8319-e0b8532403ce with identifier: 117507998
2025-12-02 19:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4fe52d45-63a2-53ab-8319-e0b8532403ce with identifier: 117507998 to the API
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/WF69LTY/2025-12-02/image/ebba9d94-d048-40ae-ae2c-02dce2f59879_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '4fe52d45-63a2-53ab-8319-e0b8532403ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WF69LTY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507998',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'PEUGEOT',
 'model': '5008 DIESEL ESTATE',
 'odometer': 69830,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32117,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/ebba9d94-d048-40ae-ae2c-02dce2f59879_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33500,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/d7816e03-49d0-4507-be86-3cb520c3a2ea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35509,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/c82a6c11-57dd-4ca7-9bbb-da86b4c3152c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35087,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e1cd49a7-747a-4449-8f7c-63d3e07418ab_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91325,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/29e5e650-0a5f-4881-b0e8-6b7a04b100f5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79827,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/6701d40e-48f2-4334-96fe-482f81e13cae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55904,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/0af3fb97-8ce3-45e0-9184-c553b71405e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52121,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e468d304-4f9f-4ca5-b567-be5d4744ca49_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48509,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/56dc19a4-1203-4f50-8f6e-f66647fcd2f2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe52d45-63a2-53ab-8319-e0b8532403ce/4fe52d45-63a2-53ab-8319-e0b8532403ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40691,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/37378945-9be0-4147-b384-ab49c666020a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-14',
 'seller_name': 'Wilsons',
 'title': 'PEUGEOT 5008 DIESEL ESTATE 1.5 BlueHDi Allure 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Allure 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507998%27 HTTP/1.1" 200 None
2025-12-02 19:02:13 [astonbarclay.gb] INFO: Saving data for 117507998: {'created_time': 1764702133.483649, 'last_price_update_time': 1764702133.483661, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507998') HTTP/1.1" 204 0
2025-12-02 19:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c4fb1890-db3b-5070-a865-7abec315cd47 with identifier: 116377459
2025-12-02 19:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c4fb1890-db3b-5070-a865-7abec315cd47 with identifier: 116377459
2025-12-02 19:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c4fb1890-db3b-5070-a865-7abec315cd47 with identifier: 116377459 to the API
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27c4fb1890-db3b-5070-a865-7abec315cd47%27 HTTP/1.1" 200 None
2025-12-02 19:02:13 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id c4fb1890-db3b-5070-a865-7abec315cd47: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:12 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116377459?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c4fb1890-db3b-5070-a865-7abec315cd47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YN22UBF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116377459',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 33224,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': 'Gates Group',
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE CLA 200 AMG Line Premium 5dr Tip '
          'Auto',
 'transmission': 'automatic',
 'trim': 'CLA 200 AMG Line Premium 5dr Tip Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116377459%27 HTTP/1.1" 200 None
2025-12-02 19:02:13 [astonbarclay.gb] INFO: Saving data for 116377459: {'auction_closing_time': 1764756000.0, 'created_time': 1760511678.538537, 'last_price_update_time': 1764702133.762848}
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116377459') HTTP/1.1" 204 0
2025-12-02 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07e4050>
2025-12-02 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX69OMA%252F2025-12-02%252Fimage%252F5869601d-16f8-4079-b6f5-fb53fd74ee3c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX69OMA/2025-12-02/image/5869601d-16f8-4079-b6f5-fb53fd74ee3c_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 947e4204-0720-5876-bad2-6dad899f30d7
2025-12-02 19:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 947e4204-0720-5876-bad2-6dad899f30d7, skipping ID generation
2025-12-02 19:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 947e4204-0720-5876-bad2-6dad899f30d7 with scrape type 1
2025-12-02 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 947e4204-0720-5876-bad2-6dad899f30d7 from tracking dictionaries
2025-12-02 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 947e4204-0720-5876-bad2-6dad899f30d7 sending to next pipeline
2025-12-02 19:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 947e4204-0720-5876-bad2-6dad899f30d7, identifier: 117634427
2025-12-02 19:02:14 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117455255, 'registration': 'KE66HCZ', 'account': 'CAR001', 'make': 'AUDI', 'model': 'A3 DIESEL SPORTBACK', 'derivative': '1.6 TDI S Line 5dr', 'mileage': 90697, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2123, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-02-08', 'fuel': 'Diesel', 'motExpiry': '2026-08-19', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/d89a467b-c3b6-454b-bec9-0589f5f49127_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/e82f0a04-6a1a-4b48-97ab-896f16a9d0e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/edc54dfd-9a1b-4ad4-bfdb-6d1d019fcad0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/9d9596d0-f9cc-4574-a2e2-0e5d12c56e50_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/f09d1c9f-a7ca-473b-989c-5e36f7e11ec2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/4c24a39d-ffb0-44df-b63a-d6026fd7ee15_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/1ea1ddde-c1a5-4ae4-b04e-5a3078ff0140_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/49df8654-13dc-4494-9cb1-74ccc1a53708_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/17- 15K, 11/18- 30K, 06/19- 40K', 'remarks': 'VOSA STATES 59K, 65K, 72K, 87K - SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/643db983-1531-4c1b-a57d-6b1133edcecb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:14 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117455255, 'registration': 'KE66HCZ', 'account': 'CAR001', 'make': 'AUDI', 'model': 'A3 DIESEL SPORTBACK', 'derivative': '1.6 TDI S Line 5dr', 'mileage': 90697, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2123, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-02-08', 'fuel': 'Diesel', 'motExpiry': '2026-08-19', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/d89a467b-c3b6-454b-bec9-0589f5f49127_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/e82f0a04-6a1a-4b48-97ab-896f16a9d0e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/edc54dfd-9a1b-4ad4-bfdb-6d1d019fcad0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/9d9596d0-f9cc-4574-a2e2-0e5d12c56e50_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/f09d1c9f-a7ca-473b-989c-5e36f7e11ec2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/4c24a39d-ffb0-44df-b63a-d6026fd7ee15_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/1ea1ddde-c1a5-4ae4-b04e-5a3078ff0140_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/49df8654-13dc-4494-9cb1-74ccc1a53708_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/17- 15K, 11/18- 30K, 06/19- 40K', 'remarks': 'VOSA STATES 59K, 65K, 72K, 87K - SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/643db983-1531-4c1b-a57d-6b1133edcecb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f01bae-22c1-5991-936a-e03020abe19d with identifier: 117455255
2025-12-02 19:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f01bae-22c1-5991-936a-e03020abe19d with scrape type 2
2025-12-02 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88f01bae-22c1-5991-936a-e03020abe19d with scrape type 2
2025-12-02 19:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 88f01bae-22c1-5991-936a-e03020abe19d, identifier: 117455255
2025-12-02 19:02:14 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117245171, 'registration': 'LO72UVB', 'account': 'GAT009', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr', 'mileage': 20191, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2231, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-12-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO72UVB/2025-11-17/image/a2fb0cd4-85ca-417b-84cd-be1bf478ee5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/55a2442a-f7d1-4a58-880a-34da75baed6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/1da2efa8-3512-4291-9353-a72558b183d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/3745e384-ea2e-45b7-afff-d0683ebcc506_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/a35df54d-c8f1-4cdb-9ef1-73cc144dc947_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/4201a444-9027-4252-9c29-6d938743a42a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/f7ee0a3e-d77e-46ae-be4d-71deef839b1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/c84b2771-a499-4d8f-88e0-d8532b730530_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/e6491eb8-5e2d-451e-8c4a-860c5d8dab5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/253ca14b-760c-402c-9e78-e733b0c836c6_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43042fab-3d3d-492e-9a2a-50f45098d27f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:14 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117245171, 'registration': 'LO72UVB', 'account': 'GAT009', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr', 'mileage': 20191, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2231, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-12-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO72UVB/2025-11-17/image/a2fb0cd4-85ca-417b-84cd-be1bf478ee5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/55a2442a-f7d1-4a58-880a-34da75baed6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/1da2efa8-3512-4291-9353-a72558b183d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/3745e384-ea2e-45b7-afff-d0683ebcc506_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/a35df54d-c8f1-4cdb-9ef1-73cc144dc947_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/4201a444-9027-4252-9c29-6d938743a42a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/f7ee0a3e-d77e-46ae-be4d-71deef839b1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/c84b2771-a499-4d8f-88e0-d8532b730530_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/e6491eb8-5e2d-451e-8c4a-860c5d8dab5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/253ca14b-760c-402c-9e78-e733b0c836c6_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43042fab-3d3d-492e-9a2a-50f45098d27f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a1e7d3a-e415-59de-a037-744b1514f421 with identifier: 117245171
2025-12-02 19:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a1e7d3a-e415-59de-a037-744b1514f421 with scrape type 2
2025-12-02 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a1e7d3a-e415-59de-a037-744b1514f421 with scrape type 2
2025-12-02 19:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0a1e7d3a-e415-59de-a037-744b1514f421, identifier: 117245171
2025-12-02 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/3e4906e6-0399-4996-91b5-397a69195db3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue)
2025-12-02 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS18MMO/2025-12-02/image/f9e664e9-18f3-422b-b182-c43ae6c37176_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue)
2025-12-02 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL17AHX/2025-12-02/image/41f02a38-2e62-4634-9a46-ac1b4c2db1cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661923?view=catalogue)
2025-12-02 19:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 947e4204-0720-5876-bad2-6dad899f30d7 with identifier: 117634427
2025-12-02 19:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 947e4204-0720-5876-bad2-6dad899f30d7 with identifier: 117634427
2025-12-02 19:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 947e4204-0720-5876-bad2-6dad899f30d7 with identifier: 117634427 to the API
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/VX69OMA/2025-12-02/image/5869601d-16f8-4079-b6f5-fb53fd74ee3c_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '947e4204-0720-5876-bad2-6dad899f30d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VX69OMA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117634427',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'SUZUKI',
 'model': 'IGNIS HATCHBACK',
 'odometer': 57117,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28659,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/5869601d-16f8-4079-b6f5-fb53fd74ee3c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27368,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/ab165de7-34ca-424c-be46-3d530345a0c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26491,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/d17fc5a2-0953-4c0c-aee7-60933a03b429_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25463,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/fc967ccb-9da1-46f0-bdd5-a8a006dfa767_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53420,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/51962326-1f02-460b-b0ca-2e0b0f73e672_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45480,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/f869c3e0-655f-4956-9f96-0cc788d57eec_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46763,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/aefccbd7-df7a-42e8-aa4d-50d477e6bb9d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72038,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/1552f193-d154-4a0a-89ee-53b79dbfc7f1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_947e4204-0720-5876-bad2-6dad899f30d7/947e4204-0720-5876-bad2-6dad899f30d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49449,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VX69OMA/2025-12-02/image/feeebb7f-bea8-4fcc-bd53-ec35d919e63c_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-18',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'SUZUKI IGNIS HATCHBACK 1.2 Dualjet SHVS SZ-T 5dr',
 'transmission': 'manual',
 'trim': '1.2 Dualjet SHVS SZ-T 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634427%27 HTTP/1.1" 200 None
2025-12-02 19:02:14 [astonbarclay.gb] INFO: Saving data for 117634427: {'created_time': 1764702134.669436, 'last_price_update_time': 1764702134.669446, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117634427') HTTP/1.1" 204 0
2025-12-02 19:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 88f01bae-22c1-5991-936a-e03020abe19d with identifier: 117455255
2025-12-02 19:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 88f01bae-22c1-5991-936a-e03020abe19d with identifier: 117455255
2025-12-02 19:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 88f01bae-22c1-5991-936a-e03020abe19d with identifier: 117455255 to the API
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117455255?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '88f01bae-22c1-5991-936a-e03020abe19d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KE66HCZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117455255',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A3 DIESEL SPORTBACK',
 'odometer': 90697,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-08',
 'seller_name': 'CarGiant',
 'title': 'AUDI A3 DIESEL SPORTBACK 1.6 TDI S Line 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDI S Line 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117455255%27 HTTP/1.1" 200 None
2025-12-02 19:02:14 [astonbarclay.gb] INFO: Saving data for 117455255: {'auction_closing_time': 1764756000.0, 'created_time': 1764010957.205306, 'last_price_update_time': 1764702134.971601}
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117455255') HTTP/1.1" 204 0
2025-12-02 19:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0a1e7d3a-e415-59de-a037-744b1514f421 with identifier: 117245171
2025-12-02 19:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0a1e7d3a-e415-59de-a037-744b1514f421 with identifier: 117245171
2025-12-02 19:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0a1e7d3a-e415-59de-a037-744b1514f421 with identifier: 117245171 to the API
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270a1e7d3a-e415-59de-a037-744b1514f421%27 HTTP/1.1" 200 None
2025-12-02 19:02:15 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0a1e7d3a-e415-59de-a037-744b1514f421: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:14 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117245171?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0a1e7d3a-e415-59de-a037-744b1514f421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LO72UVB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117245171',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 20191,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-23',
 'seller_name': 'Gates Group',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117245171%27 HTTP/1.1" 200 None
2025-12-02 19:02:15 [astonbarclay.gb] INFO: Saving data for 117245171: {'auction_closing_time': 1764756000.0, 'created_time': 1763146934.929353, 'last_price_update_time': 1764702135.256056}
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117245171') HTTP/1.1" 204 0
2025-12-02 19:02:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116509919, 'registration': 'RF68MVX', 'account': 'CAR001', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav/Servotronic]', 'mileage': 94873, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2120, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF68MVX/2025-10-23/image/8f457cc4-f9b8-4df7-bd64-b42679e491ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/5a524104-17a0-4797-a00f-1daa80ae636f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/50858f85-720e-4a69-b59c-acf469e44043_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/c15f399e-11a3-4b38-87f2-1f69dcbadbba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/ddd6411b-433d-440c-942a-642e9deb33f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/b0e0e535-64d1-4151-80b9-c17b6f259e02_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/399583bc-cbf5-49db-b910-3e43fa040bdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/8a56da56-0f18-4e8d-bd09-a91db9925feb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/48b7aea6-0ee4-4385-93a1-af9ab97b2984_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/00701a56-fcc7-4d64-ba41-d9e05a1f4d0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/962b2777-0025-4eac-99e8-6bd4da4c3f3e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital 10/19- 18K, 07/21- 36K, 11/21- 43K', 'remarks': 'VOSA STATES 54K, 73K, 85K, 94K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d0f70d5-3e01-430b-b578-4801a56ea9c6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116509919, 'registration': 'RF68MVX', 'account': 'CAR001', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav/Servotronic]', 'mileage': 94873, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2120, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF68MVX/2025-10-23/image/8f457cc4-f9b8-4df7-bd64-b42679e491ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/5a524104-17a0-4797-a00f-1daa80ae636f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/50858f85-720e-4a69-b59c-acf469e44043_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/c15f399e-11a3-4b38-87f2-1f69dcbadbba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/ddd6411b-433d-440c-942a-642e9deb33f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/b0e0e535-64d1-4151-80b9-c17b6f259e02_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/399583bc-cbf5-49db-b910-3e43fa040bdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/8a56da56-0f18-4e8d-bd09-a91db9925feb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/48b7aea6-0ee4-4385-93a1-af9ab97b2984_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/00701a56-fcc7-4d64-ba41-d9e05a1f4d0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/962b2777-0025-4eac-99e8-6bd4da4c3f3e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital 10/19- 18K, 07/21- 36K, 11/21- 43K', 'remarks': 'VOSA STATES 54K, 73K, 85K, 94K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d0f70d5-3e01-430b-b578-4801a56ea9c6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a343d5c-f504-59ea-ae64-b3f80d779d1d with identifier: 116509919
2025-12-02 19:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a343d5c-f504-59ea-ae64-b3f80d779d1d with scrape type 2
2025-12-02 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a343d5c-f504-59ea-ae64-b3f80d779d1d with scrape type 2
2025-12-02 19:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2a343d5c-f504-59ea-ae64-b3f80d779d1d, identifier: 116509919
2025-12-02 19:02:15 [astonbarclay.gb] INFO: Found listing with ID: 117256710
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256710%27 HTTP/1.1" 200 None
2025-12-02 19:02:15 [astonbarclay.gb] INFO: Scrape type for 117256710: 2
2025-12-02 19:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2a343d5c-f504-59ea-ae64-b3f80d779d1d with identifier: 116509919
2025-12-02 19:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2a343d5c-f504-59ea-ae64-b3f80d779d1d with identifier: 116509919
2025-12-02 19:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152682 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152682
2025-12-02 19:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2a343d5c-f504-59ea-ae64-b3f80d779d1d spider: astonbarclay.gb
2025-12-02 19:02:15 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 2a343d5c-f504-59ea-ae64-b3f80d779d1d due to rule: high_mileage_for_country.json, error: 152682 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152682
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2a343d5c-f504-59ea-ae64-b3f80d779d1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RF68MVX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116509919',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 94873,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seller_name': 'CarGiant',
 'title': 'BMW 1 SERIES HATCHBACK 118i [1.5] Sport 5dr [Nav/Servotronic]',
 'transmission': 'manual',
 'trim': '118i [1.5] Sport 5dr [Nav/Servotronic]',
 'vin': None,
 'year': 2018}
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116509919%27 HTTP/1.1" 200 None
2025-12-02 19:02:15 [astonbarclay.gb] INFO: Saving data for 116509919: {'auction_closing_time': 1764756000.0, 'created_time': 1761037275.386796, 'last_price_update_time': 1764702135.610559}
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116509919') HTTP/1.1" 204 0
2025-12-02 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06a9390>
2025-12-02 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252F96e1bdc1-e777-490e-8d10-8846db4f4257_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/96e1bdc1-e777-490e-8d10-8846db4f4257_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7
2025-12-02 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06aa950>
2025-12-02 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252F55b525a7-1d87-475a-a34c-015eb1c9d665_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/55b525a7-1d87-475a-a34c-015eb1c9d665_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:02:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116409684, 'registration': 'KR67ZHM', 'account': 'GAT021', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.4 TSI SE 5dr [7 Seat]', 'mileage': 109413, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2234, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/f9c0c7d5-ca6a-46fc-be4f-6a8da8fd201f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/03f8eb02-03a3-4c75-8e13-8cec7d98c0a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/eb2a48d8-91d7-4ccb-9aac-e9430e9baf10_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/170890d4-acbf-4ec4-bbd5-4d834b510c18_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/3d9aa8d6-c2b8-40d8-a029-ba1d9e770317_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/ae18bbaf-63de-4f41-99fc-66730d843b96_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/d8e6219c-8d10-4c73-bafa-3a50c60e1d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/ad468996-8512-4ddb-b783-cfd1e26647c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/e5292ac1-1418-4a7f-b97f-a4df7c7999a3_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 44K - 61K- 77K- 92K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6848e19e-5f32-4cd5-8c0a-0f95c90403a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116409684, 'registration': 'KR67ZHM', 'account': 'GAT021', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.4 TSI SE 5dr [7 Seat]', 'mileage': 109413, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2234, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/f9c0c7d5-ca6a-46fc-be4f-6a8da8fd201f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/03f8eb02-03a3-4c75-8e13-8cec7d98c0a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/eb2a48d8-91d7-4ccb-9aac-e9430e9baf10_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/170890d4-acbf-4ec4-bbd5-4d834b510c18_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/3d9aa8d6-c2b8-40d8-a029-ba1d9e770317_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/ae18bbaf-63de-4f41-99fc-66730d843b96_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/d8e6219c-8d10-4c73-bafa-3a50c60e1d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/ad468996-8512-4ddb-b783-cfd1e26647c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/e5292ac1-1418-4a7f-b97f-a4df7c7999a3_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 44K - 61K- 77K- 92K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6848e19e-5f32-4cd5-8c0a-0f95c90403a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4f88cb-7210-59d3-adcd-65d787058ed8 with identifier: 116409684
2025-12-02 19:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4f88cb-7210-59d3-adcd-65d787058ed8 with scrape type 2
2025-12-02 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c4f88cb-7210-59d3-adcd-65d787058ed8 with scrape type 2
2025-12-02 19:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5c4f88cb-7210-59d3-adcd-65d787058ed8, identifier: 116409684
2025-12-02 19:02:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116859641, 'registration': 'HG22CHJ', 'account': 'GAT001', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 100 GT 5dr', 'mileage': 49401, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2237, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-06-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/361fa3e5-8691-465d-9359-00a68a815db9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/e0172f66-aaed-4c10-bf7c-4b360bc2f58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/c1fda99d-be74-499f-abff-019191b8c5de_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/34b2b796-75f1-43d2-a688-aeb002b62ad6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/5407d368-107f-41db-b384-1ee315567be7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/cabb3944-8d83-4adc-8403-f5ee2e67304f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/15fe5a1f-34ff-4c60-9a0c-26ade2e98586_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/522107b8-52f3-4c16-bd4c-513a60ce9430_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/f4748afb-52bf-4f0f-bd8a-7358a1e3bb4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/9454b383-6f5c-4a1e-be00-a8e59548c382_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'EMPTY SERVICE BOOK', 'remarks': 'UNABLE TO AA DUE TO BONNET RELEASE BEING BROKEN - PHOTOCOPY OF V5 IN OFFICE -', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e7643179-91c6-4ad6-a0bc-18651584783a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:02:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116859641, 'registration': 'HG22CHJ', 'account': 'GAT001', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 100 GT 5dr', 'mileage': 49401, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2237, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-06-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/361fa3e5-8691-465d-9359-00a68a815db9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/e0172f66-aaed-4c10-bf7c-4b360bc2f58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/c1fda99d-be74-499f-abff-019191b8c5de_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/34b2b796-75f1-43d2-a688-aeb002b62ad6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/5407d368-107f-41db-b384-1ee315567be7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/cabb3944-8d83-4adc-8403-f5ee2e67304f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/15fe5a1f-34ff-4c60-9a0c-26ade2e98586_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/522107b8-52f3-4c16-bd4c-513a60ce9430_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/f4748afb-52bf-4f0f-bd8a-7358a1e3bb4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/9454b383-6f5c-4a1e-be00-a8e59548c382_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'EMPTY SERVICE BOOK', 'remarks': 'UNABLE TO AA DUE TO BONNET RELEASE BEING BROKEN - PHOTOCOPY OF V5 IN OFFICE -', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e7643179-91c6-4ad6-a0bc-18651584783a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60a9051e-2fed-56bb-8402-520d9f3f47d1 with identifier: 116859641
2025-12-02 19:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a9051e-2fed-56bb-8402-520d9f3f47d1 with scrape type 2
2025-12-02 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60a9051e-2fed-56bb-8402-520d9f3f47d1 with scrape type 2
2025-12-02 19:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 60a9051e-2fed-56bb-8402-520d9f3f47d1, identifier: 116859641
2025-12-02 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19EOB/2025-12-02/image/5536dae1-42da-4d30-b9cc-122f425aba6d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue)
2025-12-02 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d94def93-7122-496c-a693-700a24ed74e8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue)
2025-12-02 19:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5c4f88cb-7210-59d3-adcd-65d787058ed8 with identifier: 116409684
2025-12-02 19:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5c4f88cb-7210-59d3-adcd-65d787058ed8 with identifier: 116409684
2025-12-02 19:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176082 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176082
2025-12-02 19:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5c4f88cb-7210-59d3-adcd-65d787058ed8 spider: astonbarclay.gb
2025-12-02 19:02:16 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5c4f88cb-7210-59d3-adcd-65d787058ed8 due to rule: high_mileage_for_country.json, error: 176082 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176082
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5c4f88cb-7210-59d3-adcd-65d787058ed8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KR67ZHM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116409684',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'KODIAQ ESTATE',
 'odometer': 109413,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seller_name': 'Gates Group',
 'title': 'SKODA KODIAQ ESTATE 1.4 TSI SE 5dr [7 Seat]',
 'transmission': 'manual',
 'trim': '1.4 TSI SE 5dr [7 Seat]',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116409684%27 HTTP/1.1" 200 None
2025-12-02 19:02:16 [astonbarclay.gb] INFO: Saving data for 116409684: {'auction_closing_time': 1764756000.0, 'created_time': 1760554913.762837, 'last_price_update_time': 1764702136.600566}
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116409684') HTTP/1.1" 204 0
2025-12-02 19:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 60a9051e-2fed-56bb-8402-520d9f3f47d1 with identifier: 116859641
2025-12-02 19:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 60a9051e-2fed-56bb-8402-520d9f3f47d1 with identifier: 116859641
2025-12-02 19:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 60a9051e-2fed-56bb-8402-520d9f3f47d1 with identifier: 116859641 to the API
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116859641?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '60a9051e-2fed-56bb-8402-520d9f3f47d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'HG22CHJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116859641',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '208 HATCHBACK',
 'odometer': 49401,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-30',
 'seller_name': 'Gates Group',
 'title': 'PEUGEOT 208 HATCHBACK 1.2 PureTech 100 GT 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 100 GT 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859641%27 HTTP/1.1" 200 None
2025-12-02 19:02:16 [astonbarclay.gb] INFO: Saving data for 116859641: {'auction_closing_time': 1764756000.0, 'created_time': 1762283179.526065, 'last_price_update_time': 1764702136.929663}
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116859641') HTTP/1.1" 204 0
2025-12-02 19:02:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117558544, 'registration': 'GL22JVY', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE', 'derivative': '1.0 TSI 110 Black Edition 5dr', 'mileage': 31383, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1335, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-08-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GL22JVY/2025-11-27/image/622463e3-b621-4f5b-a708-587aac0ae2e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/ea3aad0a-e7eb-489b-bd1a-513614283ec8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/58618d01-3dbc-4658-84f1-2d9e596d6bc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/41bce0c4-9c3c-460c-9995-ecb488a9d2c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/26ba8ce8-8b30-49a3-800d-5d70a6f6909d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/74ff1176-3d17-4885-a3b9-deb298cfebbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/401ed3b1-98c8-49a4-86e9-c7dd42e67686_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/040daba0-cd99-4dba-bafc-b02a263220b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/93568dd0-a1cd-4892-9708-57b136fded87_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24- 16K, 08/25- 17K', 'remarks': 'VOSA STATES 27K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/022211c1-0ca5-4904-982a-ec87b0f7223e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117558544, 'registration': 'GL22JVY', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE', 'derivative': '1.0 TSI 110 Black Edition 5dr', 'mileage': 31383, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1335, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-08-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GL22JVY/2025-11-27/image/622463e3-b621-4f5b-a708-587aac0ae2e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/ea3aad0a-e7eb-489b-bd1a-513614283ec8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/58618d01-3dbc-4658-84f1-2d9e596d6bc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/41bce0c4-9c3c-460c-9995-ecb488a9d2c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/26ba8ce8-8b30-49a3-800d-5d70a6f6909d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/74ff1176-3d17-4885-a3b9-deb298cfebbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/401ed3b1-98c8-49a4-86e9-c7dd42e67686_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/040daba0-cd99-4dba-bafc-b02a263220b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL22JVY/2025-11-27/image/93568dd0-a1cd-4892-9708-57b136fded87_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24- 16K, 08/25- 17K', 'remarks': 'VOSA STATES 27K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/022211c1-0ca5-4904-982a-ec87b0f7223e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e58ce4a5-7326-5355-bf84-fa6f8f191ed3 with identifier: 117558544
2025-12-02 19:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e58ce4a5-7326-5355-bf84-fa6f8f191ed3 with scrape type 2
2025-12-02 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e58ce4a5-7326-5355-bf84-fa6f8f191ed3 with scrape type 2
2025-12-02 19:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e58ce4a5-7326-5355-bf84-fa6f8f191ed3, identifier: 117558544
2025-12-02 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL17AHX/2025-12-02/image/b9e5f552-9d7f-45c8-a2d2-c7095da6a44e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661923?view=catalogue)
2025-12-02 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3de95cae-e3cf-4748-8dc0-9a5bfad51400_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662353?view=catalogue)
2025-12-02 19:02:17 [astonbarclay.gb] INFO: Found listing with ID: 117605302
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605302%27 HTTP/1.1" 200 None
2025-12-02 19:02:17 [astonbarclay.gb] INFO: Scrape type for 117605302: 1
2025-12-02 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117406735?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e58ce4a5-7326-5355-bf84-fa6f8f191ed3 with identifier: 117558544
2025-12-02 19:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e58ce4a5-7326-5355-bf84-fa6f8f191ed3 with identifier: 117558544
2025-12-02 19:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e58ce4a5-7326-5355-bf84-fa6f8f191ed3 with identifier: 117558544 to the API
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117558544?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e58ce4a5-7326-5355-bf84-fa6f8f191ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GL22JVY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117558544',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS ESTATE',
 'odometer': 31383,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-31',
 'seller_name': 'UKCGR - Premium',
 'title': 'VOLKSWAGEN T-CROSS ESTATE 1.0 TSI 110 Black Edition 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI 110 Black Edition 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117558544%27 HTTP/1.1" 200 None
2025-12-02 19:02:17 [astonbarclay.gb] INFO: Saving data for 117558544: {'auction_closing_time': 1764756000.0, 'created_time': 1764356608.007214, 'last_price_update_time': 1764702137.346436}
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117558544') HTTP/1.1" 204 0
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04df190>
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F3e4906e6-0399-4996-91b5-397a69195db3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/3e4906e6-0399-4996-91b5-397a69195db3_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf096a090>
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252Ff9e664e9-18f3-422b-b182-c43ae6c37176_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/f9e664e9-18f3-422b-b182-c43ae6c37176_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67123457-1c0a-5cdd-8be3-eb490de642b0
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf032e410>
2025-12-02 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252F41f02a38-2e62-4634-9a46-ac1b4c2db1cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/41f02a38-2e62-4634-9a46-ac1b4c2db1cc_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f
2025-12-02 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS18MMO/2025-12-02/image/12ddd530-3d88-4642-ae11-10cc4829c874_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue)
2025-12-02 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/f0cdc0a4-e1d3-40a5-961d-f5690e49642f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue)
2025-12-02 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL17AHX/2025-12-02/image/ca2d2dac-6a86-411c-8ac4-7632546af028_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661923?view=catalogue)
2025-12-02 19:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/a1f561ef-cf99-4b02-b4ef-9f69c5489139_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue)
2025-12-02 19:02:18 [astonbarclay.gb] INFO: Found listing with ID: 117579419
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579419%27 HTTP/1.1" 200 None
2025-12-02 19:02:18 [astonbarclay.gb] INFO: Scrape type for 117579419: 0
2025-12-02 19:02:18 [astonbarclay.gb] INFO: Found listing with ID: 117189741
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117189741%27 HTTP/1.1" 200 None
2025-12-02 19:02:18 [astonbarclay.gb] INFO: Scrape type for 117189741: 0
2025-12-02 19:02:18 [astonbarclay.gb] INFO: Found listing with ID: 117539813
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539813%27 HTTP/1.1" 200 None
2025-12-02 19:02:18 [astonbarclay.gb] INFO: Scrape type for 117539813: 2
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf033fe10>
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252F5536dae1-42da-4d30-b9cc-122f425aba6d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/5536dae1-42da-4d30-b9cc-122f425aba6d_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0747390>
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fd94def93-7122-496c-a693-700a24ed74e8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d94def93-7122-496c-a693-700a24ed74e8_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117215946?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf032d4d0>
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252Fb9e5f552-9d7f-45c8-a2d2-c7095da6a44e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/b9e5f552-9d7f-45c8-a2d2-c7095da6a44e_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0746550>
2025-12-02 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252F3de95cae-e3cf-4748-8dc0-9a5bfad51400_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3de95cae-e3cf-4748-8dc0-9a5bfad51400_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4719489b-1fba-5fbc-a000-82ecc981e7c2
2025-12-02 19:02:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117406735, 'registration': 'DK16BXM', 'account': 'CAR001', 'make': 'BMW', 'model': '2 SERIES GRAN TOURER', 'derivative': '218i Luxury 5dr Step Auto', 'mileage': 81543, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2131, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-07-20', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DK16BXM/2025-11-21/image/f7a5aefe-4496-42c8-8a36-e6243d29ddbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/5a258935-69ff-4108-a75e-21083b1c5c5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/c7bbf55c-0cb5-459b-be92-7d55dcfd4e99_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/8911d60e-ec99-4264-80ce-540fa42c29a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/07f72ca0-6004-4882-af18-37d69e61bab9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/950fe958-42cf-49f0-be0b-9ff5d96a71ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/2d6adde8-deee-407a-811f-379b8e86b133_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/e8a01760-7a23-46b6-b48e-8b25d4cab7d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/fee8f971-15a5-47c5-ae39-d5a5f48cf87d_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL, VOSA STATES 55K, 63K, 71K, 78K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d368223-2595-49b9-98f1-c5ec906a0d6f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117406735, 'registration': 'DK16BXM', 'account': 'CAR001', 'make': 'BMW', 'model': '2 SERIES GRAN TOURER', 'derivative': '218i Luxury 5dr Step Auto', 'mileage': 81543, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2131, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-07-20', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DK16BXM/2025-11-21/image/f7a5aefe-4496-42c8-8a36-e6243d29ddbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/5a258935-69ff-4108-a75e-21083b1c5c5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/c7bbf55c-0cb5-459b-be92-7d55dcfd4e99_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/8911d60e-ec99-4264-80ce-540fa42c29a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/07f72ca0-6004-4882-af18-37d69e61bab9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/950fe958-42cf-49f0-be0b-9ff5d96a71ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/2d6adde8-deee-407a-811f-379b8e86b133_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/e8a01760-7a23-46b6-b48e-8b25d4cab7d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/fee8f971-15a5-47c5-ae39-d5a5f48cf87d_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL, VOSA STATES 55K, 63K, 71K, 78K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d368223-2595-49b9-98f1-c5ec906a0d6f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 529969d9-5cef-5593-9a35-65d0939c0d15 with identifier: 117406735
2025-12-02 19:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 529969d9-5cef-5593-9a35-65d0939c0d15 with scrape type 2
2025-12-02 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 529969d9-5cef-5593-9a35-65d0939c0d15 with scrape type 2
2025-12-02 19:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 529969d9-5cef-5593-9a35-65d0939c0d15, identifier: 117406735
2025-12-02 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS18MMO/2025-12-02/image/2abcfa8c-7f6c-4501-95ef-b2ac19257873_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue)
2025-12-02 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4f1b3b64-e21d-4ffa-8b34-246da6053acd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662353?view=catalogue)
2025-12-02 19:02:19 [astonbarclay.gb] INFO: Found listing with ID: 117545284
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117545284%27 HTTP/1.1" 200 None
2025-12-02 19:02:19 [astonbarclay.gb] INFO: Scrape type for 117545284: 2
2025-12-02 19:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 529969d9-5cef-5593-9a35-65d0939c0d15 with identifier: 117406735
2025-12-02 19:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 529969d9-5cef-5593-9a35-65d0939c0d15 with identifier: 117406735
2025-12-02 19:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 529969d9-5cef-5593-9a35-65d0939c0d15 with identifier: 117406735 to the API
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117406735?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '529969d9-5cef-5593-9a35-65d0939c0d15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DK16BXM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406735',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '2 SERIES GRAN TOURER',
 'odometer': 81543,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-01',
 'seller_name': 'CarGiant',
 'title': 'BMW 2 SERIES GRAN TOURER 218i Luxury 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '218i Luxury 5dr Step Auto',
 'vin': None,
 'year': 2016}
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406735%27 HTTP/1.1" 200 None
2025-12-02 19:02:19 [astonbarclay.gb] INFO: Saving data for 117406735: {'auction_closing_time': 1764756000.0, 'created_time': 1763751905.582027, 'last_price_update_time': 1764702139.627155}
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117406735') HTTP/1.1" 204 0
2025-12-02 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19EOB/2025-12-02/image/744e863e-1b5f-486b-a867-6d07a6fe24e9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue)
2025-12-02 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/227aece1-5b16-43ff-8611-8401b154f1ac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue)
2025-12-02 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL17AHX/2025-12-02/image/c8071269-6325-4dd4-8f2d-743c682ff0c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661923?view=catalogue)
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09180d0>
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F12ddd530-3d88-4642-ae11-10cc4829c874_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/12ddd530-3d88-4642-ae11-10cc4829c874_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67123457-1c0a-5cdd-8be3-eb490de642b0
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ff850>
2025-12-02 19:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252Ff0cdc0a4-e1d3-40a5-961d-f5690e49642f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/f0cdc0a4-e1d3-40a5-961d-f5690e49642f_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0671d90>
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252Fca2d2dac-6a86-411c-8ac4-7632546af028_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/ca2d2dac-6a86-411c-8ac4-7632546af028_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf094b710>
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252Fa1f561ef-cf99-4b02-b4ef-9f69c5489139_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/a1f561ef-cf99-4b02-b4ef-9f69c5489139_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS18MMO/2025-12-02/image/e48f57b9-748d-41a0-a19b-370f89bf0efd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue)
2025-12-02 19:02:20 [astonbarclay.gb] INFO: Found listing with ID: 117184599
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117184599%27 HTTP/1.1" 200 None
2025-12-02 19:02:20 [astonbarclay.gb] INFO: Scrape type for 117184599: 0
2025-12-02 19:02:20 [astonbarclay.gb] INFO: Found listing with ID: 117207188
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207188%27 HTTP/1.1" 200 None
2025-12-02 19:02:20 [astonbarclay.gb] INFO: Scrape type for 117207188: 2
2025-12-02 19:02:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117215946, 'registration': 'AF72NTY', 'account': 'GAT002', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV Titanium 5dr', 'mileage': 24504, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2245, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-10-20', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AF72NTY/2025-11-14/image/8a3c2a33-901c-4d8b-95af-88c4b9d82d93_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/7cd2e8c3-622d-49d1-be16-42514e7c7eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/f099c4e3-694c-412c-ba29-4a63f337c64c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/a6c20e78-2d9d-4a50-af37-ecacc1e297f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/45aa1c22-e58c-4bc5-9edb-dd93773a00c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/f9e77de7-68ee-443d-a386-b1d3b1ae1117_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/9104fd53-926f-46c9-89b7-e1906d54abc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/9354bc7a-80fd-4d12-ac14-19c91e912a6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/4b209c4b-7c7d-4a70-9e39-a57d0923a4fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/8b0472d8-f10a-4077-854b-3c86b53b7a74_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 24K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc4b25d4-34dd-43e2-8b09-31c45c248f19.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117215946, 'registration': 'AF72NTY', 'account': 'GAT002', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV Titanium 5dr', 'mileage': 24504, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2245, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-10-20', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AF72NTY/2025-11-14/image/8a3c2a33-901c-4d8b-95af-88c4b9d82d93_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/7cd2e8c3-622d-49d1-be16-42514e7c7eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/f099c4e3-694c-412c-ba29-4a63f337c64c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/a6c20e78-2d9d-4a50-af37-ecacc1e297f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/45aa1c22-e58c-4bc5-9edb-dd93773a00c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/f9e77de7-68ee-443d-a386-b1d3b1ae1117_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/9104fd53-926f-46c9-89b7-e1906d54abc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/9354bc7a-80fd-4d12-ac14-19c91e912a6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/4b209c4b-7c7d-4a70-9e39-a57d0923a4fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/8b0472d8-f10a-4077-854b-3c86b53b7a74_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 24K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc4b25d4-34dd-43e2-8b09-31c45c248f19.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efd85248-7020-50dd-acfc-5423a1ec9774 with identifier: 117215946
2025-12-02 19:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd85248-7020-50dd-acfc-5423a1ec9774 with scrape type 2
2025-12-02 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efd85248-7020-50dd-acfc-5423a1ec9774 with scrape type 2
2025-12-02 19:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: efd85248-7020-50dd-acfc-5423a1ec9774, identifier: 117215946
2025-12-02 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117522663?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507636?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: efd85248-7020-50dd-acfc-5423a1ec9774 with identifier: 117215946
2025-12-02 19:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: efd85248-7020-50dd-acfc-5423a1ec9774 with identifier: 117215946
2025-12-02 19:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: efd85248-7020-50dd-acfc-5423a1ec9774 with identifier: 117215946 to the API
2025-12-02 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27efd85248-7020-50dd-acfc-5423a1ec9774%27 HTTP/1.1" 200 None
2025-12-02 19:02:21 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id efd85248-7020-50dd-acfc-5423a1ec9774: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:20 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117215946?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'efd85248-7020-50dd-acfc-5423a1ec9774',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AF72NTY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117215946',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 24504,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-20',
 'seller_name': 'Gates Group',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV Titanium 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215946%27 HTTP/1.1" 200 None
2025-12-02 19:02:21 [astonbarclay.gb] INFO: Saving data for 117215946: {'auction_closing_time': 1764756000.0, 'created_time': 1763060610.753723, 'last_price_update_time': 1764702141.128924}
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117215946') HTTP/1.1" 204 0
2025-12-02 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bd5ef7b2-716d-4667-9330-ff01f0f81392_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue)
2025-12-02 19:02:21 [astonbarclay.gb] INFO: Found listing with ID: 117207172
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207172%27 HTTP/1.1" 200 None
2025-12-02 19:02:21 [astonbarclay.gb] INFO: Scrape type for 117207172: 2
2025-12-02 19:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08cfe90>
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F2abcfa8c-7f6c-4501-95ef-b2ac19257873_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/2abcfa8c-7f6c-4501-95ef-b2ac19257873_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67123457-1c0a-5cdd-8be3-eb490de642b0
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04df6d0>
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252F4f1b3b64-e21d-4ffa-8b34-246da6053acd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4f1b3b64-e21d-4ffa-8b34-246da6053acd_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4719489b-1fba-5fbc-a000-82ecc981e7c2
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07f0910>
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252F744e863e-1b5f-486b-a867-6d07a6fe24e9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/744e863e-1b5f-486b-a867-6d07a6fe24e9_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b9390>
2025-12-02 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F227aece1-5b16-43ff-8611-8401b154f1ac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/227aece1-5b16-43ff-8611-8401b154f1ac_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac15d0>
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252Fc8071269-6325-4dd4-8f2d-743c682ff0c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/c8071269-6325-4dd4-8f2d-743c682ff0c7_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f
2025-12-02 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19EOB/2025-12-02/image/40f6bcd2-1ff9-4d7c-8035-22aea9e6b361_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue)
2025-12-02 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL17AHX/2025-12-02/image/a7e094bc-bff5-4156-87b3-e4f722520ffd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661923?view=catalogue)
2025-12-02 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3e22fc52-d21c-49d8-a306-547ee494d0f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662353?view=catalogue)
2025-12-02 19:02:22 [astonbarclay.gb] INFO: Found listing with ID: 117002721
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117002721%27 HTTP/1.1" 200 None
2025-12-02 19:02:22 [astonbarclay.gb] INFO: Scrape type for 117002721: 2
2025-12-02 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117024373?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ec7d0>
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252Fe48f57b9-748d-41a0-a19b-370f89bf0efd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/e48f57b9-748d-41a0-a19b-370f89bf0efd_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67123457-1c0a-5cdd-8be3-eb490de642b0
2025-12-02 19:02:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117522663, 'registration': 'BG71TYH', 'account': 'ALL016', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Allure Premium 5dr', 'mileage': 73967, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2320, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BG71TYH/2025-11-28/image/13263582-de89-4129-b8ad-da27f041afc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/85b90a0c-4f15-4a76-b544-b1d94079ddf6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/6c4c344c-9fd7-4c3f-9b6e-d9c0922a3f7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/17c7c74d-1515-46ee-8c8c-1393dc01f89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/4f84c371-6721-439b-bfa1-3c9c03567cba_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/8e79d118-0dea-4070-ad32-d836c5760015_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/0a639390-fac9-40f7-baa5-77cc06b7967f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/82d05868-f590-413e-86b9-273e950758f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/e0231349-9bd2-4092-b366-dd11e91a1688_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/3b5e0636-c630-47f0-8db6-ea95f90cff59_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/22 15K - 07/23 30K - 05/24 46K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES 56K, 73K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2d428ee4-4a0c-43b5-8268-f2c247242ec4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117522663, 'registration': 'BG71TYH', 'account': 'ALL016', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Allure Premium 5dr', 'mileage': 73967, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2320, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BG71TYH/2025-11-28/image/13263582-de89-4129-b8ad-da27f041afc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/85b90a0c-4f15-4a76-b544-b1d94079ddf6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/6c4c344c-9fd7-4c3f-9b6e-d9c0922a3f7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/17c7c74d-1515-46ee-8c8c-1393dc01f89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/4f84c371-6721-439b-bfa1-3c9c03567cba_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/8e79d118-0dea-4070-ad32-d836c5760015_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/0a639390-fac9-40f7-baa5-77cc06b7967f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/82d05868-f590-413e-86b9-273e950758f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/e0231349-9bd2-4092-b366-dd11e91a1688_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG71TYH/2025-11-28/image/3b5e0636-c630-47f0-8db6-ea95f90cff59_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/22 15K - 07/23 30K - 05/24 46K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES 56K, 73K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2d428ee4-4a0c-43b5-8268-f2c247242ec4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 396c716b-c601-50de-8575-d6e91b9b5014 with identifier: 117522663
2025-12-02 19:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 396c716b-c601-50de-8575-d6e91b9b5014 with scrape type 2
2025-12-02 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 396c716b-c601-50de-8575-d6e91b9b5014 with scrape type 2
2025-12-02 19:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 396c716b-c601-50de-8575-d6e91b9b5014, identifier: 117522663
2025-12-02 19:02:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117507636, 'registration': 'EK72GBE', 'account': 'ESS039', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.6 E-TECH Hybrid 140 RS Line 5dr Auto', 'mileage': 12732, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2301, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-21', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-11-05', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK72GBE/2025-11-29/image/c6ed390b-b053-4c3a-a54e-1adf3e5d372b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/acd2f094-898e-43b0-9ce6-d9c9aca003bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/ba0ce354-fe7c-4fc9-80cf-28a33260fd1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/9ee655af-8e28-478e-93f3-28e3f9d3cfcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/4c44e924-38a3-4be0-8c85-f397a910a909_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/3d5fd686-701f-4998-8bdd-098be4de2edc_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/28a04f0e-9962-44fd-b195-2e780d6a9086_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/5a887e49-c174-4ee3-8021-1e0937019479_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/e0dee318-9db3-42ee-94ec-fe37c3daaad5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/c1e5828a-4db8-441c-9c9c-d9e93e15fa01_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 12K', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fa102133-53fb-487f-bb06-65fad13dd283.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117507636, 'registration': 'EK72GBE', 'account': 'ESS039', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.6 E-TECH Hybrid 140 RS Line 5dr Auto', 'mileage': 12732, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2301, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-21', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-11-05', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK72GBE/2025-11-29/image/c6ed390b-b053-4c3a-a54e-1adf3e5d372b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/acd2f094-898e-43b0-9ce6-d9c9aca003bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/ba0ce354-fe7c-4fc9-80cf-28a33260fd1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/9ee655af-8e28-478e-93f3-28e3f9d3cfcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/4c44e924-38a3-4be0-8c85-f397a910a909_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/3d5fd686-701f-4998-8bdd-098be4de2edc_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/28a04f0e-9962-44fd-b195-2e780d6a9086_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/5a887e49-c174-4ee3-8021-1e0937019479_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/e0dee318-9db3-42ee-94ec-fe37c3daaad5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72GBE/2025-11-29/image/c1e5828a-4db8-441c-9c9c-d9e93e15fa01_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 12K', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fa102133-53fb-487f-bb06-65fad13dd283.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2ddde0b-9b9f-5553-b197-c7e8a67f8a45 with identifier: 117507636
2025-12-02 19:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2ddde0b-9b9f-5553-b197-c7e8a67f8a45 with scrape type 2
2025-12-02 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2ddde0b-9b9f-5553-b197-c7e8a67f8a45 with scrape type 2
2025-12-02 19:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c2ddde0b-9b9f-5553-b197-c7e8a67f8a45, identifier: 117507636
2025-12-02 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 396c716b-c601-50de-8575-d6e91b9b5014 with identifier: 117522663
2025-12-02 19:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 396c716b-c601-50de-8575-d6e91b9b5014 with identifier: 117522663
2025-12-02 19:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 396c716b-c601-50de-8575-d6e91b9b5014 with identifier: 117522663 to the API
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27396c716b-c601-50de-8575-d6e91b9b5014%27 HTTP/1.1" 200 None
2025-12-02 19:02:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 396c716b-c601-50de-8575-d6e91b9b5014: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117522663?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '396c716b-c601-50de-8575-d6e91b9b5014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BG71TYH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117522663',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 73967,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seller_name': 'SMC GROUP',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech Allure Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure Premium 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117522663%27 HTTP/1.1" 200 None
2025-12-02 19:02:23 [astonbarclay.gb] INFO: Saving data for 117522663: {'auction_closing_time': 1764756000.0, 'created_time': 1764356647.815289, 'last_price_update_time': 1764702143.077219}
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117522663') HTTP/1.1" 204 0
2025-12-02 19:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c2ddde0b-9b9f-5553-b197-c7e8a67f8a45 with identifier: 117507636
2025-12-02 19:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c2ddde0b-9b9f-5553-b197-c7e8a67f8a45 with identifier: 117507636
2025-12-02 19:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c2ddde0b-9b9f-5553-b197-c7e8a67f8a45 with identifier: 117507636 to the API
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27c2ddde0b-9b9f-5553-b197-c7e8a67f8a45%27 HTTP/1.1" 200 None
2025-12-02 19:02:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id c2ddde0b-9b9f-5553-b197-c7e8a67f8a45: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117507636?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'c2ddde0b-9b9f-5553-b197-c7e8a67f8a45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK72GBE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507636',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'CLIO HATCHBACK',
 'odometer': 12732,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seller_name': 'SMC Group',
 'title': 'RENAULT CLIO HATCHBACK 1.6 E-TECH Hybrid 140 RS Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH Hybrid 140 RS Line 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507636%27 HTTP/1.1" 200 None
2025-12-02 19:02:23 [astonbarclay.gb] INFO: Saving data for 117507636: {'auction_closing_time': 1764756000.0, 'created_time': 1764356615.964975, 'last_price_update_time': 1764702143.462485}
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507636') HTTP/1.1" 204 0
2025-12-02 19:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d5f250>
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fbd5ef7b2-716d-4667-9330-ff01f0f81392_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bd5ef7b2-716d-4667-9330-ff01f0f81392_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/1e598046-c815-46c4-abdb-d527cfb41ec5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue)
2025-12-02 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 117480843
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117480843%27 HTTP/1.1" 200 None
2025-12-02 19:02:23 [astonbarclay.gb] INFO: Scrape type for 117480843: 0
2025-12-02 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 117357391
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117357391%27 HTTP/1.1" 200 None
2025-12-02 19:02:23 [astonbarclay.gb] INFO: Scrape type for 117357391: 2
2025-12-02 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD70MVG/2025-12-02/image/9435d6c4-f83f-423a-a9d1-119f4e90fe34_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue)
2025-12-02 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4aaa9b86-ae7f-44ea-be39-27e98a68467a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662353?view=catalogue)
2025-12-02 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS18MMO/2025-12-02/image/eb0f444d-5ccd-4174-b751-310d29957c4c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue)
2025-12-02 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117256710?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06ca490>
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252F40f6bcd2-1ff9-4d7c-8035-22aea9e6b361_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/40f6bcd2-1ff9-4d7c-8035-22aea9e6b361_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0596310>
2025-12-02 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252Fa7e094bc-bff5-4156-87b3-e4f722520ffd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/a7e094bc-bff5-4156-87b3-e4f722520ffd_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f
2025-12-02 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0596c10>
2025-12-02 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252F3e22fc52-d21c-49d8-a306-547ee494d0f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3e22fc52-d21c-49d8-a306-547ee494d0f7_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4719489b-1fba-5fbc-a000-82ecc981e7c2
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117592979, 'registration': 'AX19OCE', 'account': 'SMC010', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 3dr', 'mileage': 35321, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2303, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-04-01', 'doors': 3, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX19OCE/2025-12-01/image/ab423de8-5422-4764-ab54-6b073aec3eed_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/9bd2475c-1a8f-45a0-bd60-332edfb22ec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4d202cf2-7af0-4b1c-ac8d-9f63083181e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/2cac4f0d-61b6-4d61-ab6d-47af306347f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/b4ed5a7a-79a4-4ca3-9975-2aa43396a084_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4e4023df-36dc-4957-8545-b41f12bda182_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/5f43a055-a446-4d28-a98c-f584e0627747_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/c04ed6f9-e91c-4cfe-a1df-132b93008d26_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/3c18cc03-d1e5-45fa-a525-1e2ebe93f2b7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 03/22 16K - 03/24 27K - 03/25 33K', 'remarks': 'PHOTOCOPY OF CURRENT V5 ONLY - VOSA STATES, 16K, 22K, 27K, 33K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2be181ec-e906-48b1-b137-76e9847ca46d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117592979, 'registration': 'AX19OCE', 'account': 'SMC010', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 3dr', 'mileage': 35321, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2303, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-04-01', 'doors': 3, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX19OCE/2025-12-01/image/ab423de8-5422-4764-ab54-6b073aec3eed_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/9bd2475c-1a8f-45a0-bd60-332edfb22ec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4d202cf2-7af0-4b1c-ac8d-9f63083181e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/2cac4f0d-61b6-4d61-ab6d-47af306347f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/b4ed5a7a-79a4-4ca3-9975-2aa43396a084_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4e4023df-36dc-4957-8545-b41f12bda182_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/5f43a055-a446-4d28-a98c-f584e0627747_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/c04ed6f9-e91c-4cfe-a1df-132b93008d26_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/3c18cc03-d1e5-45fa-a525-1e2ebe93f2b7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 03/22 16K - 03/24 27K - 03/25 33K', 'remarks': 'PHOTOCOPY OF CURRENT V5 ONLY - VOSA STATES, 16K, 22K, 27K, 33K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2be181ec-e906-48b1-b137-76e9847ca46d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab7e8163-878a-5bd5-bf93-2903eae01623 with identifier: 117592979
2025-12-02 19:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab7e8163-878a-5bd5-bf93-2903eae01623 with scrape type 2
2025-12-02 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab7e8163-878a-5bd5-bf93-2903eae01623 with scrape type 2
2025-12-02 19:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ab7e8163-878a-5bd5-bf93-2903eae01623, identifier: 117592979
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117550696, 'registration': 'EX19ZNK', 'account': 'WBA002', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 140 ST-Line 3dr', 'mileage': 25705, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1312, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-29', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/dbc723d2-8fdf-4ef6-ad40-10a76ce6b20e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/997262ef-83c8-49a0-8983-0d04db16ca14_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/b60b8fd2-681c-4eff-91ed-02f3ddc37257_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/304b74c5-6df5-4203-8e39-04671df9e2fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/34d9e36a-0a9e-459b-b7c4-65c7ede650c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/63cda6f6-a44c-47e4-93f4-44ed7f8bc145_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/6f80eb86-6d3c-4f37-ab79-8767fd72693e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/f02372d8-b672-4b6c-9fee-820f37a4dfa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/970d81e7-c299-43ee-8234-126d9c88da9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/d809a779-7294-400b-bf1e-ecd1cd571f49_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/20-5k,  04/21-7k,  05/23-17k,  04/25-23k', 'remarks': 'SPARE KEY - VOSA STATES 12k 16k 20k 23k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e1a1f6b2-45a5-4582-b6c1-9dc2e913ccde.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117550696, 'registration': 'EX19ZNK', 'account': 'WBA002', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 140 ST-Line 3dr', 'mileage': 25705, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1312, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-29', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/dbc723d2-8fdf-4ef6-ad40-10a76ce6b20e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/997262ef-83c8-49a0-8983-0d04db16ca14_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/b60b8fd2-681c-4eff-91ed-02f3ddc37257_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/304b74c5-6df5-4203-8e39-04671df9e2fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/34d9e36a-0a9e-459b-b7c4-65c7ede650c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/63cda6f6-a44c-47e4-93f4-44ed7f8bc145_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/6f80eb86-6d3c-4f37-ab79-8767fd72693e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/f02372d8-b672-4b6c-9fee-820f37a4dfa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/970d81e7-c299-43ee-8234-126d9c88da9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/d809a779-7294-400b-bf1e-ecd1cd571f49_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/20-5k,  04/21-7k,  05/23-17k,  04/25-23k', 'remarks': 'SPARE KEY - VOSA STATES 12k 16k 20k 23k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e1a1f6b2-45a5-4582-b6c1-9dc2e913ccde.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with identifier: 117550696
2025-12-02 19:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with scrape type 2
2025-12-02 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with scrape type 2
2025-12-02 19:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 46b6a300-66a4-57b9-9cf6-1e3aefd40f85, identifier: 117550696
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117024373, 'registration': 'KR18MYC', 'account': 'ALL016', 'make': 'BMW', 'model': '5 SERIES DIESEL SALOON', 'derivative': '520d M Sport 4dr Auto', 'mileage': 87000, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2318, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-04-23', 'fuel': 'Diesel', 'motExpiry': '2026-03-19', 'doors': 4, 'engineSize': 1995, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KR18MYC/2025-11-12/image/275693bd-6e2c-43aa-84ed-c36cc799a414_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/9d68ac40-dc27-4986-a442-f3d71eb20938_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/ac70872b-e467-4733-814f-70161b30a795_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/acd049d3-85ba-4c38-95be-0a8932675e19_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/a494b5fd-58f6-402f-8146-5fcc19410d5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/a0e94fff-3818-4b47-9fcb-a16621460e06_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/4bd22785-28af-4e8a-801e-e28b5441ed35_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/d1b0cb50-0770-4bbc-8feb-6f217f50b17c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/796a2e1c-4b91-47da-ade4-5f29e8f46b98_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/a2bbf15a-a78a-481a-a8c0-6fc18faa7d97_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/fbec8ee3-d57c-440d-b5eb-f2945c7ff0ce_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital SERVICE HISTORY IN KM - 02/19 14km - 08/20 37km - 05/21 53k- 07/22 61km', 'remarks': 'Ex-Private Hire - DISPLAY CLUSTER/ DIALS NOT WORKING OR LIGHTING UP, UNABLE TO READ MILEAGE  - LAST KNOWN MILEAGE AS PER VOSA 85168 MILES  03/2025 TRUE MILEAGE UNKNOWN - CAPPED INCORRECTLY  - VOSA STATES -  38K, 44K, 59K, 59K, 85K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40983e14-d114-4c88-96ce-c3a156517f6b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117024373, 'registration': 'KR18MYC', 'account': 'ALL016', 'make': 'BMW', 'model': '5 SERIES DIESEL SALOON', 'derivative': '520d M Sport 4dr Auto', 'mileage': 87000, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2318, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-04-23', 'fuel': 'Diesel', 'motExpiry': '2026-03-19', 'doors': 4, 'engineSize': 1995, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KR18MYC/2025-11-12/image/275693bd-6e2c-43aa-84ed-c36cc799a414_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/9d68ac40-dc27-4986-a442-f3d71eb20938_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/ac70872b-e467-4733-814f-70161b30a795_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/acd049d3-85ba-4c38-95be-0a8932675e19_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/a494b5fd-58f6-402f-8146-5fcc19410d5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/a0e94fff-3818-4b47-9fcb-a16621460e06_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/4bd22785-28af-4e8a-801e-e28b5441ed35_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/d1b0cb50-0770-4bbc-8feb-6f217f50b17c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/796a2e1c-4b91-47da-ade4-5f29e8f46b98_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/a2bbf15a-a78a-481a-a8c0-6fc18faa7d97_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR18MYC/2025-11-12/image/fbec8ee3-d57c-440d-b5eb-f2945c7ff0ce_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital SERVICE HISTORY IN KM - 02/19 14km - 08/20 37km - 05/21 53k- 07/22 61km', 'remarks': 'Ex-Private Hire - DISPLAY CLUSTER/ DIALS NOT WORKING OR LIGHTING UP, UNABLE TO READ MILEAGE  - LAST KNOWN MILEAGE AS PER VOSA 85168 MILES  03/2025 TRUE MILEAGE UNKNOWN - CAPPED INCORRECTLY  - VOSA STATES -  38K, 44K, 59K, 59K, 85K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40983e14-d114-4c88-96ce-c3a156517f6b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2d7a6ac-4703-59dd-91e0-a00a869af430 with identifier: 117024373
2025-12-02 19:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2d7a6ac-4703-59dd-91e0-a00a869af430 with scrape type 2
2025-12-02 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2d7a6ac-4703-59dd-91e0-a00a869af430 with scrape type 2
2025-12-02 19:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b2d7a6ac-4703-59dd-91e0-a00a869af430, identifier: 117024373
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117605293, 'registration': 'KM69HWX', 'account': 'ALL016', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 53816, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2322, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM69HWX/2025-12-02/image/aa300758-0cf0-438c-b1b4-992c5abb680b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/3b937082-aa30-4679-8229-d3a5d8708729_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/681c7d2a-0bb5-4982-a952-c6e2a02e48de_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/8a2e4109-4e92-47fa-9d29-a799f17a2344_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/e95a8559-82e9-4080-923f-469729c82f87_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/b20ac89f-95fa-4841-af3b-d01c38c5e5f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/4f6110e0-7dde-48f9-836c-18f2c6fe3dea_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/d1532de9-b48e-4bd4-9c41-284d2e40bea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/91a6ecca-eb61-463c-bdbe-3018b9992a09_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/24 38K', 'remarks': 'VOSA STATES  26K - 27K- 38K - 51K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/675faab8-ad82-4d69-8aed-2439c41c0a5a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117605293, 'registration': 'KM69HWX', 'account': 'ALL016', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 53816, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2322, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM69HWX/2025-12-02/image/aa300758-0cf0-438c-b1b4-992c5abb680b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/3b937082-aa30-4679-8229-d3a5d8708729_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/681c7d2a-0bb5-4982-a952-c6e2a02e48de_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/8a2e4109-4e92-47fa-9d29-a799f17a2344_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/e95a8559-82e9-4080-923f-469729c82f87_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/b20ac89f-95fa-4841-af3b-d01c38c5e5f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/4f6110e0-7dde-48f9-836c-18f2c6fe3dea_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/d1532de9-b48e-4bd4-9c41-284d2e40bea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/91a6ecca-eb61-463c-bdbe-3018b9992a09_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/24 38K', 'remarks': 'VOSA STATES  26K - 27K- 38K - 51K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/675faab8-ad82-4d69-8aed-2439c41c0a5a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffb2e0dc-63cf-5790-9da5-de91299ab615 with identifier: 117605293
2025-12-02 19:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb2e0dc-63cf-5790-9da5-de91299ab615 with scrape type 1
2025-12-02 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item ffb2e0dc-63cf-5790-9da5-de91299ab615
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252Faa300758-0cf0-438c-b1b4-992c5abb680b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/aa300758-0cf0-438c-b1b4-992c5abb680b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117631646, 'registration': 'FE17TBU', 'account': 'ESS009', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.4 EcoTSI Xcellence 5dr', 'mileage': 80306, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2319, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-06', 'fuel': 'Petrol', 'motExpiry': '2026-04-07', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FE17TBU/2025-12-02/image/644b0dc9-9399-4166-9862-a72b108e210d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/2db95366-3e57-449a-95ca-2ec56c9b2772_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/f077e1e5-e318-4905-b515-5364ae9196e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/5f50aa41-eff4-4d71-8f57-0bae72f48ed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/35ed20ce-3bdf-4506-87bd-54c236326127_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/6a65d646-dee9-4ce1-89bb-500e945d7244_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/ba710ae2-1ca3-4e70-adb1-e4327d449361_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/034c295f-d569-4a03-91bf-94e2f0bfa825_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/0e0b01f7-1c94-4b37-9bb2-ff8ba479ecea_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/18 18K - 09/20 38K - 09/21 46K - 06/22 50k - 09/22 52k - 09/23 60k - 09/24 68k', 'remarks': 'VOSA STATES, 55K, 63K, 64K, 74K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d85137a-0506-4e13-8440-bed4f048f6eb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117631646, 'registration': 'FE17TBU', 'account': 'ESS009', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.4 EcoTSI Xcellence 5dr', 'mileage': 80306, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2319, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-06', 'fuel': 'Petrol', 'motExpiry': '2026-04-07', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FE17TBU/2025-12-02/image/644b0dc9-9399-4166-9862-a72b108e210d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/2db95366-3e57-449a-95ca-2ec56c9b2772_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/f077e1e5-e318-4905-b515-5364ae9196e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/5f50aa41-eff4-4d71-8f57-0bae72f48ed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/35ed20ce-3bdf-4506-87bd-54c236326127_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/6a65d646-dee9-4ce1-89bb-500e945d7244_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/ba710ae2-1ca3-4e70-adb1-e4327d449361_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/034c295f-d569-4a03-91bf-94e2f0bfa825_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/0e0b01f7-1c94-4b37-9bb2-ff8ba479ecea_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/18 18K - 09/20 38K - 09/21 46K - 06/22 50k - 09/22 52k - 09/23 60k - 09/24 68k', 'remarks': 'VOSA STATES, 55K, 63K, 64K, 74K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d85137a-0506-4e13-8440-bed4f048f6eb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with identifier: 117631646
2025-12-02 19:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with scrape type 1
2025-12-02 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F644b0dc9-9399-4166-9862-a72b108e210d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/644b0dc9-9399-4166-9862-a72b108e210d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Found listing with ID: 117267405
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267405%27 HTTP/1.1" 200 None
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Scrape type for 117267405: 0
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Found listing with ID: 117452123
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452123%27 HTTP/1.1" 200 None
2025-12-02 19:02:24 [astonbarclay.gb] INFO: Scrape type for 117452123: 2
2025-12-02 19:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ab7e8163-878a-5bd5-bf93-2903eae01623 with identifier: 117592979
2025-12-02 19:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ab7e8163-878a-5bd5-bf93-2903eae01623 with identifier: 117592979
2025-12-02 19:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ab7e8163-878a-5bd5-bf93-2903eae01623 with identifier: 117592979 to the API
2025-12-02 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ab7e8163-878a-5bd5-bf93-2903eae01623',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AX19OCE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117592979',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 35321,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'SMC Group',
 'title': 'FORD FIESTA HATCHBACK 1.1 Zetec 3dr',
 'transmission': 'manual',
 'trim': '1.1 Zetec 3dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117592979%27 HTTP/1.1" 200 None
2025-12-02 19:02:25 [astonbarclay.gb] INFO: Saving data for 117592979: {'auction_closing_time': 1764756000.0, 'created_time': 1764615681.722757, 'last_price_update_time': 1764702145.119778}
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117592979') HTTP/1.1" 204 0
2025-12-02 19:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with identifier: 117550696
2025-12-02 19:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with identifier: 117550696
2025-12-02 19:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with identifier: 117550696 to the API
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '46b6a300-66a4-57b9-9cf6-1e3aefd40f85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EX19ZNK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550696',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 25705,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-30',
 'seller_name': 'UKCGR - Premium',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost 140 ST-Line 3dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 140 ST-Line 3dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550696%27 HTTP/1.1" 200 None
2025-12-02 19:02:25 [astonbarclay.gb] INFO: Saving data for 117550696: {'auction_closing_time': 1764756000.0, 'created_time': 1764270374.304636, 'last_price_update_time': 1764702145.435289}
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550696') HTTP/1.1" 204 0
2025-12-02 19:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b2d7a6ac-4703-59dd-91e0-a00a869af430 with identifier: 117024373
2025-12-02 19:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b2d7a6ac-4703-59dd-91e0-a00a869af430 with identifier: 117024373
2025-12-02 19:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b2d7a6ac-4703-59dd-91e0-a00a869af430 with identifier: 117024373 to the API
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b2d7a6ac-4703-59dd-91e0-a00a869af430%27 HTTP/1.1" 200 None
2025-12-02 19:02:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b2d7a6ac-4703-59dd-91e0-a00a869af430: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117024373?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b2d7a6ac-4703-59dd-91e0-a00a869af430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KR18MYC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117024373',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '5 SERIES DIESEL SALOON',
 'odometer': 87000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': 'SMC GROUP',
 'title': 'BMW 5 SERIES DIESEL SALOON 520d M Sport 4dr Auto',
 'transmission': 'automatic',
 'trim': '520d M Sport 4dr Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024373%27 HTTP/1.1" 200 None
2025-12-02 19:02:25 [astonbarclay.gb] INFO: Saving data for 117024373: {'auction_closing_time': 1764756000.0, 'created_time': 1762974274.612844, 'last_price_update_time': 1764702145.706254}
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117024373') HTTP/1.1" 204 0
2025-12-02 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL17AHX/2025-12-02/image/46ebe2eb-e791-41b1-bf4c-eee15f207ff0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661923?view=catalogue)
2025-12-02 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/e8ba6462-5e65-46f6-a029-df88ef3ce973_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue)
2025-12-02 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ecc7fb15-e6b4-4f9c-868e-b094b8092f74_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue)
2025-12-02 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS18MMO/2025-12-02/image/92a974d9-f0db-4f98-8ef3-d9c65aae54e4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue)
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252F3b937082-aa30-4679-8229-d3a5d8708729_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/3b937082-aa30-4679-8229-d3a5d8708729_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F2db95366-3e57-449a-95ca-2ec56c9b2772_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/2db95366-3e57-449a-95ca-2ec56c9b2772_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117569819
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569819%27 HTTP/1.1" 200 None
2025-12-02 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117569819: 2
2025-12-02 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf060bfd0>
2025-12-02 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F1e598046-c815-46c4-abdb-d527cfb41ec5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/1e598046-c815-46c4-abdb-d527cfb41ec5_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0884ad0>
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252F9435d6c4-f83f-423a-a9d1-119f4e90fe34_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/9435d6c4-f83f-423a-a9d1-119f4e90fe34_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05fee10>
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252F4aaa9b86-ae7f-44ea-be39-27e98a68467a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4aaa9b86-ae7f-44ea-be39-27e98a68467a_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4719489b-1fba-5fbc-a000-82ecc981e7c2
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d780d0>
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252Feb0f444d-5ccd-4174-b751-310d29957c4c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/eb0f444d-5ccd-4174-b751-310d29957c4c_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67123457-1c0a-5cdd-8be3-eb490de642b0
2025-12-02 19:02:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117256710, 'registration': 'BV71XTR', 'account': 'SMC036', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 130 GT 5dr EAT8', 'mileage': 24527, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2323, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-01-11', 'fuel': 'Petrol', 'motExpiry': '2026-10-23', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BV71XTR/2025-11-20/image/3629516d-9e51-43cd-95d9-aba0dd80668e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/a026ec4a-2ffc-4979-a731-82578cb6c653_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/06940fac-cd77-4757-a4e1-1efbb225b0d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/8832b595-4130-461d-8a23-7118054e5b1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/e18f8deb-4c62-4d4a-a3c5-b2040060d2cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/6d2a9185-325f-49d1-b23c-3101159d7b4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/b7a35bc9-0024-4e07-8e78-6921b8fc6b13_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/2b4f9501-bf76-4b1f-912e-87e4076d34f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/8616a39f-3f12-4438-abdd-4886de51ca9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/3be1c847-ebae-43ea-829f-07917b96957d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'EMPTY SERVICE BOOK', 'remarks': 'VOSA STATES, 13K, 14K, 24K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC (Allen Motor Group)', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5974bc9c-47ef-47ff-9cc5-10df1e8c9c81.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117256710, 'registration': 'BV71XTR', 'account': 'SMC036', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 130 GT 5dr EAT8', 'mileage': 24527, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2323, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-01-11', 'fuel': 'Petrol', 'motExpiry': '2026-10-23', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BV71XTR/2025-11-20/image/3629516d-9e51-43cd-95d9-aba0dd80668e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/a026ec4a-2ffc-4979-a731-82578cb6c653_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/06940fac-cd77-4757-a4e1-1efbb225b0d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/8832b595-4130-461d-8a23-7118054e5b1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/e18f8deb-4c62-4d4a-a3c5-b2040060d2cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/6d2a9185-325f-49d1-b23c-3101159d7b4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/b7a35bc9-0024-4e07-8e78-6921b8fc6b13_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/2b4f9501-bf76-4b1f-912e-87e4076d34f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/8616a39f-3f12-4438-abdd-4886de51ca9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71XTR/2025-11-20/image/3be1c847-ebae-43ea-829f-07917b96957d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'EMPTY SERVICE BOOK', 'remarks': 'VOSA STATES, 13K, 14K, 24K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC (Allen Motor Group)', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5974bc9c-47ef-47ff-9cc5-10df1e8c9c81.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e10d341-9c22-5b10-b6f1-6817811df593 with identifier: 117256710
2025-12-02 19:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e10d341-9c22-5b10-b6f1-6817811df593 with scrape type 2
2025-12-02 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e10d341-9c22-5b10-b6f1-6817811df593 with scrape type 2
2025-12-02 19:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2e10d341-9c22-5b10-b6f1-6817811df593, identifier: 117256710
2025-12-02 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bb1c5b0f-28e4-4167-8682-387669bca078_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue)
2025-12-02 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19EOB/2025-12-02/image/deb87879-6401-4fe6-a708-c0cac2c0bc0d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue)
2025-12-02 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF66NXS/2025-12-02/image/d397b23e-3a30-459f-bc88-727df0c3f647_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662353?view=catalogue)
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252F681c7d2a-0bb5-4982-a952-c6e2a02e48de_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/681c7d2a-0bb5-4982-a952-c6e2a02e48de_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252Ff077e1e5-e318-4905-b515-5364ae9196e0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/f077e1e5-e318-4905-b515-5364ae9196e0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2e10d341-9c22-5b10-b6f1-6817811df593 with identifier: 117256710
2025-12-02 19:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2e10d341-9c22-5b10-b6f1-6817811df593 with identifier: 117256710
2025-12-02 19:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2e10d341-9c22-5b10-b6f1-6817811df593 with identifier: 117256710 to the API
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272e10d341-9c22-5b10-b6f1-6817811df593%27 HTTP/1.1" 200 None
2025-12-02 19:02:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2e10d341-9c22-5b10-b6f1-6817811df593: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117256710?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2e10d341-9c22-5b10-b6f1-6817811df593',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BV71XTR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117256710',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '208 HATCHBACK',
 'odometer': 24527,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seller_name': 'SMC (Allen Motor Group)',
 'title': 'PEUGEOT 208 HATCHBACK 1.2 PureTech 130 GT 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.2 PureTech 130 GT 5dr EAT8',
 'vin': None,
 'year': 2022}
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256710%27 HTTP/1.1" 200 None
2025-12-02 19:02:27 [astonbarclay.gb] INFO: Saving data for 117256710: {'auction_closing_time': 1764756000.0, 'created_time': 1763578959.50826, 'last_price_update_time': 1764702147.183596}
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117256710') HTTP/1.1" 204 0
2025-12-02 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117425377
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425377%27 HTTP/1.1" 200 None
2025-12-02 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117425377: 2
2025-12-02 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE17TBU/2025-12-02/image/644b0dc9-9399-4166-9862-a72b108e210d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue)
2025-12-02 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM69HWX/2025-12-02/image/aa300758-0cf0-438c-b1b4-992c5abb680b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue)
2025-12-02 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL17AHX/2025-12-02/image/4fc06e3f-8cca-425e-9cfc-637074e2215e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661923?view=catalogue)
2025-12-02 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/5fd14d88-adf2-4929-911c-0249130e453a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue)
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252F8a2e4109-4e92-47fa-9d29-a799f17a2344_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/8a2e4109-4e92-47fa-9d29-a799f17a2344_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F5f50aa41-eff4-4d71-8f57-0bae72f48ed8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/5f50aa41-eff4-4d71-8f57-0bae72f48ed8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117539813?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117568753
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117568753%27 HTTP/1.1" 200 None
2025-12-02 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117568753: 2
2025-12-02 19:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0662b90>
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252F46ebe2eb-e791-41b1-bf4c-eee15f207ff0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/46ebe2eb-e791-41b1-bf4c-eee15f207ff0_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0368fd0>
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252Fe8ba6462-5e65-46f6-a029-df88ef3ce973_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/e8ba6462-5e65-46f6-a029-df88ef3ce973_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05e4bd0>
2025-12-02 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252Fecc7fb15-e6b4-4f9c-868e-b094b8092f74_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ecc7fb15-e6b4-4f9c-868e-b094b8092f74_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0760050>
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F92a974d9-f0db-4f98-8ef3-d9c65aae54e4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/92a974d9-f0db-4f98-8ef3-d9c65aae54e4_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67123457-1c0a-5cdd-8be3-eb490de642b0
2025-12-02 19:02:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117605302, 'registration': 'HK72VGF', 'account': 'ALL016', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 21811, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2324, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-02-06', 'fuel': 'Petrol', 'motExpiry': '2026-09-25', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d2097441-a9b8-4c03-99f6-9cdbf47e5cd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/8fa20397-93b8-4d4f-8652-a9d4e42798aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/bf126592-2a72-40c3-9064-5c235f25b613_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/c1545413-1741-4155-9a15-6aea8b49b4df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/82675e9d-48ff-4af7-8324-278e13a980c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a3164988-f4b7-4226-a441-f55defec4c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a203dec2-b260-49f5-afa2-7eeafebe3134_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d6a6a3a1-e97e-4aa5-ba6d-d2c36eeeb53c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/3622391d-1fae-47c8-abc6-4a8ffb54a62d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/5b622055-c3ba-49c8-b3f7-0bdd21d165ff_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/24 6K - 09/25 21K', 'remarks': 'VOSA STATES 21K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f350f290-78db-4e02-be07-a5b8d09ed44b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117605302, 'registration': 'HK72VGF', 'account': 'ALL016', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 21811, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2324, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-02-06', 'fuel': 'Petrol', 'motExpiry': '2026-09-25', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d2097441-a9b8-4c03-99f6-9cdbf47e5cd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/8fa20397-93b8-4d4f-8652-a9d4e42798aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/bf126592-2a72-40c3-9064-5c235f25b613_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/c1545413-1741-4155-9a15-6aea8b49b4df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/82675e9d-48ff-4af7-8324-278e13a980c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a3164988-f4b7-4226-a441-f55defec4c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a203dec2-b260-49f5-afa2-7eeafebe3134_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d6a6a3a1-e97e-4aa5-ba6d-d2c36eeeb53c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/3622391d-1fae-47c8-abc6-4a8ffb54a62d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/5b622055-c3ba-49c8-b3f7-0bdd21d165ff_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/24 6K - 09/25 21K', 'remarks': 'VOSA STATES 21K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f350f290-78db-4e02-be07-a5b8d09ed44b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbeb631d-6470-5e0f-b9cc-332242767dc1 with identifier: 117605302
2025-12-02 19:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbeb631d-6470-5e0f-b9cc-332242767dc1 with scrape type 1
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbeb631d-6470-5e0f-b9cc-332242767dc1
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fd2097441-a9b8-4c03-99f6-9cdbf47e5cd8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d2097441-a9b8-4c03-99f6-9cdbf47e5cd8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08a7a90>
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD70MVG%252F2025-12-02%252Fimage%252Fbb1c5b0f-28e4-4167-8682-387669bca078_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bb1c5b0f-28e4-4167-8682-387669bca078_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4
2025-12-02 19:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad9b9b48-76f8-59ad-9d41-c83d882f26a4, skipping ID generation
2025-12-02 19:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with scrape type 1
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ad9b9b48-76f8-59ad-9d41-c83d882f26a4 from tracking dictionaries
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4 sending to next pipeline
2025-12-02 19:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ad9b9b48-76f8-59ad-9d41-c83d882f26a4, identifier: 117660087
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ef3c90>
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19EOB%252F2025-12-02%252Fimage%252Fdeb87879-6401-4fe6-a708-c0cac2c0bc0d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19EOB/2025-12-02/image/deb87879-6401-4fe6-a708-c0cac2c0bc0d_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7
2025-12-02 19:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb33cba7-fde2-51bb-8ef6-46e67c9a30f7, skipping ID generation
2025-12-02 19:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with scrape type 1
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 from tracking dictionaries
2025-12-02 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 sending to next pipeline
2025-12-02 19:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cb33cba7-fde2-51bb-8ef6-46e67c9a30f7, identifier: 117661782
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf036a250>
2025-12-02 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF66NXS%252F2025-12-02%252Fimage%252Fd397b23e-3a30-459f-bc88-727df0c3f647_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF66NXS/2025-12-02/image/d397b23e-3a30-459f-bc88-727df0c3f647_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4719489b-1fba-5fbc-a000-82ecc981e7c2
2025-12-02 19:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4719489b-1fba-5fbc-a000-82ecc981e7c2, skipping ID generation
2025-12-02 19:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4719489b-1fba-5fbc-a000-82ecc981e7c2 with scrape type 1
2025-12-02 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4719489b-1fba-5fbc-a000-82ecc981e7c2 from tracking dictionaries
2025-12-02 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4719489b-1fba-5fbc-a000-82ecc981e7c2 sending to next pipeline
2025-12-02 19:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4719489b-1fba-5fbc-a000-82ecc981e7c2, identifier: 117662353
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252Fe95a8559-82e9-4080-923f-469729c82f87_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/e95a8559-82e9-4080-923f-469729c82f87_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F35ed20ce-3bdf-4506-87bd-54c236326127_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/35ed20ce-3bdf-4506-87bd-54c236326127_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with identifier: 117660087
2025-12-02 19:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with identifier: 117660087
2025-12-02 19:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with identifier: 117660087 to the API
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bb1c5b0f-28e4-4167-8682-387669bca078_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'ad9b9b48-76f8-59ad-9d41-c83d882f26a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FD70MVG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117660087',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND X HATCHBACK',
 'odometer': 47042,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32996,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bb1c5b0f-28e4-4167-8682-387669bca078_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34317,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/9435d6c4-f83f-423a-a9d1-119f4e90fe34_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34137,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bd5ef7b2-716d-4667-9330-ff01f0f81392_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33714,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d7dd04b8-e937-4f63-af3a-b8d4afb935f7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84895,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/5ab5850a-ccf1-48f3-a062-44ef4c5aee28_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72321,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/3e87a060-d349-4347-a6d8-ea109f0da041_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50524,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d94def93-7122-496c-a693-700a24ed74e8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46330,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/a5de513b-34a4-4f72-8f27-c42680adb6d0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43364,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/55b525a7-1d87-475a-a34c-015eb1c9d665_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44091,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/c3c852dc-35a4-491b-8c87-be61d14fe8fe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9b9b48-76f8-59ad-9d41-c83d882f26a4/ad9b9b48-76f8-59ad-9d41-c83d882f26a4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43014,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/95fcc619-4c1a-4f66-a40f-1108cb5b2a3a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': 'Wilsons',
 'title': 'VAUXHALL GRANDLAND X HATCHBACK 1.2 Turbo Elite Nav 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo Elite Nav 5dr',
 'vin': None,
 'year': 2020}
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660087%27 HTTP/1.1" 200 None
2025-12-02 19:02:29 [astonbarclay.gb] INFO: Saving data for 117660087: {'created_time': 1764702149.709235, 'last_price_update_time': 1764702149.709246, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117660087') HTTP/1.1" 204 0
2025-12-02 19:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with identifier: 117661782
2025-12-02 19:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with identifier: 117661782
2025-12-02 19:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with identifier: 117661782 to the API
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AX19EOB/2025-12-02/image/deb87879-6401-4fe6-a708-c0cac2c0bc0d_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'cb33cba7-fde2-51bb-8ef6-46e67c9a30f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AX19EOB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117661782',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'HYUNDAI',
 'model': 'KONA HATCHBACK',
 'odometer': 35092,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30094,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/deb87879-6401-4fe6-a708-c0cac2c0bc0d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33918,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ecc7fb15-e6b4-4f9c-868e-b094b8092f74_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32257,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/40f6bcd2-1ff9-4d7c-8035-22aea9e6b361_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31914,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/744e863e-1b5f-486b-a867-6d07a6fe24e9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75116,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ea46bbf0-2291-4923-991a-e4d7ec889044_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57526,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/cbc6017d-c189-43ca-8bc7-5235cfaf0482_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44753,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/5536dae1-42da-4d30-b9cc-122f425aba6d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38059,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/288effb1-8abc-41d4-8a07-d2e858165642_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34769,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/96e1bdc1-e777-490e-8d10-8846db4f4257_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb33cba7-fde2-51bb-8ef6-46e67c9a30f7/cb33cba7-fde2-51bb-8ef6-46e67c9a30f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44936,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/f4187a4f-ffa5-477b-996f-26133ae180da_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-27',
 'seller_name': 'TCB Group - Prime',
 'title': 'HYUNDAI KONA HATCHBACK 1.0T GDi Blue Drive Premium 5dr',
 'transmission': 'manual',
 'trim': '1.0T GDi Blue Drive Premium 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661782%27 HTTP/1.1" 200 None
2025-12-02 19:02:30 [astonbarclay.gb] INFO: Saving data for 117661782: {'created_time': 1764702150.081366, 'last_price_update_time': 1764702150.081377, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117661782') HTTP/1.1" 204 0
2025-12-02 19:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4719489b-1fba-5fbc-a000-82ecc981e7c2 with identifier: 117662353
2025-12-02 19:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4719489b-1fba-5fbc-a000-82ecc981e7c2 with identifier: 117662353
2025-12-02 19:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4719489b-1fba-5fbc-a000-82ecc981e7c2 with identifier: 117662353 to the API
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/GF66NXS/2025-12-02/image/d397b23e-3a30-459f-bc88-727df0c3f647_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '4719489b-1fba-5fbc-a000-82ecc981e7c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GF66NXS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662353',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'BMW',
 'model': '2 SERIES DIESEL CONVERTIBLE',
 'odometer': 76409,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23012,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/d397b23e-3a30-459f-bc88-727df0c3f647_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22335,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4aaa9b86-ae7f-44ea-be39-27e98a68467a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22869,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3e22fc52-d21c-49d8-a306-547ee494d0f7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25055,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/4f1b3b64-e21d-4ffa-8b34-246da6053acd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51630,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/5f208a1f-0607-4660-b860-7672dd9de736_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37376,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/a5e0cb28-673b-4ea7-8be2-091bedc15c73_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88993,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/3de95cae-e3cf-4748-8dc0-9a5bfad51400_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4719489b-1fba-5fbc-a000-82ecc981e7c2/4719489b-1fba-5fbc-a000-82ecc981e7c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53181,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GF66NXS/2025-12-02/image/e5e82012-b5b1-4ad9-b858-45c36be26c8e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-07',
 'seller_name': 'TCB Group - Prime',
 'title': 'BMW 2 SERIES DIESEL CONVERTIBLE 218d [150] M Sport 2dr [Nav] Step '
          'Auto',
 'transmission': 'automatic',
 'trim': '218d [150] M Sport 2dr [Nav] Step Auto',
 'vin': None,
 'year': 2016}
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662353%27 HTTP/1.1" 200 None
2025-12-02 19:02:30 [astonbarclay.gb] INFO: Saving data for 117662353: {'created_time': 1764702150.42972, 'last_price_update_time': 1764702150.429733, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662353') HTTP/1.1" 204 0
2025-12-02 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE17TBU/2025-12-02/image/2db95366-3e57-449a-95ca-2ec56c9b2772_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue)
2025-12-02 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM69HWX/2025-12-02/image/3b937082-aa30-4679-8229-d3a5d8708729_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue)
2025-12-02 19:02:30 [astonbarclay.gb] INFO: Found listing with ID: 117599337
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599337%27 HTTP/1.1" 200 None
2025-12-02 19:02:30 [astonbarclay.gb] INFO: Scrape type for 117599337: 2
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252F8fa20397-93b8-4d4f-8652-a9d4e42798aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/8fa20397-93b8-4d4f-8652-a9d4e42798aa_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS18MMO/2025-12-02/image/6a82ce94-55c1-40cd-86aa-02c1e9d4e2a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue)
2025-12-02 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE17TBU/2025-12-02/image/f077e1e5-e318-4905-b515-5364ae9196e0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue)
2025-12-02 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM18VOU/2025-12-02/image/090a5132-1f03-443e-96d4-96f401d70feb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662383?view=catalogue)
2025-12-02 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM69HWX/2025-12-02/image/681c7d2a-0bb5-4982-a952-c6e2a02e48de_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue)
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252Fb20ac89f-95fa-4841-af3b-d01c38c5e5f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/b20ac89f-95fa-4841-af3b-d01c38c5e5f9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F6a65d646-dee9-4ce1-89bb-500e945d7244_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/6a65d646-dee9-4ce1-89bb-500e945d7244_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117207172?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117545284?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117207188?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117627985?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117627604?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1215710>
2025-12-02 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F644b0dc9-9399-4166-9862-a72b108e210d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/644b0dc9-9399-4166-9862-a72b108e210d_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb
2025-12-02 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf337fd90>
2025-12-02 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252Faa300758-0cf0-438c-b1b4-992c5abb680b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/aa300758-0cf0-438c-b1b4-992c5abb680b_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffb2e0dc-63cf-5790-9da5-de91299ab615
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf086f410>
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL17AHX%252F2025-12-02%252Fimage%252F4fc06e3f-8cca-425e-9cfc-637074e2215e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL17AHX/2025-12-02/image/4fc06e3f-8cca-425e-9cfc-637074e2215e_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f
2025-12-02 19:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f, skipping ID generation
2025-12-02 19:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f with scrape type 1
2025-12-02 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f from tracking dictionaries
2025-12-02 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f sending to next pipeline
2025-12-02 19:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f, identifier: 117661923
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07ac550>
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F5fd14d88-adf2-4929-911c-0249130e453a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/5fd14d88-adf2-4929-911c-0249130e453a_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:02:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117539813, 'registration': 'LC74SFU', 'account': 'THE109', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Excite 5dr', 'mileage': 10991, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2404, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-10-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LC74SFU/2025-11-29/image/70b57690-e276-4190-8af2-79ef6ddc123a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/c17b4c72-96b0-47ad-8b7b-4e1131a9175e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/fb5cb6b0-f74d-4fe3-9a2e-85d3cec041cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/fae448be-5ce8-4cdf-b17f-420b21ec6c10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/666d649d-cfb3-4dcd-b45a-a597f0740be6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/d0366e2b-e3a6-4b8c-b91c-8b9a1a3a751a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/147d070b-9409-4aab-aa2b-b8474cb5d07f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/ac4070b0-15b0-44e3-a504-c79cdf2f0d16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/bcf764a3-03a8-4c23-be40-8f6fad5d048d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/25- 10K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a9106f0d-4bab-4800-b575-dcc0384eda24.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117539813, 'registration': 'LC74SFU', 'account': 'THE109', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Excite 5dr', 'mileage': 10991, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2404, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-10-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LC74SFU/2025-11-29/image/70b57690-e276-4190-8af2-79ef6ddc123a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/c17b4c72-96b0-47ad-8b7b-4e1131a9175e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/fb5cb6b0-f74d-4fe3-9a2e-85d3cec041cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/fae448be-5ce8-4cdf-b17f-420b21ec6c10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/666d649d-cfb3-4dcd-b45a-a597f0740be6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/d0366e2b-e3a6-4b8c-b91c-8b9a1a3a751a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/147d070b-9409-4aab-aa2b-b8474cb5d07f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/ac4070b0-15b0-44e3-a504-c79cdf2f0d16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/bcf764a3-03a8-4c23-be40-8f6fad5d048d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/25- 10K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a9106f0d-4bab-4800-b575-dcc0384eda24.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with identifier: 117539813
2025-12-02 19:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with scrape type 2
2025-12-02 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with scrape type 2
2025-12-02 19:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fdb2fdc2-a124-5806-b72d-0aa1cb2e9762, identifier: 117539813
2025-12-02 19:02:31 [astonbarclay.gb] INFO: Found listing with ID: 117217399
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217399%27 HTTP/1.1" 200 None
2025-12-02 19:02:31 [astonbarclay.gb] INFO: Scrape type for 117217399: 2
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fbf126592-2a72-40c3-9064-5c235f25b613_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/bf126592-2a72-40c3-9064-5c235f25b613_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f with identifier: 117661923
2025-12-02 19:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f with identifier: 117661923
2025-12-02 19:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f with identifier: 117661923 to the API
2025-12-02 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NL17AHX/2025-12-02/image/4fc06e3f-8cca-425e-9cfc-637074e2215e_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL17AHX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117661923',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VAUXHALL',
 'model': 'MOKKA X HATCHBACK',
 'odometer': 47817,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36933,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/4fc06e3f-8cca-425e-9cfc-637074e2215e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36099,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/46ebe2eb-e791-41b1-bf4c-eee15f207ff0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36183,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/a7e094bc-bff5-4156-87b3-e4f722520ffd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33551,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/c8071269-6325-4dd4-8f2d-743c682ff0c7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50792,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/ca2d2dac-6a86-411c-8ac4-7632546af028_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44832,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/21e4c5f5-4b42-4dc3-9145-94b55612a23a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50074,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/b9e5f552-9d7f-45c8-a2d2-c7095da6a44e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53133,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/cb27b343-ef8f-4511-b30e-9b5cd1188805_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f/ef2b9444-e01c-5a15-b6d9-afd2bc1b8f7f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88607,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/NL17AHX/2025-12-02/image/41f02a38-2e62-4634-9a46-ac1b4c2db1cc_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-08',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL MOKKA X HATCHBACK 1.4T Elite 5dr',
 'transmission': 'manual',
 'trim': '1.4T Elite 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661923%27 HTTP/1.1" 200 None
2025-12-02 19:02:32 [astonbarclay.gb] INFO: Saving data for 117661923: {'created_time': 1764702152.224694, 'last_price_update_time': 1764702152.224705, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117661923') HTTP/1.1" 204 0
2025-12-02 19:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with identifier: 117539813
2025-12-02 19:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with identifier: 117539813
2025-12-02 19:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with identifier: 117539813 to the API
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fdb2fdc2-a124-5806-b72d-0aa1cb2e9762%27 HTTP/1.1" 200 None
2025-12-02 19:02:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fdb2fdc2-a124-5806-b72d-0aa1cb2e9762: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:31 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117539813?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'fdb2fdc2-a124-5806-b72d-0aa1cb2e9762',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LC74SFU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117539813',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'MG3 HATCHBACK',
 'odometer': 10991,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-17',
 'seller_name': 'TCB Group - Prime',
 'title': 'MG MOTOR UK MG3 HATCHBACK 1.5 VTi-TECH Excite 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTi-TECH Excite 5dr',
 'vin': None,
 'year': 2024}
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539813%27 HTTP/1.1" 200 None
2025-12-02 19:02:32 [astonbarclay.gb] INFO: Saving data for 117539813: {'auction_closing_time': 1764756000.0, 'created_time': 1764356773.151338, 'last_price_update_time': 1764702152.529308}
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117539813') HTTP/1.1" 204 0
2025-12-02 19:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252F4f6110e0-7dde-48f9-836c-18f2c6fe3dea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/4f6110e0-7dde-48f9-836c-18f2c6fe3dea_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252Fba710ae2-1ca3-4e70-adb1-e4327d449361_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/ba710ae2-1ca3-4e70-adb1-e4327d449361_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117357391?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07ac450>
2025-12-02 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F2db95366-3e57-449a-95ca-2ec56c9b2772_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/2db95366-3e57-449a-95ca-2ec56c9b2772_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb
2025-12-02 19:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf095d0d0>
2025-12-02 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252F3b937082-aa30-4679-8229-d3a5d8708729_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/3b937082-aa30-4679-8229-d3a5d8708729_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffb2e0dc-63cf-5790-9da5-de91299ab615
2025-12-02 19:02:33 [astonbarclay.gb] INFO: Found listing with ID: 114036273
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114036273%27 HTTP/1.1" 200 None
2025-12-02 19:02:33 [astonbarclay.gb] INFO: Scrape type for 114036273: 2
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fc1545413-1741-4155-9a15-6aea8b49b4df_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/c1545413-1741-4155-9a15-6aea8b49b4df_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0588090>
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F6a82ce94-55c1-40cd-86aa-02c1e9d4e2a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/6a82ce94-55c1-40cd-86aa-02c1e9d4e2a2_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67123457-1c0a-5cdd-8be3-eb490de642b0
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf049bbd0>
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252Ff077e1e5-e318-4905-b515-5364ae9196e0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/f077e1e5-e318-4905-b515-5364ae9196e0_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf049ab90>
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252F090a5132-1f03-443e-96d4-96f401d70feb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/090a5132-1f03-443e-96d4-96f401d70feb_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 52669e31-67d3-5cd8-9ca1-4e345de83c70
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06dcd10>
2025-12-02 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252F681c7d2a-0bb5-4982-a952-c6e2a02e48de_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/681c7d2a-0bb5-4982-a952-c6e2a02e48de_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffb2e0dc-63cf-5790-9da5-de91299ab615
2025-12-02 19:02:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117207172, 'registration': 'LP68KPL', 'account': 'AST002', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '1.5 VTEC Turbo SR 5dr', 'mileage': 66046, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2410, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-21', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP68KPL/2025-11-18/image/818c0937-a52a-4ead-b74f-7a340b4c9b4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b3ecac5c-d76a-4609-ad45-6a9b745ed809_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/7993ee14-3934-4d82-a5cc-2b1a8ab270c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/478e66a8-0389-4321-8355-d9461ba23778_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/4427cadb-798b-45b7-ac11-0f8fe0780deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/5771ba0e-d625-40e5-9f30-a3233047e8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/245f69b9-724d-4eca-9e94-b9628cef4a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/9ec46779-9821-4bca-99df-29192a601705_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b9ba36ce-e586-4a49-82d2-e9ceb5e08cf1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**Intermittent EML - CHECK ASSURED REPORT - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - VOSA STATES, 40K, 48K, 55K, 63K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5d6c9cb-3550-4ac2-b87a-9dd71fc34512.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117207172, 'registration': 'LP68KPL', 'account': 'AST002', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '1.5 VTEC Turbo SR 5dr', 'mileage': 66046, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2410, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-21', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP68KPL/2025-11-18/image/818c0937-a52a-4ead-b74f-7a340b4c9b4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b3ecac5c-d76a-4609-ad45-6a9b745ed809_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/7993ee14-3934-4d82-a5cc-2b1a8ab270c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/478e66a8-0389-4321-8355-d9461ba23778_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/4427cadb-798b-45b7-ac11-0f8fe0780deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/5771ba0e-d625-40e5-9f30-a3233047e8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/245f69b9-724d-4eca-9e94-b9628cef4a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/9ec46779-9821-4bca-99df-29192a601705_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b9ba36ce-e586-4a49-82d2-e9ceb5e08cf1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**Intermittent EML - CHECK ASSURED REPORT - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - VOSA STATES, 40K, 48K, 55K, 63K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5d6c9cb-3550-4ac2-b87a-9dd71fc34512.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-12-02 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92454ddf-1dc2-588e-b630-dd71f18ddd7a with scrape type 2
2025-12-02 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92454ddf-1dc2-588e-b630-dd71f18ddd7a with scrape type 2
2025-12-02 19:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 92454ddf-1dc2-588e-b630-dd71f18ddd7a, identifier: 117207172
2025-12-02 19:02:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117545284, 'registration': 'MD19SWX', 'account': 'THE109', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr Auto', 'mileage': 23614, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2405, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-06-10', 'fuel': 'Petrol', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MD19SWX/2025-11-29/image/38cf12c8-49e7-4f7a-818b-854d04486e66_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/2a13e14d-00b2-44e0-a452-f2e6ab521bc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/6b512b7d-1954-4176-894a-8c99495f9d8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/0998485a-de83-4874-bd8b-779f193ee8fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/00beca97-e0bc-40a7-8119-97f64a30e4dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/7222f370-fccf-4402-b5df-43d3150194b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/91fd7cb1-bbf9-4154-9944-d1c514c59d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/f405a276-f1d6-48b7-96d2-081406978826_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/655f7e7a-daa3-438f-893d-6d269f21f5a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/4117c717-511a-4688-95fc-801bef2ff1aa_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/22@11K', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is all over and front end MOT STATES 01/23@11K 01/24@16K 01/25@20K SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/571c5112-aa17-4563-9acb-0e13df3f17ea.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117545284, 'registration': 'MD19SWX', 'account': 'THE109', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr Auto', 'mileage': 23614, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2405, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-06-10', 'fuel': 'Petrol', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MD19SWX/2025-11-29/image/38cf12c8-49e7-4f7a-818b-854d04486e66_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/2a13e14d-00b2-44e0-a452-f2e6ab521bc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/6b512b7d-1954-4176-894a-8c99495f9d8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/0998485a-de83-4874-bd8b-779f193ee8fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/00beca97-e0bc-40a7-8119-97f64a30e4dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/7222f370-fccf-4402-b5df-43d3150194b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/91fd7cb1-bbf9-4154-9944-d1c514c59d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/f405a276-f1d6-48b7-96d2-081406978826_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/655f7e7a-daa3-438f-893d-6d269f21f5a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD19SWX/2025-11-29/image/4117c717-511a-4688-95fc-801bef2ff1aa_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/22@11K', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is all over and front end MOT STATES 01/23@11K 01/24@16K 01/25@20K SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/571c5112-aa17-4563-9acb-0e13df3f17ea.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c2a2b17-ea58-5cb8-a56a-63b96e02ed23 with identifier: 117545284
2025-12-02 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c2a2b17-ea58-5cb8-a56a-63b96e02ed23 with scrape type 2
2025-12-02 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c2a2b17-ea58-5cb8-a56a-63b96e02ed23 with scrape type 2
2025-12-02 19:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3c2a2b17-ea58-5cb8-a56a-63b96e02ed23, identifier: 117545284
2025-12-02 19:02:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117207188, 'registration': 'BU21HYC', 'account': 'AST002', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK SPECIAL EDITION', 'derivative': '1.0 T3 GSE Night Eagle II 5dr', 'mileage': 21876, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2409, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-17', 'fuel': 'Petrol', 'motExpiry': '2025-01-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BU21HYC/2025-11-18/image/e5c75224-a802-435f-b578-43508d0d9506_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/f2246be3-a9a6-496e-8c3d-5276412848e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/868263ca-69d0-413f-b361-6faa173d1a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9687693f-f640-455e-992b-fb7c63681dff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9f51af8f-617f-4146-acd0-f946bc471cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/82262a13-56d8-432a-bc7f-d520bca1776b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/d8f211c2-7bc0-4e94-b841-5d3006565666_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/ac0761ea-9300-4a59-90e6-9cc6cc027e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9fafc760-c61d-413b-9f99-67501b31c105_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/356e5c26-9467-4311-96b3-daa734bae976_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/22-5k,  02/23-11k,  01/24-18k', 'remarks': '**STARTS & RUNS BUT INTERMITTEN EML ILLUMINATED - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a929741f-2f35-43d3-a9cb-28dda0f6780c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117207188, 'registration': 'BU21HYC', 'account': 'AST002', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK SPECIAL EDITION', 'derivative': '1.0 T3 GSE Night Eagle II 5dr', 'mileage': 21876, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2409, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-17', 'fuel': 'Petrol', 'motExpiry': '2025-01-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BU21HYC/2025-11-18/image/e5c75224-a802-435f-b578-43508d0d9506_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/f2246be3-a9a6-496e-8c3d-5276412848e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/868263ca-69d0-413f-b361-6faa173d1a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9687693f-f640-455e-992b-fb7c63681dff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9f51af8f-617f-4146-acd0-f946bc471cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/82262a13-56d8-432a-bc7f-d520bca1776b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/d8f211c2-7bc0-4e94-b841-5d3006565666_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/ac0761ea-9300-4a59-90e6-9cc6cc027e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9fafc760-c61d-413b-9f99-67501b31c105_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/356e5c26-9467-4311-96b3-daa734bae976_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/22-5k,  02/23-11k,  01/24-18k', 'remarks': '**STARTS & RUNS BUT INTERMITTEN EML ILLUMINATED - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a929741f-2f35-43d3-a9cb-28dda0f6780c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-12-02 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3e9c6c-f246-5405-ac96-76e6a1737954 with scrape type 2
2025-12-02 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e3e9c6c-f246-5405-ac96-76e6a1737954 with scrape type 2
2025-12-02 19:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0e3e9c6c-f246-5405-ac96-76e6a1737954, identifier: 117207188
2025-12-02 19:02:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117627985, 'registration': 'LO71OFM', 'account': 'STE097', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Exclusive 5dr Auto', 'mileage': 50696, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1127, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-02-17', 'fuel': 'Petrol', 'motExpiry': '2026-04-09', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO71OFM/2025-12-02/image/54aa7f6e-62eb-4408-9a6c-39cbeed1e0b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ee974730-016d-4060-a593-106a091b69db_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/21387fd4-ab1f-43a1-bb3e-ba800d44b816_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/79df732d-9c48-4c67-950f-1903b32b3a8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ab44aa71-90b0-4611-bb86-2992a8d3e64a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/c34b9904-d488-4ed1-bc85-4d0bee777443_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/6bf99182-fbab-403d-8b66-e832764e5e6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/50dbcbbb-296c-4ee0-b9bf-c25183032778_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/51d63936-4432-42a2-bb12-c6ed3ec9e4f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/18d56b22-0c94-4e7d-9175-26fe89ff82f3_removebg.jpg?w=600'], 'colour': 'BLUE/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 07/23 16K', 'remarks': 'VOSA STATES, 41K', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13afa8ee-a6ad-43e9-a08e-19bf76e03111.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117627985, 'registration': 'LO71OFM', 'account': 'STE097', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Exclusive 5dr Auto', 'mileage': 50696, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1127, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-02-17', 'fuel': 'Petrol', 'motExpiry': '2026-04-09', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO71OFM/2025-12-02/image/54aa7f6e-62eb-4408-9a6c-39cbeed1e0b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ee974730-016d-4060-a593-106a091b69db_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/21387fd4-ab1f-43a1-bb3e-ba800d44b816_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/79df732d-9c48-4c67-950f-1903b32b3a8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ab44aa71-90b0-4611-bb86-2992a8d3e64a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/c34b9904-d488-4ed1-bc85-4d0bee777443_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/6bf99182-fbab-403d-8b66-e832764e5e6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/50dbcbbb-296c-4ee0-b9bf-c25183032778_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/51d63936-4432-42a2-bb12-c6ed3ec9e4f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/18d56b22-0c94-4e7d-9175-26fe89ff82f3_removebg.jpg?w=600'], 'colour': 'BLUE/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 07/23 16K', 'remarks': 'VOSA STATES, 41K', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13afa8ee-a6ad-43e9-a08e-19bf76e03111.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 506582ff-1440-5046-adbb-d8614199e03f with identifier: 117627985
2025-12-02 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 506582ff-1440-5046-adbb-d8614199e03f with scrape type 1
2025-12-02 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 506582ff-1440-5046-adbb-d8614199e03f
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F54aa7f6e-62eb-4408-9a6c-39cbeed1e0b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/54aa7f6e-62eb-4408-9a6c-39cbeed1e0b3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117627604, 'registration': 'LT22VVW', 'account': 'STE097', 'make': 'TOYOTA', 'model': 'AYGO X HATCHBACK', 'derivative': '1.0 VVT-i Limited Edition 5dr', 'mileage': 16378, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1128, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-07-19', 'fuel': 'Petrol', 'motExpiry': '2026-07-18', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT22VVW/2025-12-02/image/f1904dc5-a25a-4cac-926b-0b269acc8434_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/2b2b908f-ebed-4c6c-9d89-19c79b496cd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e2750ea5-a799-47f9-b20a-fe9f4e3eda75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5aeac550-dae8-45e1-ae75-065bc0e7bf75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5978c5df-90f8-4a20-8b61-d45427cb7d68_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e8c97a5e-92de-4970-b44b-d2153ed642e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/c73a5cf2-c085-4eda-8389-c8efc01abfa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/baf066c5-771d-4558-94b6-7ffbaf0e12c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/372b7cde-d79c-4301-b12d-50aec7a4abb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/683baaa5-4251-40f2-a49b-628d1c1b7bd7_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23 6K - 11/24 12K - 10/25 16K', 'remarks': 'VOSA STATES 15K', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/80aeb884-d9da-4b79-9ec9-bfde6b9fb974.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117627604, 'registration': 'LT22VVW', 'account': 'STE097', 'make': 'TOYOTA', 'model': 'AYGO X HATCHBACK', 'derivative': '1.0 VVT-i Limited Edition 5dr', 'mileage': 16378, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1128, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-07-19', 'fuel': 'Petrol', 'motExpiry': '2026-07-18', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT22VVW/2025-12-02/image/f1904dc5-a25a-4cac-926b-0b269acc8434_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/2b2b908f-ebed-4c6c-9d89-19c79b496cd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e2750ea5-a799-47f9-b20a-fe9f4e3eda75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5aeac550-dae8-45e1-ae75-065bc0e7bf75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5978c5df-90f8-4a20-8b61-d45427cb7d68_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e8c97a5e-92de-4970-b44b-d2153ed642e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/c73a5cf2-c085-4eda-8389-c8efc01abfa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/baf066c5-771d-4558-94b6-7ffbaf0e12c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/372b7cde-d79c-4301-b12d-50aec7a4abb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/683baaa5-4251-40f2-a49b-628d1c1b7bd7_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23 6K - 11/24 12K - 10/25 16K', 'remarks': 'VOSA STATES 15K', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/80aeb884-d9da-4b79-9ec9-bfde6b9fb974.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10c872fd-9e40-56e1-abab-9ea4dadc8e0b with identifier: 117627604
2025-12-02 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b with scrape type 1
2025-12-02 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252Ff1904dc5-a25a-4cac-926b-0b269acc8434_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/f1904dc5-a25a-4cac-926b-0b269acc8434_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM69HWX/2025-12-02/image/8a2e4109-4e92-47fa-9d29-a799f17a2344_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue)
2025-12-02 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE17TBU/2025-12-02/image/5f50aa41-eff4-4d71-8f57-0bae72f48ed8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue)
2025-12-02 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM69HWX/2025-12-02/image/e95a8559-82e9-4080-923f-469729c82f87_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue)
2025-12-02 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d2097441-a9b8-4c03-99f6-9cdbf47e5cd8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue)
2025-12-02 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE17TBU/2025-12-02/image/35ed20ce-3bdf-4506-87bd-54c236326127_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue)
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252Fd1532de9-b48e-4bd4-9c41-284d2e40bea2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/d1532de9-b48e-4bd4-9c41-284d2e40bea2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F034c295f-d569-4a03-91bf-94e2f0bfa825_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/034c295f-d569-4a03-91bf-94e2f0bfa825_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-12-02 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-12-02 19:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172 to the API
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117207172?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '92454ddf-1dc2-588e-b630-dd71f18ddd7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP68KPL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117207172',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'CR-V ESTATE',
 'odometer': 66046,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-21',
 'seller_name': 'TCB Group - Prime',
 'title': 'HONDA CR-V ESTATE 1.5 VTEC Turbo SR 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTEC Turbo SR 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207172%27 HTTP/1.1" 200 None
2025-12-02 19:02:34 [astonbarclay.gb] INFO: Saving data for 117207172: {'auction_closing_time': 1764756000.0, 'created_time': 1763449278.224542, 'last_price_update_time': 1764702154.86913}
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117207172') HTTP/1.1" 204 0
2025-12-02 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3c2a2b17-ea58-5cb8-a56a-63b96e02ed23 with identifier: 117545284
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:02:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=YELLOW HTTP/1.1" 200 None
2025-12-02 19:02:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3c2a2b17-ea58-5cb8-a56a-63b96e02ed23 with identifier: 117545284
2025-12-02 19:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3c2a2b17-ea58-5cb8-a56a-63b96e02ed23 with identifier: 117545284 to the API
2025-12-02 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273c2a2b17-ea58-5cb8-a56a-63b96e02ed23%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3c2a2b17-ea58-5cb8-a56a-63b96e02ed23: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117545284?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'YELLOW',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3c2a2b17-ea58-5cb8-a56a-63b96e02ed23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MD19SWX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117545284',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'ECOSPORT HATCHBACK',
 'odometer': 23614,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD ECOSPORT HATCHBACK 1.0 EcoBoost 125 Titanium 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.0 EcoBoost 125 Titanium 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117545284%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Saving data for 117545284: {'auction_closing_time': 1764756000.0, 'created_time': 1764356772.783455, 'last_price_update_time': 1764702156.109671}
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117545284') HTTP/1.1" 204 0
2025-12-02 19:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-12-02 19:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-12-02 19:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188 to the API
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117207188?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0e3e9c6c-f246-5405-ac96-76e6a1737954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BU21HYC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117207188',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'RENEGADE HATCHBACK SPECIAL EDITION',
 'odometer': 21876,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-17',
 'seller_name': 'TCB Group - Prime',
 'title': 'JEEP RENEGADE HATCHBACK SPECIAL EDITION 1.0 T3 GSE Night Eagle II '
          '5dr',
 'transmission': 'manual',
 'trim': '1.0 T3 GSE Night Eagle II 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207188%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Saving data for 117207188: {'auction_closing_time': 1764756000.0, 'created_time': 1763492568.692688, 'last_price_update_time': 1764702156.378024}
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117207188') HTTP/1.1" 204 0
2025-12-02 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HK72VGF/2025-12-02/image/8fa20397-93b8-4d4f-8652-a9d4e42798aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue)
2025-12-02 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS18MMO/2025-12-02/image/3f4f2b49-3ec9-4eda-b368-157b402a9d03_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue)
2025-12-02 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM18VOU/2025-12-02/image/ab181ea5-aa04-49b5-9fb1-c0525ba02149_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662383?view=catalogue)
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Found listing with ID: 117079065
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117079065%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Scrape type for 117079065: 2
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252F82675e9d-48ff-4af7-8324-278e13a980c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/82675e9d-48ff-4af7-8324-278e13a980c3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252Fee974730-016d-4060-a593-106a091b69db_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ee974730-016d-4060-a593-106a091b69db_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252F2b2b908f-ebed-4c6c-9d89-19c79b496cd2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/2b2b908f-ebed-4c6c-9d89-19c79b496cd2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117569819?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117357391, 'registration': 'MD65ZGJ', 'account': 'ATA001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E350 BlueTEC AMG Night Ed Premium 4dr 9G-Tronic', 'mileage': 114245, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2415, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2015-12-31', 'fuel': 'Diesel', 'motExpiry': '2025-10-18', 'doors': 4, 'engineSize': 2987, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/e75845a7-ff1e-4d8f-a5d3-1bc426c0f621_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/98787ba9-3b07-4f04-8695-ed791eec5b21_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/ef17cd06-8ac6-4c1c-aec0-987a18b6213d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/dbe961d9-9a4f-4b4b-93d8-58be6ec87e81_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/39883fdf-758a-4dd8-9db1-6a1fc9460963_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/acdf63f3-e504-41f5-89a9-3a188f05925a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/20ce900a-7cd9-42d9-abff-27aa73e79582_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/80449f7a-12fc-425c-ba18-b693bf618e99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/97f3ef64-7d92-41bb-9c7d-806403c7c491_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/17 25K - 06/21 68K - 12/21 72K - 12/22 81K - 02/24 95K - 10/24 103K', 'remarks': 'VOSA STATES, 72K, 78K, 91K, 103K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6e05b61b-9d6e-4b66-877b-a23c2fee261c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117357391, 'registration': 'MD65ZGJ', 'account': 'ATA001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E350 BlueTEC AMG Night Ed Premium 4dr 9G-Tronic', 'mileage': 114245, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2415, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2015-12-31', 'fuel': 'Diesel', 'motExpiry': '2025-10-18', 'doors': 4, 'engineSize': 2987, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/e75845a7-ff1e-4d8f-a5d3-1bc426c0f621_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/98787ba9-3b07-4f04-8695-ed791eec5b21_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/ef17cd06-8ac6-4c1c-aec0-987a18b6213d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/dbe961d9-9a4f-4b4b-93d8-58be6ec87e81_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/39883fdf-758a-4dd8-9db1-6a1fc9460963_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/acdf63f3-e504-41f5-89a9-3a188f05925a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/20ce900a-7cd9-42d9-abff-27aa73e79582_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/80449f7a-12fc-425c-ba18-b693bf618e99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/97f3ef64-7d92-41bb-9c7d-806403c7c491_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/17 25K - 06/21 68K - 12/21 72K - 12/22 81K - 02/24 95K - 10/24 103K', 'remarks': 'VOSA STATES, 72K, 78K, 91K, 103K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6e05b61b-9d6e-4b66-877b-a23c2fee261c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9926db2-eb01-5575-baac-fcdfc0a1b314 with identifier: 117357391
2025-12-02 19:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9926db2-eb01-5575-baac-fcdfc0a1b314 with scrape type 2
2025-12-02 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9926db2-eb01-5575-baac-fcdfc0a1b314 with scrape type 2
2025-12-02 19:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f9926db2-eb01-5575-baac-fcdfc0a1b314, identifier: 117357391
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252F91a6ecca-eb61-463c-bdbe-3018b9992a09_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/91a6ecca-eb61-463c-bdbe-3018b9992a09_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F0e0b01f7-1c94-4b37-9bb2-ff8ba479ecea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/0e0b01f7-1c94-4b37-9bb2-ff8ba479ecea_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f9926db2-eb01-5575-baac-fcdfc0a1b314 with identifier: 117357391
2025-12-02 19:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f9926db2-eb01-5575-baac-fcdfc0a1b314 with identifier: 117357391
2025-12-02 19:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183859 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183859
2025-12-02 19:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f9926db2-eb01-5575-baac-fcdfc0a1b314 spider: astonbarclay.gb
2025-12-02 19:02:36 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f9926db2-eb01-5575-baac-fcdfc0a1b314 due to rule: high_mileage_for_country.json, error: 183859 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183859
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f9926db2-eb01-5575-baac-fcdfc0a1b314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MD65ZGJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117357391',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS DIESEL SALOON',
 'odometer': 114245,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': 'Auction Plus',
 'title': 'MERCEDES-BENZ E CLASS DIESEL SALOON E350 BlueTEC AMG Night Ed '
          'Premium 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'E350 BlueTEC AMG Night Ed Premium 4dr 9G-Tronic',
 'vin': None,
 'year': 2015}
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117357391%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Saving data for 117357391: {'auction_closing_time': 1764756000.0, 'created_time': 1763665371.217539, 'last_price_update_time': 1764702156.807552}
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117357391') HTTP/1.1" 204 0
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Found listing with ID: 117348031
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117348031%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Scrape type for 117348031: 0
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Found listing with ID: 117495142
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495142%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Scrape type for 117495142: 0
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Found listing with ID: 117310723
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310723%27 HTTP/1.1" 200 None
2025-12-02 19:02:36 [astonbarclay.gb] INFO: Scrape type for 117310723: 2
2025-12-02 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fa3164988-f4b7-4226-a441-f55defec4c4f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a3164988-f4b7-4226-a441-f55defec4c4f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F21387fd4-ab1f-43a1-bb3e-ba800d44b816_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/21387fd4-ab1f-43a1-bb3e-ba800d44b816_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252Fe2750ea5-a799-47f9-b20a-fe9f4e3eda75_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e2750ea5-a799-47f9-b20a-fe9f4e3eda75_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ec510>
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252F8a2e4109-4e92-47fa-9d29-a799f17a2344_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/8a2e4109-4e92-47fa-9d29-a799f17a2344_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffb2e0dc-63cf-5790-9da5-de91299ab615
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf080f210>
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F5f50aa41-eff4-4d71-8f57-0bae72f48ed8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/5f50aa41-eff4-4d71-8f57-0bae72f48ed8_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0518d50>
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252Fe95a8559-82e9-4080-923f-469729c82f87_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/e95a8559-82e9-4080-923f-469729c82f87_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffb2e0dc-63cf-5790-9da5-de91299ab615
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0679010>
2025-12-02 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fd2097441-a9b8-4c03-99f6-9cdbf47e5cd8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d2097441-a9b8-4c03-99f6-9cdbf47e5cd8_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbeb631d-6470-5e0f-b9cc-332242767dc1
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf080e410>
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F35ed20ce-3bdf-4506-87bd-54c236326127_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/35ed20ce-3bdf-4506-87bd-54c236326127_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb
2025-12-02 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HK72VGF/2025-12-02/image/bf126592-2a72-40c3-9064-5c235f25b613_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue)
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06a8990>
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252F8fa20397-93b8-4d4f-8652-a9d4e42798aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/8fa20397-93b8-4d4f-8652-a9d4e42798aa_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cbeb631d-6470-5e0f-b9cc-332242767dc1
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02de990>
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F3f4f2b49-3ec9-4eda-b368-157b402a9d03_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/3f4f2b49-3ec9-4eda-b368-157b402a9d03_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67123457-1c0a-5cdd-8be3-eb490de642b0
2025-12-02 19:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c40d0>
2025-12-02 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252Fab181ea5-aa04-49b5-9fb1-c0525ba02149_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/ab181ea5-aa04-49b5-9fb1-c0525ba02149_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52669e31-67d3-5cd8-9ca1-4e345de83c70
2025-12-02 19:02:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117569819, 'registration': 'CP68LNV', 'account': 'KCS003', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.5 TSI SE L 5dr DSG [7 Seat]', 'mileage': 106414, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2501, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-21', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CP68LNV/2025-11-28/image/c9c35042-6dd2-48a4-bf35-dc3218604485_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/9ec56e20-93af-4229-ab80-11fcce2f4415_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/49af51c2-3def-4735-9070-0992b86eb4c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/18d4024d-abcb-4d3a-909a-925d175631e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/65a739f8-0791-4d56-bcf9-fb6e60e58f0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/9ad449ed-c1dd-442e-9f06-8e65d07bfc74_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/931dce1e-eb18-4eb7-a5a2-5c384a7d6d6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/d4043e23-54b3-42f2-938b-92098f105dcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/7433a850-67e3-4fa4-af28-9ea587aae826_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 11/19 21K- 03/22 61K- 02/23 79K - 09/25 101K', 'remarks': 'VOSA STATES 76K - 94K - 101K - 106K', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/65964909-b959-4c1e-9a4b-e2653e98ffe5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117569819, 'registration': 'CP68LNV', 'account': 'KCS003', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.5 TSI SE L 5dr DSG [7 Seat]', 'mileage': 106414, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2501, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-21', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CP68LNV/2025-11-28/image/c9c35042-6dd2-48a4-bf35-dc3218604485_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/9ec56e20-93af-4229-ab80-11fcce2f4415_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/49af51c2-3def-4735-9070-0992b86eb4c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/18d4024d-abcb-4d3a-909a-925d175631e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/65a739f8-0791-4d56-bcf9-fb6e60e58f0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/9ad449ed-c1dd-442e-9f06-8e65d07bfc74_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/931dce1e-eb18-4eb7-a5a2-5c384a7d6d6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/d4043e23-54b3-42f2-938b-92098f105dcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/7433a850-67e3-4fa4-af28-9ea587aae826_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 11/19 21K- 03/22 61K- 02/23 79K - 09/25 101K', 'remarks': 'VOSA STATES 76K - 94K - 101K - 106K', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/65964909-b959-4c1e-9a4b-e2653e98ffe5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with identifier: 117569819
2025-12-02 19:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with scrape type 2
2025-12-02 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with scrape type 2
2025-12-02 19:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d, identifier: 117569819
2025-12-02 19:02:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117002721, 'registration': 'HT19ODX', 'account': 'AST003', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE Iconic 5dr', 'mileage': 66282, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2413, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-03-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HT19ODX/2025-11-12/image/44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/dc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/b0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/cdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/c8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20- 18K, 02/21- 26K', 'remarks': 'VOSA STATES 46K, 59K, DAMAGED SPARE KEY IN', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d0471923-74fa-44fe-b531-63906c03feb4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117002721, 'registration': 'HT19ODX', 'account': 'AST003', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE Iconic 5dr', 'mileage': 66282, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2413, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-03-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HT19ODX/2025-11-12/image/44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/dc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/b0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/cdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/c8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20- 18K, 02/21- 26K', 'remarks': 'VOSA STATES 46K, 59K, DAMAGED SPARE KEY IN', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d0471923-74fa-44fe-b531-63906c03feb4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721
2025-12-02 19:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4712bc-835e-5d1b-8a87-785ebf261f12 with scrape type 2
2025-12-02 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb4712bc-835e-5d1b-8a87-785ebf261f12 with scrape type 2
2025-12-02 19:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eb4712bc-835e-5d1b-8a87-785ebf261f12, identifier: 117002721
2025-12-02 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT22VVW/2025-12-02/image/f1904dc5-a25a-4cac-926b-0b269acc8434_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627604?view=catalogue)
2025-12-02 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE17TBU/2025-12-02/image/ba710ae2-1ca3-4e70-adb1-e4327d449361_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue)
2025-12-02 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM69HWX/2025-12-02/image/4f6110e0-7dde-48f9-836c-18f2c6fe3dea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue)
2025-12-02 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE17TBU/2025-12-02/image/6a65d646-dee9-4ce1-89bb-500e945d7244_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue)
2025-12-02 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HK72VGF/2025-12-02/image/c1545413-1741-4155-9a15-6aea8b49b4df_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue)
2025-12-02 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO71OFM/2025-12-02/image/54aa7f6e-62eb-4408-9a6c-39cbeed1e0b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627985?view=catalogue)
2025-12-02 19:02:39 [astonbarclay.gb] INFO: Found listing with ID: 117397605
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397605%27 HTTP/1.1" 200 None
2025-12-02 19:02:39 [astonbarclay.gb] INFO: Scrape type for 117397605: 2
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fa203dec2-b260-49f5-afa2-7eeafebe3134_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a203dec2-b260-49f5-afa2-7eeafebe3134_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F79df732d-9c48-4c67-950f-1903b32b3a8c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/79df732d-9c48-4c67-950f-1903b32b3a8c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252F5aeac550-dae8-45e1-ae75-065bc0e7bf75_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5aeac550-dae8-45e1-ae75-065bc0e7bf75_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117425377?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117452123?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with identifier: 117569819
2025-12-02 19:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with identifier: 117569819
2025-12-02 19:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171256 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171256
2025-12-02 19:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d spider: astonbarclay.gb
2025-12-02 19:02:39 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d due to rule: high_mileage_for_country.json, error: 171256 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171256
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CP68LNV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117569819',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'KODIAQ ESTATE',
 'odometer': 106414,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-28',
 'seller_name': 'CarBuy Limited',
 'title': 'SKODA KODIAQ ESTATE 1.5 TSI SE L 5dr DSG [7 Seat]',
 'transmission': 'automatic',
 'trim': '1.5 TSI SE L 5dr DSG [7 Seat]',
 'vin': None,
 'year': 2018}
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569819%27 HTTP/1.1" 200 None
2025-12-02 19:02:39 [astonbarclay.gb] INFO: Saving data for 117569819: {'auction_closing_time': 1764756000.0, 'created_time': 1764270101.440459, 'last_price_update_time': 1764702159.727544}
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117569819') HTTP/1.1" 204 0
2025-12-02 19:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721
2025-12-02 19:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721
2025-12-02 19:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721 to the API
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'eb4712bc-835e-5d1b-8a87-785ebf261f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HT19ODX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117002721',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'KADJAR HATCHBACK',
 'odometer': 66282,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': 'TCB Group - Value',
 'title': 'RENAULT KADJAR HATCHBACK 1.3 TCE Iconic 5dr',
 'transmission': 'manual',
 'trim': '1.3 TCE Iconic 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117002721%27 HTTP/1.1" 200 None
2025-12-02 19:02:39 [astonbarclay.gb] INFO: Saving data for 117002721: {'auction_closing_time': 1764756000.0, 'created_time': 1764615687.27575, 'last_price_update_time': 1764702159.990566}
2025-12-02 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117002721') HTTP/1.1" 204 0
2025-12-02 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE17TBU/2025-12-02/image/034c295f-d569-4a03-91bf-94e2f0bfa825_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue)
2025-12-02 19:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM69HWX/2025-12-02/image/d1532de9-b48e-4bd4-9c41-284d2e40bea2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue)
2025-12-02 19:02:40 [astonbarclay.gb] INFO: Found listing with ID: 117452490
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452490%27 HTTP/1.1" 200 None
2025-12-02 19:02:40 [astonbarclay.gb] INFO: Scrape type for 117452490: 2
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fd6a6a3a1-e97e-4aa5-ba6d-d2c36eeeb53c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d6a6a3a1-e97e-4aa5-ba6d-d2c36eeeb53c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252Fab44aa71-90b0-4611-bb86-2992a8d3e64a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ab44aa71-90b0-4611-bb86-2992a8d3e64a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252F5978c5df-90f8-4a20-8b61-d45427cb7d68_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5978c5df-90f8-4a20-8b61-d45427cb7d68_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE17TBU/2025-12-02/image/0e0b01f7-1c94-4b37-9bb2-ff8ba479ecea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue)
2025-12-02 19:02:40 [astonbarclay.gb] INFO: Found listing with ID: 116988307
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988307%27 HTTP/1.1" 200 None
2025-12-02 19:02:40 [astonbarclay.gb] INFO: Scrape type for 116988307: 0
2025-12-02 19:02:40 [astonbarclay.gb] INFO: Found listing with ID: 116937928
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116937928%27 HTTP/1.1" 200 None
2025-12-02 19:02:40 [astonbarclay.gb] INFO: Scrape type for 116937928: 0
2025-12-02 19:02:40 [astonbarclay.gb] INFO: Found listing with ID: 117276677
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117276677%27 HTTP/1.1" 200 None
2025-12-02 19:02:40 [astonbarclay.gb] INFO: Scrape type for 117276677: 2
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252F3622391d-1fae-47c8-abc6-4a8ffb54a62d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/3622391d-1fae-47c8-abc6-4a8ffb54a62d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252Fc34b9904-d488-4ed1-bc85-4d0bee777443_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/c34b9904-d488-4ed1-bc85-4d0bee777443_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252Fe8c97a5e-92de-4970-b44b-d2153ed642e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e8c97a5e-92de-4970-b44b-d2153ed642e5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08e6e50>
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fbf126592-2a72-40c3-9064-5c235f25b613_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/bf126592-2a72-40c3-9064-5c235f25b613_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbeb631d-6470-5e0f-b9cc-332242767dc1
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09265d0>
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252Ff1904dc5-a25a-4cac-926b-0b269acc8434_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/f1904dc5-a25a-4cac-926b-0b269acc8434_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07ea590>
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252Fba710ae2-1ca3-4e70-adb1-e4327d449361_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/ba710ae2-1ca3-4e70-adb1-e4327d449361_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0927650>
2025-12-02 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252F4f6110e0-7dde-48f9-836c-18f2c6fe3dea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/4f6110e0-7dde-48f9-836c-18f2c6fe3dea_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffb2e0dc-63cf-5790-9da5-de91299ab615
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0925d90>
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F6a65d646-dee9-4ce1-89bb-500e945d7244_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/6a65d646-dee9-4ce1-89bb-500e945d7244_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0371090>
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fc1545413-1741-4155-9a15-6aea8b49b4df_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/c1545413-1741-4155-9a15-6aea8b49b4df_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cbeb631d-6470-5e0f-b9cc-332242767dc1
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0927b90>
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F54aa7f6e-62eb-4408-9a6c-39cbeed1e0b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/54aa7f6e-62eb-4408-9a6c-39cbeed1e0b3_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 506582ff-1440-5046-adbb-d8614199e03f
2025-12-02 19:02:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117425377, 'registration': 'WT18WFL', 'account': 'KCS003', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 4 5dr', 'mileage': 113744, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2502, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-06-19', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WT18WFL/2025-11-24/image/49151907-3d7c-4695-a858-c7c0a4d4a9b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/d53692d0-6cd3-4424-8827-c0c3fc20f818_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/4e102daf-d505-4a87-bd01-5bda607d6178_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/b1f4d46b-592e-4f64-b51a-55968ee0af9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/e2df6981-5f36-4ecd-802d-3fa07b020c5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/3638aacb-10c7-4835-ba42-7b95e84d8c0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/8c18838c-480a-4d09-8f80-6880afa7654f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/979ab6d2-af97-4127-b8c3-caae4af88ed0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 04/18 13K - 11/19 28K - 09/20 33K - 08/21 46K - 04/22 58K - 02/23 70K - 12/23 85K - 07/24 97K - 06/25 110K', 'remarks': 'VOSA STATES 62K- 79K - 97K - 110K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba3d3176-b5c1-4edd-9a63-655c9ba278a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117425377, 'registration': 'WT18WFL', 'account': 'KCS003', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 4 5dr', 'mileage': 113744, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2502, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-06-19', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WT18WFL/2025-11-24/image/49151907-3d7c-4695-a858-c7c0a4d4a9b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/d53692d0-6cd3-4424-8827-c0c3fc20f818_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/4e102daf-d505-4a87-bd01-5bda607d6178_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/b1f4d46b-592e-4f64-b51a-55968ee0af9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/e2df6981-5f36-4ecd-802d-3fa07b020c5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/3638aacb-10c7-4835-ba42-7b95e84d8c0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/8c18838c-480a-4d09-8f80-6880afa7654f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/979ab6d2-af97-4127-b8c3-caae4af88ed0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 04/18 13K - 11/19 28K - 09/20 33K - 08/21 46K - 04/22 58K - 02/23 70K - 12/23 85K - 07/24 97K - 06/25 110K', 'remarks': 'VOSA STATES 62K- 79K - 97K - 110K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba3d3176-b5c1-4edd-9a63-655c9ba278a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec51caee-5658-548b-b162-28ba8f6303d3 with identifier: 117425377
2025-12-02 19:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec51caee-5658-548b-b162-28ba8f6303d3 with scrape type 2
2025-12-02 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec51caee-5658-548b-b162-28ba8f6303d3 with scrape type 2
2025-12-02 19:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec51caee-5658-548b-b162-28ba8f6303d3, identifier: 117425377
2025-12-02 19:02:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117568753, 'registration': 'DS67TJV', 'account': 'KCS003', 'make': 'MAZDA', 'model': 'CX-3 DIESEL HATCHBACK', 'derivative': '1.5d Sport Nav 5dr', 'mileage': 65256, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2504, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-12-06', 'fuel': 'Diesel', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS67TJV/2025-11-27/image/2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/d6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/c8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 43K- 54K- 62K - 65K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/97f2b055-c554-4e52-a866-b4d85df17c3e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117568753, 'registration': 'DS67TJV', 'account': 'KCS003', 'make': 'MAZDA', 'model': 'CX-3 DIESEL HATCHBACK', 'derivative': '1.5d Sport Nav 5dr', 'mileage': 65256, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2504, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-12-06', 'fuel': 'Diesel', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS67TJV/2025-11-27/image/2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/d6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/c8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 43K- 54K- 62K - 65K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/97f2b055-c554-4e52-a866-b4d85df17c3e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753
2025-12-02 19:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with scrape type 2
2025-12-02 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with scrape type 2
2025-12-02 19:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46, identifier: 117568753
2025-12-02 19:02:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117452123, 'registration': 'KT66JVG', 'account': 'KCS003', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '2.0 Cooper S 5dr Auto', 'mileage': 93324, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2500, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-04-11', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KT66JVG/2025-11-24/image/165f1191-a254-4dae-b8f8-27bf001b2cfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/de93ae43-0f37-473d-8d2e-1d95243fc5a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/fa342ea5-162d-45e0-a4dc-82ba3a0a3f9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/f5ce7fcd-8984-4aa0-88d1-e2d6197622a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/8ef774d9-0134-4fb4-8adc-47197580ca5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/91f83bbe-5605-4598-82c0-e6b120b877fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/652a257d-d21c-443c-84da-b5d951368b6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/ca539604-6f2a-4c61-afef-6d79aac34944_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/5bc8f600-a33a-4789-9112-a7c4f6738f66_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/9b1f0fd4-4f4e-425b-b66e-c355e36146f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/3937eb23-267e-4439-b76a-908346275c68_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 11/18 12k - 12/19 25k - 11/20 33K', 'remarks': 'VOSA STATES 40K - 60K - 75K - 87K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/382399e9-e13f-490b-a3f9-7abe4fa442bd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117452123, 'registration': 'KT66JVG', 'account': 'KCS003', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '2.0 Cooper S 5dr Auto', 'mileage': 93324, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2500, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-04-11', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KT66JVG/2025-11-24/image/165f1191-a254-4dae-b8f8-27bf001b2cfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/de93ae43-0f37-473d-8d2e-1d95243fc5a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/fa342ea5-162d-45e0-a4dc-82ba3a0a3f9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/f5ce7fcd-8984-4aa0-88d1-e2d6197622a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/8ef774d9-0134-4fb4-8adc-47197580ca5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/91f83bbe-5605-4598-82c0-e6b120b877fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/652a257d-d21c-443c-84da-b5d951368b6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/ca539604-6f2a-4c61-afef-6d79aac34944_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/5bc8f600-a33a-4789-9112-a7c4f6738f66_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/9b1f0fd4-4f4e-425b-b66e-c355e36146f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/3937eb23-267e-4439-b76a-908346275c68_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 11/18 12k - 12/19 25k - 11/20 33K', 'remarks': 'VOSA STATES 40K - 60K - 75K - 87K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/382399e9-e13f-490b-a3f9-7abe4fa442bd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with identifier: 117452123
2025-12-02 19:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with scrape type 2
2025-12-02 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with scrape type 2
2025-12-02 19:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b, identifier: 117452123
2025-12-02 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HK72VGF/2025-12-02/image/82675e9d-48ff-4af7-8324-278e13a980c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue)
2025-12-02 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a3164988-f4b7-4226-a441-f55defec4c4f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue)
2025-12-02 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e2750ea5-a799-47f9-b20a-fe9f4e3eda75_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627604?view=catalogue)
2025-12-02 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ee974730-016d-4060-a593-106a091b69db_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627985?view=catalogue)
2025-12-02 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO71OFM/2025-12-02/image/21387fd4-ab1f-43a1-bb3e-ba800d44b816_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627985?view=catalogue)
2025-12-02 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM69HWX/2025-12-02/image/91a6ecca-eb61-463c-bdbe-3018b9992a09_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue)
2025-12-02 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT22VVW/2025-12-02/image/2b2b908f-ebed-4c6c-9d89-19c79b496cd2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627604?view=catalogue)
2025-12-02 19:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec51caee-5658-548b-b162-28ba8f6303d3 with identifier: 117425377
2025-12-02 19:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec51caee-5658-548b-b162-28ba8f6303d3 with identifier: 117425377
2025-12-02 19:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183052 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183052
2025-12-02 19:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ec51caee-5658-548b-b162-28ba8f6303d3 spider: astonbarclay.gb
2025-12-02 19:02:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ec51caee-5658-548b-b162-28ba8f6303d3 due to rule: high_mileage_for_country.json, error: 183052 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183052
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ec51caee-5658-548b-b162-28ba8f6303d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WT18WFL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117425377',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER DIESEL ESTATE',
 'odometer': 113744,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': 'CarBuy Limited',
 'title': 'MITSUBISHI OUTLANDER DIESEL ESTATE 2.2 DI-D 4 5dr',
 'transmission': 'manual',
 'trim': '2.2 DI-D 4 5dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425377%27 HTTP/1.1" 200 None
2025-12-02 19:02:42 [astonbarclay.gb] INFO: Saving data for 117425377: {'auction_closing_time': 1764756000.0, 'created_time': 1763751630.089459, 'last_price_update_time': 1764702162.351842}
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117425377') HTTP/1.1" 204 0
2025-12-02 19:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753
2025-12-02 19:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753
2025-12-02 19:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753 to the API
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e2b6d930-d9f3-5dd0-8d98-f900c4b66f46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS67TJV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117568753',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MAZDA',
 'model': 'CX-3 DIESEL HATCHBACK',
 'odometer': 65256,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': 'CarBuy Limited',
 'title': 'MAZDA CX-3 DIESEL HATCHBACK 1.5d Sport Nav 5dr',
 'transmission': 'manual',
 'trim': '1.5d Sport Nav 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117568753%27 HTTP/1.1" 200 None
2025-12-02 19:02:42 [astonbarclay.gb] INFO: Saving data for 117568753: {'auction_closing_time': 1764756000.0, 'created_time': 1764270128.985777, 'last_price_update_time': 1764702162.66982}
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117568753') HTTP/1.1" 204 0
2025-12-02 19:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with identifier: 117452123
2025-12-02 19:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with identifier: 117452123
2025-12-02 19:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150190 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150190
2025-12-02 19:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b spider: astonbarclay.gb
2025-12-02 19:02:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b due to rule: high_mileage_for_country.json, error: 150190 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150190
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '20ab3011-b9cc-544b-bd87-9a940ebbfe5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KT66JVG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117452123',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 93324,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-28',
 'seller_name': 'CarBuy Limited',
 'title': 'MINI HATCHBACK 2.0 Cooper S 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 Cooper S 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452123%27 HTTP/1.1" 200 None
2025-12-02 19:02:42 [astonbarclay.gb] INFO: Saving data for 117452123: {'auction_closing_time': 1764756000.0, 'created_time': 1764010879.85748, 'last_price_update_time': 1764702162.881339}
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117452123') HTTP/1.1" 204 0
2025-12-02 19:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:42 [astonbarclay.gb] INFO: Found listing with ID: 115457692
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115457692%27 HTTP/1.1" 200 None
2025-12-02 19:02:42 [astonbarclay.gb] INFO: Scrape type for 115457692: 2
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252F5b622055-c3ba-49c8-b3f7-0bdd21d165ff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/5b622055-c3ba-49c8-b3f7-0bdd21d165ff_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F6bf99182-fbab-403d-8b66-e832764e5e6e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/6bf99182-fbab-403d-8b66-e832764e5e6e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252Fc73a5cf2-c085-4eda-8389-c8efc01abfa7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/c73a5cf2-c085-4eda-8389-c8efc01abfa7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117599337?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117217399?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM69HWX/2025-12-02/image/b20ac89f-95fa-4841-af3b-d01c38c5e5f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue)
2025-12-02 19:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf082a350>
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F034c295f-d569-4a03-91bf-94e2f0bfa825_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/034c295f-d569-4a03-91bf-94e2f0bfa825_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aa5b90>
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252Fd1532de9-b48e-4bd4-9c41-284d2e40bea2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/d1532de9-b48e-4bd4-9c41-284d2e40bea2_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffb2e0dc-63cf-5790-9da5-de91299ab615
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066bb90>
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE17TBU%252F2025-12-02%252Fimage%252F0e0b01f7-1c94-4b37-9bb2-ff8ba479ecea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE17TBU/2025-12-02/image/0e0b01f7-1c94-4b37-9bb2-ff8ba479ecea_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb
2025-12-02 19:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb, skipping ID generation
2025-12-02 19:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with scrape type 1
2025-12-02 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb from tracking dictionaries
2025-12-02 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb sending to next pipeline
2025-12-02 19:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb, identifier: 117631646
2025-12-02 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5aeac550-dae8-45e1-ae75-065bc0e7bf75_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627604?view=catalogue)
2025-12-02 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5978c5df-90f8-4a20-8b61-d45427cb7d68_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627604?view=catalogue)
2025-12-02 19:02:43 [astonbarclay.gb] INFO: Found listing with ID: 116994676
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116994676%27 HTTP/1.1" 200 None
2025-12-02 19:02:43 [astonbarclay.gb] INFO: Scrape type for 116994676: 2
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F50dbcbbb-296c-4ee0-b9bf-c25183032778_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/50dbcbbb-296c-4ee0-b9bf-c25183032778_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252Fbaf066c5-771d-4558-94b6-7ffbaf0e12c8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/baf066c5-771d-4558-94b6-7ffbaf0e12c8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/114036273?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with identifier: 117631646
2025-12-02 19:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with identifier: 117631646
2025-12-02 19:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with identifier: 117631646 to the API
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FE17TBU/2025-12-02/image/0e0b01f7-1c94-4b37-9bb2-ff8ba479ecea_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6fde9c42-a9ae-5244-82a2-b83dd84aa0eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FE17TBU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631646',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SEAT',
 'model': 'ATECA ESTATE',
 'odometer': 80306,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33585,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/644b0dc9-9399-4166-9862-a72b108e210d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32453,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/2db95366-3e57-449a-95ca-2ec56c9b2772_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30052,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/f077e1e5-e318-4905-b515-5364ae9196e0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29215,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/5f50aa41-eff4-4d71-8f57-0bae72f48ed8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38834,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/35ed20ce-3bdf-4506-87bd-54c236326127_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37669,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/6a65d646-dee9-4ce1-89bb-500e945d7244_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38884,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/ba710ae2-1ca3-4e70-adb1-e4327d449361_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47455,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/034c295f-d569-4a03-91bf-94e2f0bfa825_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fde9c42-a9ae-5244-82a2-b83dd84aa0eb/6fde9c42-a9ae-5244-82a2-b83dd84aa0eb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53219,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/0e0b01f7-1c94-4b37-9bb2-ff8ba479ecea_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-06',
 'seller_name': 'SMC GROUP',
 'title': 'SEAT ATECA ESTATE 1.4 EcoTSI Xcellence 5dr',
 'transmission': 'manual',
 'trim': '1.4 EcoTSI Xcellence 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631646%27 HTTP/1.1" 200 None
2025-12-02 19:02:44 [astonbarclay.gb] INFO: Saving data for 117631646: {'created_time': 1764702164.350911, 'last_price_update_time': 1764702164.350921, 'auction_closing_time': 1764756000.0}
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117631646') HTTP/1.1" 204 0
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf033f990>
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252F82675e9d-48ff-4af7-8324-278e13a980c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/82675e9d-48ff-4af7-8324-278e13a980c3_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cbeb631d-6470-5e0f-b9cc-332242767dc1
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0900810>
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fa3164988-f4b7-4226-a441-f55defec4c4f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a3164988-f4b7-4226-a441-f55defec4c4f_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cbeb631d-6470-5e0f-b9cc-332242767dc1
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf033c1d0>
2025-12-02 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252Fe2750ea5-a799-47f9-b20a-fe9f4e3eda75_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e2750ea5-a799-47f9-b20a-fe9f4e3eda75_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ab8490>
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252Fee974730-016d-4060-a593-106a091b69db_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ee974730-016d-4060-a593-106a091b69db_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 506582ff-1440-5046-adbb-d8614199e03f
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf073e190>
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F21387fd4-ab1f-43a1-bb3e-ba800d44b816_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/21387fd4-ab1f-43a1-bb3e-ba800d44b816_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 506582ff-1440-5046-adbb-d8614199e03f
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05eec50>
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252F91a6ecca-eb61-463c-bdbe-3018b9992a09_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/91a6ecca-eb61-463c-bdbe-3018b9992a09_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffb2e0dc-63cf-5790-9da5-de91299ab615
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08853d0>
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252F2b2b908f-ebed-4c6c-9d89-19c79b496cd2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/2b2b908f-ebed-4c6c-9d89-19c79b496cd2_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b
2025-12-02 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ab44aa71-90b0-4611-bb86-2992a8d3e64a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627985?view=catalogue)
2025-12-02 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d6a6a3a1-e97e-4aa5-ba6d-d2c36eeeb53c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue)
2025-12-02 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO71OFM/2025-12-02/image/79df732d-9c48-4c67-950f-1903b32b3a8c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627985?view=catalogue)
2025-12-02 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a203dec2-b260-49f5-afa2-7eeafebe3134_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue)
2025-12-02 19:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Found listing with ID: 117517662
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517662%27 HTTP/1.1" 200 None
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Scrape type for 117517662: 0
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Found listing with ID: 117517675
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517675%27 HTTP/1.1" 200 None
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Scrape type for 117517675: 0
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Found listing with ID: 117517631
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517631%27 HTTP/1.1" 200 None
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Scrape type for 117517631: 0
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Found listing with ID: 117517620
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517620%27 HTTP/1.1" 200 None
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Scrape type for 117517620: 0
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Found listing with ID: 117584272
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584272%27 HTTP/1.1" 200 None
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Scrape type for 117584272: 2
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F51d63936-4432-42a2-bb12-c6ed3ec9e4f8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/51d63936-4432-42a2-bb12-c6ed3ec9e4f8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252F372b7cde-d79c-4301-b12d-50aec7a4abb3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/372b7cde-d79c-4301-b12d-50aec7a4abb3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117599337, 'registration': 'RX66SOJ', 'account': 'KCS003', 'make': 'BMW', 'model': '2 SERIES COUPE', 'derivative': '218i M Sport 2dr [Nav]', 'mileage': 51716, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2507, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/8352d9b7-2b45-4d23-b6c3-1bd4d26731ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/8344a187-3a83-42dc-b285-3d5186c22d3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/bca99add-dd7b-45cf-8e63-bd0d13e0015b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/1809bace-d439-4323-8904-1770ab30b2d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/f48ced47-1995-4b08-a636-7097f476d130_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/cf79ba65-6ee5-4015-9510-6968135bb542_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/b7a532ee-17b7-4d0f-915b-3e6734d08987_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/a09b80c8-9cf7-41f6-a096-42ba73b4c7d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/415efb34-4418-4019-bdb9-396d14c77118_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/0aa456a7-5e0c-49d1-93d8-fcf2d2866349_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 45K, 47K, 48K, 51K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f378cfd-2def-414b-abe5-9ba9cf4b883b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117599337, 'registration': 'RX66SOJ', 'account': 'KCS003', 'make': 'BMW', 'model': '2 SERIES COUPE', 'derivative': '218i M Sport 2dr [Nav]', 'mileage': 51716, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2507, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/8352d9b7-2b45-4d23-b6c3-1bd4d26731ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/8344a187-3a83-42dc-b285-3d5186c22d3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/bca99add-dd7b-45cf-8e63-bd0d13e0015b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/1809bace-d439-4323-8904-1770ab30b2d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/f48ced47-1995-4b08-a636-7097f476d130_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/cf79ba65-6ee5-4015-9510-6968135bb542_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/b7a532ee-17b7-4d0f-915b-3e6734d08987_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/a09b80c8-9cf7-41f6-a096-42ba73b4c7d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/415efb34-4418-4019-bdb9-396d14c77118_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/0aa456a7-5e0c-49d1-93d8-fcf2d2866349_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 45K, 47K, 48K, 51K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f378cfd-2def-414b-abe5-9ba9cf4b883b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9667a21-4fe8-5103-b36e-16045ddcf314 with identifier: 117599337
2025-12-02 19:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9667a21-4fe8-5103-b36e-16045ddcf314 with scrape type 2
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9667a21-4fe8-5103-b36e-16045ddcf314 with scrape type 2
2025-12-02 19:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c9667a21-4fe8-5103-b36e-16045ddcf314, identifier: 117599337
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117217399, 'registration': 'DU67AEP', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE 5dr Auto', 'mileage': 95720, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2513, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-09-08', 'fuel': 'Diesel', 'motExpiry': '2026-09-13', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DU67AEP/2025-11-14/image/d8d119d9-10c0-45f3-bbc7-a84d7f887756_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f46245b5-f5a9-465d-99eb-61d35f495693_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/e82b037f-4da2-47f4-ae87-7f2cab5251f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f37ded18-4116-472a-b994-85c2f62593c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/87aa4fd2-4ba9-4ba6-a528-54f59028facb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/34dac5ec-fe12-40c3-af6a-314a84ac896d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f4b54e02-7021-42b5-b36e-48ddb2428c7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/fc6071ff-cb51-4138-a915-aad63aa1b399_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/27db63c6-21d7-43f2-bf34-b0210de5c445_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/e6ec9931-3a09-43f9-a9aa-83c16a3da9ec_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice PRINT @ 10/18-14k - INVOICE @ 02/25-95k', 'remarks': 'VOSA STATES 46K 70K 91K 95K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40de7641-4eb0-4340-9a82-7ab711727724.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117217399, 'registration': 'DU67AEP', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE 5dr Auto', 'mileage': 95720, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2513, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-09-08', 'fuel': 'Diesel', 'motExpiry': '2026-09-13', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DU67AEP/2025-11-14/image/d8d119d9-10c0-45f3-bbc7-a84d7f887756_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f46245b5-f5a9-465d-99eb-61d35f495693_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/e82b037f-4da2-47f4-ae87-7f2cab5251f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f37ded18-4116-472a-b994-85c2f62593c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/87aa4fd2-4ba9-4ba6-a528-54f59028facb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/34dac5ec-fe12-40c3-af6a-314a84ac896d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f4b54e02-7021-42b5-b36e-48ddb2428c7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/fc6071ff-cb51-4138-a915-aad63aa1b399_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/27db63c6-21d7-43f2-bf34-b0210de5c445_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/e6ec9931-3a09-43f9-a9aa-83c16a3da9ec_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice PRINT @ 10/18-14k - INVOICE @ 02/25-95k', 'remarks': 'VOSA STATES 46K 70K 91K 95K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40de7641-4eb0-4340-9a82-7ab711727724.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8318d99-8678-5a88-9fa1-07aa4df4b59c with identifier: 117217399
2025-12-02 19:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8318d99-8678-5a88-9fa1-07aa4df4b59c with scrape type 2
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8318d99-8678-5a88-9fa1-07aa4df4b59c with scrape type 2
2025-12-02 19:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d8318d99-8678-5a88-9fa1-07aa4df4b59c, identifier: 117217399
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117616251, 'registration': 'GV17RDZ', 'account': 'STE094', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper 3dr Auto', 'mileage': 32519, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1125, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-03-28', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/3dd01e1f-b757-476a-8670-6e08a3e41777_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/f4d0ed44-da4a-4691-b28e-e00693add82d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/8025b10f-087d-4932-9f67-9219f515c1ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/2d1458ab-6f10-401b-9cd5-657de800e6e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/ccb6a71e-365d-41f4-8dbf-7dbe615805d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/76fd3979-46e0-4b5a-9185-f38f4fdd5dc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/60db119d-2458-45d3-b46a-a5b2f38cf516_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/dfc2e2a2-9bac-43fa-bab8-5fa7321f8b30_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/b0e983b6-825a-4c33-b703-92505496bff1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/267724db-2085-45c9-9827-f73807fc4c38_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/0ea6c0d9-8cf1-4a16-aa36-bb4f2bbbf300_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/19 10K - 12/20 13K - 02/23 23K - 03/25 31K', 'remarks': 'VOSA STATES, 17K, 23K, 29K, 31K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c255f23c-079d-4604-ab48-b61898034b39.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117616251, 'registration': 'GV17RDZ', 'account': 'STE094', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper 3dr Auto', 'mileage': 32519, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1125, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-03-28', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/3dd01e1f-b757-476a-8670-6e08a3e41777_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/f4d0ed44-da4a-4691-b28e-e00693add82d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/8025b10f-087d-4932-9f67-9219f515c1ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/2d1458ab-6f10-401b-9cd5-657de800e6e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/ccb6a71e-365d-41f4-8dbf-7dbe615805d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/76fd3979-46e0-4b5a-9185-f38f4fdd5dc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/60db119d-2458-45d3-b46a-a5b2f38cf516_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/dfc2e2a2-9bac-43fa-bab8-5fa7321f8b30_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/b0e983b6-825a-4c33-b703-92505496bff1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/267724db-2085-45c9-9827-f73807fc4c38_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/0ea6c0d9-8cf1-4a16-aa36-bb4f2bbbf300_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/19 10K - 12/20 13K - 02/23 23K - 03/25 31K', 'remarks': 'VOSA STATES, 17K, 23K, 29K, 31K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c255f23c-079d-4604-ab48-b61898034b39.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37ea0390-0aee-5e2b-b7dc-184334f54095 with identifier: 117616251
2025-12-02 19:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37ea0390-0aee-5e2b-b7dc-184334f54095 with scrape type 1
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F3dd01e1f-b757-476a-8670-6e08a3e41777_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/3dd01e1f-b757-476a-8670-6e08a3e41777_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aaf390>
2025-12-02 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM69HWX%252F2025-12-02%252Fimage%252Fb20ac89f-95fa-4841-af3b-d01c38c5e5f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM69HWX/2025-12-02/image/b20ac89f-95fa-4841-af3b-d01c38c5e5f9_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffb2e0dc-63cf-5790-9da5-de91299ab615
2025-12-02 19:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffb2e0dc-63cf-5790-9da5-de91299ab615, skipping ID generation
2025-12-02 19:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb2e0dc-63cf-5790-9da5-de91299ab615 with scrape type 1
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ffb2e0dc-63cf-5790-9da5-de91299ab615 from tracking dictionaries
2025-12-02 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffb2e0dc-63cf-5790-9da5-de91299ab615 sending to next pipeline
2025-12-02 19:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ffb2e0dc-63cf-5790-9da5-de91299ab615, identifier: 117605293
2025-12-02 19:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c9667a21-4fe8-5103-b36e-16045ddcf314 with identifier: 117599337
2025-12-02 19:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c9667a21-4fe8-5103-b36e-16045ddcf314 with identifier: 117599337
2025-12-02 19:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c9667a21-4fe8-5103-b36e-16045ddcf314 with identifier: 117599337 to the API
2025-12-02 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117599337?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c9667a21-4fe8-5103-b36e-16045ddcf314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RX66SOJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599337',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '2 SERIES COUPE',
 'odometer': 51716,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': 'CarBuy Limited',
 'title': 'BMW 2 SERIES COUPE 218i M Sport 2dr [Nav]',
 'transmission': 'manual',
 'trim': '218i M Sport 2dr [Nav]',
 'vin': None,
 'year': 2016}
2025-12-02 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599337%27 HTTP/1.1" 200 None
2025-12-02 19:02:47 [astonbarclay.gb] INFO: Saving data for 117599337: {'auction_closing_time': 1764756000.0, 'created_time': 1764356764.480806, 'last_price_update_time': 1764702167.177868}
2025-12-02 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117599337') HTTP/1.1" 204 0
2025-12-02 19:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d8318d99-8678-5a88-9fa1-07aa4df4b59c with identifier: 117217399
2025-12-02 19:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d8318d99-8678-5a88-9fa1-07aa4df4b59c with identifier: 117217399
2025-12-02 19:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154046 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154046
2025-12-02 19:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d8318d99-8678-5a88-9fa1-07aa4df4b59c spider: astonbarclay.gb
2025-12-02 19:02:47 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d8318d99-8678-5a88-9fa1-07aa4df4b59c due to rule: high_mileage_for_country.json, error: 154046 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154046
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd8318d99-8678-5a88-9fa1-07aa4df4b59c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DU67AEP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117217399',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 95720,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-08',
 'seller_name': 'Zuto',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 SE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 SE 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217399%27 HTTP/1.1" 200 None
2025-12-02 19:02:47 [astonbarclay.gb] INFO: Saving data for 117217399: {'auction_closing_time': 1764756000.0, 'created_time': 1764097462.098402, 'last_price_update_time': 1764702167.490702}
2025-12-02 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117217399') HTTP/1.1" 204 0
2025-12-02 19:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ffb2e0dc-63cf-5790-9da5-de91299ab615 with identifier: 117605293
2025-12-02 19:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ffb2e0dc-63cf-5790-9da5-de91299ab615 with identifier: 117605293
2025-12-02 19:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ffb2e0dc-63cf-5790-9da5-de91299ab615 with identifier: 117605293 to the API
2025-12-02 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KM69HWX/2025-12-02/image/b20ac89f-95fa-4841-af3b-d01c38c5e5f9_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ffb2e0dc-63cf-5790-9da5-de91299ab615',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KM69HWX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117605293',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 53816,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36986,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/aa300758-0cf0-438c-b1b4-992c5abb680b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33212,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/3b937082-aa30-4679-8229-d3a5d8708729_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37391,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/681c7d2a-0bb5-4982-a952-c6e2a02e48de_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37552,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/8a2e4109-4e92-47fa-9d29-a799f17a2344_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49122,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/e95a8559-82e9-4080-923f-469729c82f87_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46472,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/b20ac89f-95fa-4841-af3b-d01c38c5e5f9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53706,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/4f6110e0-7dde-48f9-836c-18f2c6fe3dea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51391,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/d1532de9-b48e-4bd4-9c41-284d2e40bea2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb2e0dc-63cf-5790-9da5-de91299ab615/ffb2e0dc-63cf-5790-9da5-de91299ab615_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42299,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/91a6ecca-eb61-463c-bdbe-3018b9992a09_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': 'SMC GROUP',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Titanium 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605293%27 HTTP/1.1" 200 None
2025-12-02 19:02:48 [astonbarclay.gb] INFO: Saving data for 117605293: {'created_time': 1764702168.647471, 'last_price_update_time': 1764702168.647484, 'auction_closing_time': 1764756000.0}
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117605293') HTTP/1.1" 204 0
2025-12-02 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf48b4bd0>
2025-12-02 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252F5aeac550-dae8-45e1-ae75-065bc0e7bf75_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5aeac550-dae8-45e1-ae75-065bc0e7bf75_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b
2025-12-02 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08fa610>
2025-12-02 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252F5978c5df-90f8-4a20-8b61-d45427cb7d68_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5978c5df-90f8-4a20-8b61-d45427cb7d68_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b
2025-12-02 19:02:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 114036273, 'registration': 'SC16YKU', 'account': 'ZUT001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 71819, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2514, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-05-27', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SC16YKU/2025-07-21/image/c7ff638c-2008-4f4e-9d76-063939cfd7fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/db260a8c-951b-4a7a-a126-f37b07d3f6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/ef4e31fa-f1ec-4184-9a70-ca552c12d33a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/5ec7e89b-f19f-46c7-a464-4e9c71fbb515_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/31548f0b-9dc0-49ff-b530-31649015c52d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/5ad72bb1-86a0-4511-bcf9-af67bdb75400_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/bb6d51a7-4b02-4360-96a3-379438a72639_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/38575eee-ed64-4860-886f-172ebbcdb445_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'ONLY NEW KEEPERS SLIP IN OFFICE VOSA STATES 45K, 54K, 62K, 68K, SD CARD IN OFFICE', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd8500a7-64a4-4c6f-9f20-d5c6dd3f7bc9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 114036273, 'registration': 'SC16YKU', 'account': 'ZUT001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 71819, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2514, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-05-27', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SC16YKU/2025-07-21/image/c7ff638c-2008-4f4e-9d76-063939cfd7fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/db260a8c-951b-4a7a-a126-f37b07d3f6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/ef4e31fa-f1ec-4184-9a70-ca552c12d33a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/5ec7e89b-f19f-46c7-a464-4e9c71fbb515_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/31548f0b-9dc0-49ff-b530-31649015c52d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/5ad72bb1-86a0-4511-bcf9-af67bdb75400_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/bb6d51a7-4b02-4360-96a3-379438a72639_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/38575eee-ed64-4860-886f-172ebbcdb445_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'ONLY NEW KEEPERS SLIP IN OFFICE VOSA STATES 45K, 54K, 62K, 68K, SD CARD IN OFFICE', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd8500a7-64a4-4c6f-9f20-d5c6dd3f7bc9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cfb3114-2738-53c3-a759-96c1d95b095f with identifier: 114036273
2025-12-02 19:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cfb3114-2738-53c3-a759-96c1d95b095f with scrape type 2
2025-12-02 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cfb3114-2738-53c3-a759-96c1d95b095f with scrape type 2
2025-12-02 19:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0cfb3114-2738-53c3-a759-96c1d95b095f, identifier: 114036273
2025-12-02 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HK72VGF/2025-12-02/image/3622391d-1fae-47c8-abc6-4a8ffb54a62d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue)
2025-12-02 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e8c97a5e-92de-4970-b44b-d2153ed642e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627604?view=catalogue)
2025-12-02 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO71OFM/2025-12-02/image/c34b9904-d488-4ed1-bc85-4d0bee777443_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627985?view=catalogue)
2025-12-02 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT22VVW/2025-12-02/image/c73a5cf2-c085-4eda-8389-c8efc01abfa7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627604?view=catalogue)
2025-12-02 19:02:49 [astonbarclay.gb] INFO: Found listing with ID: 117517693
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517693%27 HTTP/1.1" 200 None
2025-12-02 19:02:49 [astonbarclay.gb] INFO: Scrape type for 117517693: 0
2025-12-02 19:02:49 [astonbarclay.gb] INFO: Found listing with ID: 117584328
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584328%27 HTTP/1.1" 200 None
2025-12-02 19:02:49 [astonbarclay.gb] INFO: Scrape type for 117584328: 2
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F18d56b22-0c94-4e7d-9175-26fe89ff82f3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/18d56b22-0c94-4e7d-9175-26fe89ff82f3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252F683baaa5-4251-40f2-a49b-628d1c1b7bd7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/683baaa5-4251-40f2-a49b-628d1c1b7bd7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252Ff4d0ed44-da4a-4691-b28e-e00693add82d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/f4d0ed44-da4a-4691-b28e-e00693add82d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0cfb3114-2738-53c3-a759-96c1d95b095f with identifier: 114036273
2025-12-02 19:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0cfb3114-2738-53c3-a759-96c1d95b095f with identifier: 114036273
2025-12-02 19:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0cfb3114-2738-53c3-a759-96c1d95b095f with identifier: 114036273 to the API
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/114036273?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0cfb3114-2738-53c3-a759-96c1d95b095f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SC16YKU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/114036273',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 71819,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-27',
 'seller_name': 'Zuto',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Connecta 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114036273%27 HTTP/1.1" 200 None
2025-12-02 19:02:50 [astonbarclay.gb] INFO: Saving data for 114036273: {'auction_closing_time': 1764756000.0, 'created_time': 1764097461.879199, 'last_price_update_time': 1764702170.040782}
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='114036273') HTTP/1.1" 204 0
2025-12-02 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/9ad10aec-2da0-42a9-9521-71876c49455f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662118?view=catalogue)
2025-12-02 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS18MMO/2025-12-02/image/326395ca-a6ec-4001-893d-21e0f0907202_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue)
2025-12-02 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO71OFM/2025-12-02/image/6bf99182-fbab-403d-8b66-e832764e5e6e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627985?view=catalogue)
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf076b390>
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252Fab44aa71-90b0-4611-bb86-2992a8d3e64a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ab44aa71-90b0-4611-bb86-2992a8d3e64a_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 506582ff-1440-5046-adbb-d8614199e03f
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07b60d0>
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fd6a6a3a1-e97e-4aa5-ba6d-d2c36eeeb53c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d6a6a3a1-e97e-4aa5-ba6d-d2c36eeeb53c_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cbeb631d-6470-5e0f-b9cc-332242767dc1
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0466150>
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F79df732d-9c48-4c67-950f-1903b32b3a8c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/79df732d-9c48-4c67-950f-1903b32b3a8c_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 506582ff-1440-5046-adbb-d8614199e03f
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07b7990>
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252Fa203dec2-b260-49f5-afa2-7eeafebe3134_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a203dec2-b260-49f5-afa2-7eeafebe3134_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cbeb631d-6470-5e0f-b9cc-332242767dc1
2025-12-02 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HK72VGF/2025-12-02/image/5b622055-c3ba-49c8-b3f7-0bdd21d165ff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue)
2025-12-02 19:02:51 [astonbarclay.gb] INFO: Found listing with ID: 117517733
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517733%27 HTTP/1.1" 200 None
2025-12-02 19:02:51 [astonbarclay.gb] INFO: Scrape type for 117517733: 0
2025-12-02 19:02:51 [astonbarclay.gb] INFO: Found listing with ID: 117517710
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517710%27 HTTP/1.1" 200 None
2025-12-02 19:02:51 [astonbarclay.gb] INFO: Scrape type for 117517710: 0
2025-12-02 19:02:51 [astonbarclay.gb] INFO: Found listing with ID: 117517747
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517747%27 HTTP/1.1" 200 None
2025-12-02 19:02:51 [astonbarclay.gb] INFO: Scrape type for 117517747: 0
2025-12-02 19:02:51 [astonbarclay.gb] INFO: Found listing with ID: 117584337
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584337%27 HTTP/1.1" 200 None
2025-12-02 19:02:51 [astonbarclay.gb] INFO: Scrape type for 117584337: 2
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F8025b10f-087d-4932-9f67-9219f515c1ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/8025b10f-087d-4932-9f67-9219f515c1ae_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117397605?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117626705?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117276677?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117452490?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117310723?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ef4110>
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252F3622391d-1fae-47c8-abc6-4a8ffb54a62d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/3622391d-1fae-47c8-abc6-4a8ffb54a62d_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cbeb631d-6470-5e0f-b9cc-332242767dc1
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0902c90>
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252Fe8c97a5e-92de-4970-b44b-d2153ed642e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e8c97a5e-92de-4970-b44b-d2153ed642e5_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02e7750>
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252Fc34b9904-d488-4ed1-bc85-4d0bee777443_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/c34b9904-d488-4ed1-bc85-4d0bee777443_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 506582ff-1440-5046-adbb-d8614199e03f
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b589d0>
2025-12-02 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252Fc73a5cf2-c085-4eda-8389-c8efc01abfa7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/c73a5cf2-c085-4eda-8389-c8efc01abfa7_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b
2025-12-02 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/3dd01e1f-b757-476a-8670-6e08a3e41777_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue)
2025-12-02 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO71OFM/2025-12-02/image/51d63936-4432-42a2-bb12-c6ed3ec9e4f8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627985?view=catalogue)
2025-12-02 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT22VVW/2025-12-02/image/372b7cde-d79c-4301-b12d-50aec7a4abb3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627604?view=catalogue)
2025-12-02 19:02:52 [astonbarclay.gb] INFO: Found listing with ID: 117517722
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517722%27 HTTP/1.1" 200 None
2025-12-02 19:02:52 [astonbarclay.gb] INFO: Scrape type for 117517722: 0
2025-12-02 19:02:52 [astonbarclay.gb] INFO: Found listing with ID: 117584319
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584319%27 HTTP/1.1" 200 None
2025-12-02 19:02:52 [astonbarclay.gb] INFO: Scrape type for 117584319: 2
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F2d1458ab-6f10-401b-9cd5-657de800e6e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/2d1458ab-6f10-401b-9cd5-657de800e6e6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03f9890>
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWJ17GRX%252F2025-12-02%252Fimage%252F9ad10aec-2da0-42a9-9521-71876c49455f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/9ad10aec-2da0-42a9-9521-71876c49455f_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c79e020-ccca-522b-ba24-b7db825f3356
2025-12-02 19:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c79e020-ccca-522b-ba24-b7db825f3356, skipping ID generation
2025-12-02 19:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c79e020-ccca-522b-ba24-b7db825f3356 with scrape type 1
2025-12-02 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9c79e020-ccca-522b-ba24-b7db825f3356 from tracking dictionaries
2025-12-02 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c79e020-ccca-522b-ba24-b7db825f3356 sending to next pipeline
2025-12-02 19:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9c79e020-ccca-522b-ba24-b7db825f3356, identifier: 117662118
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aa6890>
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS18MMO%252F2025-12-02%252Fimage%252F326395ca-a6ec-4001-893d-21e0f0907202_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS18MMO/2025-12-02/image/326395ca-a6ec-4001-893d-21e0f0907202_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67123457-1c0a-5cdd-8be3-eb490de642b0
2025-12-02 19:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67123457-1c0a-5cdd-8be3-eb490de642b0, skipping ID generation
2025-12-02 19:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67123457-1c0a-5cdd-8be3-eb490de642b0 with scrape type 1
2025-12-02 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 67123457-1c0a-5cdd-8be3-eb490de642b0 from tracking dictionaries
2025-12-02 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67123457-1c0a-5cdd-8be3-eb490de642b0 sending to next pipeline
2025-12-02 19:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 67123457-1c0a-5cdd-8be3-eb490de642b0, identifier: 117662079
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf37e3810>
2025-12-02 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F6bf99182-fbab-403d-8b66-e832764e5e6e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/6bf99182-fbab-403d-8b66-e832764e5e6e_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 506582ff-1440-5046-adbb-d8614199e03f
2025-12-02 19:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT22VVW/2025-12-02/image/baf066c5-771d-4558-94b6-7ffbaf0e12c8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627604?view=catalogue)
2025-12-02 19:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9c79e020-ccca-522b-ba24-b7db825f3356 with identifier: 117662118
2025-12-02 19:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9c79e020-ccca-522b-ba24-b7db825f3356 with identifier: 117662118
2025-12-02 19:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9c79e020-ccca-522b-ba24-b7db825f3356 with identifier: 117662118 to the API
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/9ad10aec-2da0-42a9-9521-71876c49455f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '9c79e020-ccca-522b-ba24-b7db825f3356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WJ17GRX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662118',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 68640,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32776,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/9ad10aec-2da0-42a9-9521-71876c49455f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34330,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/cd7da82f-372a-4200-a4d9-a87ddc1996e1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37366,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/5fd14d88-adf2-4929-911c-0249130e453a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33890,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/e8ba6462-5e65-46f6-a029-df88ef3ce973_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44621,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/1e598046-c815-46c4-abdb-d527cfb41ec5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35392,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/227aece1-5b16-43ff-8611-8401b154f1ac_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90264,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/a1f561ef-cf99-4b02-b4ef-9f69c5489139_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77371,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/923ed404-47b5-487a-b6b7-d992452917d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50047,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/f0cdc0a4-e1d3-40a5-961d-f5690e49642f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24774,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/166df408-a2b7-4812-806d-a5eb8cd6ab32_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c79e020-ccca-522b-ba24-b7db825f3356/9c79e020-ccca-522b-ba24-b7db825f3356_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34967,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/WJ17GRX/2025-12-02/image/3e4906e6-0399-4996-91b5-397a69195db3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': 'TCB Group - Prime',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 HSE Dynamic '
          '5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 HSE Dynamic 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662118%27 HTTP/1.1" 200 None
2025-12-02 19:02:53 [astonbarclay.gb] INFO: Saving data for 117662118: {'created_time': 1764702173.524295, 'last_price_update_time': 1764702173.524306, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662118') HTTP/1.1" 204 0
2025-12-02 19:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 67123457-1c0a-5cdd-8be3-eb490de642b0 with identifier: 117662079
2025-12-02 19:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 67123457-1c0a-5cdd-8be3-eb490de642b0 with identifier: 117662079
2025-12-02 19:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 67123457-1c0a-5cdd-8be3-eb490de642b0 with identifier: 117662079 to the API
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DS18MMO/2025-12-02/image/326395ca-a6ec-4001-893d-21e0f0907202_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '67123457-1c0a-5cdd-8be3-eb490de642b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS18MMO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662079',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 60294,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30877,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/326395ca-a6ec-4001-893d-21e0f0907202_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29088,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/3f4f2b49-3ec9-4eda-b368-157b402a9d03_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33912,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/6a82ce94-55c1-40cd-86aa-02c1e9d4e2a2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29575,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/92a974d9-f0db-4f98-8ef3-d9c65aae54e4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79068,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/eb0f444d-5ccd-4174-b751-310d29957c4c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64828,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/e48f57b9-748d-41a0-a19b-370f89bf0efd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46374,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/2abcfa8c-7f6c-4501-95ef-b2ac19257873_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40075,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/5c6f1c4e-1378-46c6-85d5-a622a28748e7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60617,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/12ddd530-3d88-4642-ae11-10cc4829c874_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67123457-1c0a-5cdd-8be3-eb490de642b0/67123457-1c0a-5cdd-8be3-eb490de642b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64774,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/f9e664e9-18f3-422b-b182-c43ae6c37176_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Tekna 5dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662079%27 HTTP/1.1" 200 None
2025-12-02 19:02:53 [astonbarclay.gb] INFO: Saving data for 117662079: {'created_time': 1764702173.909431, 'last_price_update_time': 1764702173.909444, 'auction_closing_time': 1764755100.0}
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662079') HTTP/1.1" 204 0
2025-12-02 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066f850>
2025-12-02 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHK72VGF%252F2025-12-02%252Fimage%252F5b622055-c3ba-49c8-b3f7-0bdd21d165ff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HK72VGF/2025-12-02/image/5b622055-c3ba-49c8-b3f7-0bdd21d165ff_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cbeb631d-6470-5e0f-b9cc-332242767dc1
2025-12-02 19:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbeb631d-6470-5e0f-b9cc-332242767dc1, skipping ID generation
2025-12-02 19:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbeb631d-6470-5e0f-b9cc-332242767dc1 with scrape type 1
2025-12-02 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cbeb631d-6470-5e0f-b9cc-332242767dc1 from tracking dictionaries
2025-12-02 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbeb631d-6470-5e0f-b9cc-332242767dc1 sending to next pipeline
2025-12-02 19:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cbeb631d-6470-5e0f-b9cc-332242767dc1, identifier: 117605302
2025-12-02 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/f4d0ed44-da4a-4691-b28e-e00693add82d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue)
2025-12-02 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO71OFM/2025-12-02/image/50dbcbbb-296c-4ee0-b9bf-c25183032778_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627985?view=catalogue)
2025-12-02 19:02:54 [astonbarclay.gb] INFO: Found listing with ID: 117584261
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584261%27 HTTP/1.1" 200 None
2025-12-02 19:02:54 [astonbarclay.gb] INFO: Scrape type for 117584261: 2
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252Fccb6a71e-365d-41f4-8dbf-7dbe615805d9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/ccb6a71e-365d-41f4-8dbf-7dbe615805d9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115457692?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117079065?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cbeb631d-6470-5e0f-b9cc-332242767dc1 with identifier: 117605302
2025-12-02 19:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cbeb631d-6470-5e0f-b9cc-332242767dc1 with identifier: 117605302
2025-12-02 19:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cbeb631d-6470-5e0f-b9cc-332242767dc1 with identifier: 117605302 to the API
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/HK72VGF/2025-12-02/image/5b622055-c3ba-49c8-b3f7-0bdd21d165ff_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cbeb631d-6470-5e0f-b9cc-332242767dc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HK72VGF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117605302',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND HATCHBACK',
 'odometer': 21811,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33559,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d2097441-a9b8-4c03-99f6-9cdbf47e5cd8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28136,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/8fa20397-93b8-4d4f-8652-a9d4e42798aa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34649,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/bf126592-2a72-40c3-9064-5c235f25b613_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32024,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/c1545413-1741-4155-9a15-6aea8b49b4df_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20791,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/82675e9d-48ff-4af7-8324-278e13a980c3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41354,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a3164988-f4b7-4226-a441-f55defec4c4f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51160,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a203dec2-b260-49f5-afa2-7eeafebe3134_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45595,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d6a6a3a1-e97e-4aa5-ba6d-d2c36eeeb53c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46623,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/3622391d-1fae-47c8-abc6-4a8ffb54a62d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbeb631d-6470-5e0f-b9cc-332242767dc1/cbeb631d-6470-5e0f-b9cc-332242767dc1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66731,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/5b622055-c3ba-49c8-b3f7-0bdd21d165ff_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-06',
 'seller_name': 'SMC GROUP',
 'title': 'VAUXHALL GRANDLAND HATCHBACK 1.2 Turbo Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Ultimate 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-02 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605302%27 HTTP/1.1" 200 None
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Saving data for 117605302: {'created_time': 1764702175.007204, 'last_price_update_time': 1764702175.007213, 'auction_closing_time': 1764756000.0}
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117605302') HTTP/1.1" 204 0
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117397605, 'registration': 'RV72YYE', 'account': 'DAY005', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 39662, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2522, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-09-16', 'fuel': 'Diesel', 'motExpiry': '2026-09-15', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV72YYE/2025-11-24/image/af201da6-9ef9-439b-aefd-1ddf604d603b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/4dfdc7fe-8269-469e-bab9-084c98cff8d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/112051d6-6ad0-4050-a40e-d5414020d68d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/9d71a631-3046-4c48-b97a-33e1c0cd119d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/a4761cfc-8d26-495e-9477-eafc2bf5a1bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/e03b3775-d6b7-4366-b406-c9d498b7120f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/40962408-0249-417b-8737-45063378cee9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/e189b0c5-ae4f-449c-bde8-f1567c0d0b35_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/a91b4f09-9f7c-4531-a084-684ca6a7628a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/b3115f3e-fe2c-4113-9bdb-bdb2e9cc5f74_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25-29K', 'remarks': '', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe1dae54-0e79-4292-b064-51eb2123224a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117397605, 'registration': 'RV72YYE', 'account': 'DAY005', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 39662, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2522, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-09-16', 'fuel': 'Diesel', 'motExpiry': '2026-09-15', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV72YYE/2025-11-24/image/af201da6-9ef9-439b-aefd-1ddf604d603b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/4dfdc7fe-8269-469e-bab9-084c98cff8d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/112051d6-6ad0-4050-a40e-d5414020d68d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/9d71a631-3046-4c48-b97a-33e1c0cd119d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/a4761cfc-8d26-495e-9477-eafc2bf5a1bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/e03b3775-d6b7-4366-b406-c9d498b7120f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/40962408-0249-417b-8737-45063378cee9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/e189b0c5-ae4f-449c-bde8-f1567c0d0b35_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/a91b4f09-9f7c-4531-a084-684ca6a7628a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/b3115f3e-fe2c-4113-9bdb-bdb2e9cc5f74_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25-29K', 'remarks': '', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe1dae54-0e79-4292-b064-51eb2123224a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with identifier: 117397605
2025-12-02 19:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with scrape type 2
2025-12-02 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with scrape type 2
2025-12-02 19:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb, identifier: 117397605
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117626705, 'registration': 'GN70XMC', 'account': 'STE009', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr DCT', 'mileage': 29254, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1123, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-09-05', 'fuel': 'Petrol', 'motExpiry': '2026-09-27', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GN70XMC/2025-12-02/image/8ce4e6e7-becf-499d-8c4c-9780e7797d57_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7eb09dd1-42a9-4d47-9ad4-9a30391523b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c1aa0908-74af-41b5-9f61-a0fc4d6ffc84_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/d635a90a-a74a-4992-bdac-507087e1554e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/142e7745-dc98-4e22-9b91-ece5e00b8850_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c87d8e4a-c20e-4e83-93cb-4ec94df8362e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/98887429-4eb6-4764-9c7b-8efb542f9cc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/22a1e99b-d520-407f-8f96-21a1646aadb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7b9c579b-7c3e-45da-978a-b46db5be5f39_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/0acade92-cb45-4857-b00a-ea0f94b88208_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'VOSA STATES, 16K, 21K, 27K', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 177, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f405c576-72f7-4a80-8b0e-582d7759d16f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117626705, 'registration': 'GN70XMC', 'account': 'STE009', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr DCT', 'mileage': 29254, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1123, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-09-05', 'fuel': 'Petrol', 'motExpiry': '2026-09-27', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GN70XMC/2025-12-02/image/8ce4e6e7-becf-499d-8c4c-9780e7797d57_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7eb09dd1-42a9-4d47-9ad4-9a30391523b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c1aa0908-74af-41b5-9f61-a0fc4d6ffc84_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/d635a90a-a74a-4992-bdac-507087e1554e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/142e7745-dc98-4e22-9b91-ece5e00b8850_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c87d8e4a-c20e-4e83-93cb-4ec94df8362e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/98887429-4eb6-4764-9c7b-8efb542f9cc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/22a1e99b-d520-407f-8f96-21a1646aadb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7b9c579b-7c3e-45da-978a-b46db5be5f39_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/0acade92-cb45-4857-b00a-ea0f94b88208_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'VOSA STATES, 16K, 21K, 27K', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 177, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f405c576-72f7-4a80-8b0e-582d7759d16f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b72ee729-55bc-52a5-989d-ac2b2b7aba2c with identifier: 117626705
2025-12-02 19:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c with scrape type 1
2025-12-02 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F8ce4e6e7-becf-499d-8c4c-9780e7797d57_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/8ce4e6e7-becf-499d-8c4c-9780e7797d57_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117276677, 'registration': 'LP19RXL', 'account': 'SOU037', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.0T ecoTEC Elite Nav 5dr', 'mileage': 31105, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2531, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-22', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP19RXL/2025-11-18/image/7c43d681-7f13-42dc-b0d4-934c44c04ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/51a43a15-b093-41f1-a854-dd2eeae9452b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/21c4de07-50d4-4094-8e4c-d8aa06ba8e5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/134999b7-7f0f-4a53-ad71-0d08023791eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/54740b1b-9aba-494a-aafc-636cc0f1a8eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/17b6e06a-67c2-4b70-a094-b6f7af3f1fdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/c7944ae5-0eba-47da-8f24-2afb0c9957e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/989087b9-4427-436a-a063-fce6611165ec_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 06/21-19K 10/22-28K 05/24-30K 05/25-30K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 28K 30K 30K', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f18308b6-7d41-45ca-b7b9-c0d3823e2c66.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117276677, 'registration': 'LP19RXL', 'account': 'SOU037', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.0T ecoTEC Elite Nav 5dr', 'mileage': 31105, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2531, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-22', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP19RXL/2025-11-18/image/7c43d681-7f13-42dc-b0d4-934c44c04ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/51a43a15-b093-41f1-a854-dd2eeae9452b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/21c4de07-50d4-4094-8e4c-d8aa06ba8e5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/134999b7-7f0f-4a53-ad71-0d08023791eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/54740b1b-9aba-494a-aafc-636cc0f1a8eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/17b6e06a-67c2-4b70-a094-b6f7af3f1fdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/c7944ae5-0eba-47da-8f24-2afb0c9957e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/989087b9-4427-436a-a063-fce6611165ec_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 06/21-19K 10/22-28K 05/24-30K 05/25-30K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 28K 30K 30K', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f18308b6-7d41-45ca-b7b9-c0d3823e2c66.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677
2025-12-02 19:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with scrape type 2
2025-12-02 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with scrape type 2
2025-12-02 19:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d, identifier: 117276677
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117452490, 'registration': 'SB67GKV', 'account': 'FCC001', 'make': 'BMW', 'model': 'X5 ESTATE', 'derivative': 'xDrive40e M Sport 5dr Auto', 'mileage': 113348, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2523, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-17', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SB67GKV/2025-11-24/image/4aec8c6c-795e-4ffc-b3b1-c77d831caa05_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/b2566468-4162-404e-bea8-afc41d928cc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/1c4bc1ca-edef-4c59-a239-bec94f7d3e3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/bbcfb972-f6b8-4a2e-8b8a-adcbba5c5f0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/7d64c9d1-93df-4e6f-ba5f-62eac61ab6ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/847d4496-7d2d-41fa-b6fb-d4d001284b32_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/44a009e8-2169-48ff-9eca-058ef8708b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/6b6ccf76-9e91-4f9a-8713-d43d8420a6e0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 03/19 22K 07/20-44K, 06/21-67K, 04/22-89K.', 'remarks': 'VOSA STATES MILES@ 111,761K, 111,769K, 111,815K, 111,827K. SPARE KEY IN OFFICE.', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 78, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d8496bbb-c93d-4e55-b81d-e93c6028c66c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117452490, 'registration': 'SB67GKV', 'account': 'FCC001', 'make': 'BMW', 'model': 'X5 ESTATE', 'derivative': 'xDrive40e M Sport 5dr Auto', 'mileage': 113348, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2523, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-17', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SB67GKV/2025-11-24/image/4aec8c6c-795e-4ffc-b3b1-c77d831caa05_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/b2566468-4162-404e-bea8-afc41d928cc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/1c4bc1ca-edef-4c59-a239-bec94f7d3e3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/bbcfb972-f6b8-4a2e-8b8a-adcbba5c5f0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/7d64c9d1-93df-4e6f-ba5f-62eac61ab6ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/847d4496-7d2d-41fa-b6fb-d4d001284b32_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/44a009e8-2169-48ff-9eca-058ef8708b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/6b6ccf76-9e91-4f9a-8713-d43d8420a6e0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 03/19 22K 07/20-44K, 06/21-67K, 04/22-89K.', 'remarks': 'VOSA STATES MILES@ 111,761K, 111,769K, 111,815K, 111,827K. SPARE KEY IN OFFICE.', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 78, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d8496bbb-c93d-4e55-b81d-e93c6028c66c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e65083d-5e5f-588d-ae0f-977434105342 with identifier: 117452490
2025-12-02 19:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e65083d-5e5f-588d-ae0f-977434105342 with scrape type 2
2025-12-02 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e65083d-5e5f-588d-ae0f-977434105342 with scrape type 2
2025-12-02 19:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5e65083d-5e5f-588d-ae0f-977434105342, identifier: 117452490
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117310723, 'registration': 'RV66XCX', 'account': 'DAN036', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav]', 'mileage': 51449, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2521, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-10-08', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV66XCX/2025-11-18/image/fac241cc-cd1e-4326-ae37-1e4752bf270d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/2c96102c-43f7-4f00-879c-4df44221ce0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/c0bb5dde-1c39-410a-b3aa-b6b4a6c2a449_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/0bae5347-7c0f-4b80-be05-1358c4ddeb75_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/4264a0de-0a27-40c3-b483-f6826872751d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/48720d7f-d38e-4ab0-a768-ac72b358f0fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/21e5f7f0-1074-4bfc-801c-483f61bcb771_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL, VOSA STATES - 26K, 37K, 49K, 51K', 'virtual': False, 'seller': 'Local dealer group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8c212ee-b852-4f40-b03c-a78097b53574.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117310723, 'registration': 'RV66XCX', 'account': 'DAN036', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav]', 'mileage': 51449, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2521, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-10-08', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV66XCX/2025-11-18/image/fac241cc-cd1e-4326-ae37-1e4752bf270d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/2c96102c-43f7-4f00-879c-4df44221ce0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/c0bb5dde-1c39-410a-b3aa-b6b4a6c2a449_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/0bae5347-7c0f-4b80-be05-1358c4ddeb75_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/4264a0de-0a27-40c3-b483-f6826872751d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/48720d7f-d38e-4ab0-a768-ac72b358f0fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/21e5f7f0-1074-4bfc-801c-483f61bcb771_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL, VOSA STATES - 26K, 37K, 49K, 51K', 'virtual': False, 'seller': 'Local dealer group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8c212ee-b852-4f40-b03c-a78097b53574.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723
2025-12-02 19:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with scrape type 2
2025-12-02 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with scrape type 2
2025-12-02 19:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3e5c1793-1592-51ac-94a1-fc485e5e64b0, identifier: 117310723
2025-12-02 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/8025b10f-087d-4932-9f67-9219f515c1ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue)
2025-12-02 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT22VVW/2025-12-02/image/683baaa5-4251-40f2-a49b-628d1c1b7bd7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627604?view=catalogue)
2025-12-02 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO71OFM/2025-12-02/image/18d56b22-0c94-4e7d-9175-26fe89ff82f3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627985?view=catalogue)
2025-12-02 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM18VOU/2025-12-02/image/cf92d786-4b9d-488c-95ce-3b4525bb52ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662383?view=catalogue)
2025-12-02 19:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with identifier: 117397605
2025-12-02 19:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with identifier: 117397605
2025-12-02 19:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with identifier: 117397605 to the API
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb%27 HTTP/1.1" 200 None
2025-12-02 19:02:55 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:02:54 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117397605?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RV72YYE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117397605',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 39662,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seller_name': 'Days Fleet',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397605%27 HTTP/1.1" 200 None
2025-12-02 19:02:55 [astonbarclay.gb] INFO: Saving data for 117397605: {'auction_closing_time': 1764756000.0, 'created_time': 1763751833.796632, 'last_price_update_time': 1764702175.728343}
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117397605') HTTP/1.1" 204 0
2025-12-02 19:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677
2025-12-02 19:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677
2025-12-02 19:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677 to the API
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117276677?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4a42e05e-1cce-5cf2-8f88-23b89a32ba9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP19RXL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117276677',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'ASTRA HATCHBACK',
 'odometer': 31105,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': 'Local Dealer Group',
 'title': 'VAUXHALL ASTRA HATCHBACK 1.0T ecoTEC Elite Nav 5dr',
 'transmission': 'manual',
 'trim': '1.0T ecoTEC Elite Nav 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117276677%27 HTTP/1.1" 200 None
2025-12-02 19:02:56 [astonbarclay.gb] INFO: Saving data for 117276677: {'auction_closing_time': 1764756000.0, 'created_time': 1763492979.845664, 'last_price_update_time': 1764702176.012932}
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117276677') HTTP/1.1" 204 0
2025-12-02 19:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5e65083d-5e5f-588d-ae0f-977434105342 with identifier: 117452490
2025-12-02 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5e65083d-5e5f-588d-ae0f-977434105342 with identifier: 117452490
2025-12-02 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182415 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182415
2025-12-02 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5e65083d-5e5f-588d-ae0f-977434105342 spider: astonbarclay.gb
2025-12-02 19:02:56 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5e65083d-5e5f-588d-ae0f-977434105342 due to rule: high_mileage_for_country.json, error: 182415 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182415
{'auction_title': '',
 'c_o_2_emission_value': 78,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '5e65083d-5e5f-588d-ae0f-977434105342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SB67GKV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117452490',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': 'X5 ESTATE',
 'odometer': 113348,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-09',
 'seller_name': 'Local Dealer Group',
 'title': 'BMW X5 ESTATE xDrive40e M Sport 5dr Auto',
 'transmission': 'automatic',
 'trim': 'xDrive40e M Sport 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452490%27 HTTP/1.1" 200 None
2025-12-02 19:02:56 [astonbarclay.gb] INFO: Saving data for 117452490: {'auction_closing_time': 1764756000.0, 'created_time': 1764010992.773169, 'last_price_update_time': 1764702176.219942}
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117452490') HTTP/1.1" 204 0
2025-12-02 19:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723
2025-12-02 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723
2025-12-02 19:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723 to the API
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117310723?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3e5c1793-1592-51ac-94a1-fc485e5e64b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RV66XCX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117310723',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 51449,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-22',
 'seller_name': 'Local dealer group',
 'title': 'BMW 1 SERIES HATCHBACK 118i [1.5] Sport 5dr [Nav]',
 'transmission': 'manual',
 'trim': '118i [1.5] Sport 5dr [Nav]',
 'vin': None,
 'year': 2016}
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310723%27 HTTP/1.1" 200 None
2025-12-02 19:02:56 [astonbarclay.gb] INFO: Saving data for 117310723: {'auction_closing_time': 1764756000.0, 'created_time': 1763492732.772906, 'last_price_update_time': 1764702176.508619}
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117310723') HTTP/1.1" 204 0
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0628e90>
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F3dd01e1f-b757-476a-8670-6e08a3e41777_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/3dd01e1f-b757-476a-8670-6e08a3e41777_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06c8310>
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F51d63936-4432-42a2-bb12-c6ed3ec9e4f8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/51d63936-4432-42a2-bb12-c6ed3ec9e4f8_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 506582ff-1440-5046-adbb-d8614199e03f
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf34ea550>
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252F372b7cde-d79c-4301-b12d-50aec7a4abb3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/372b7cde-d79c-4301-b12d-50aec7a4abb3_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b
2025-12-02 19:02:57 [astonbarclay.gb] INFO: Found listing with ID: 117033189
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117033189%27 HTTP/1.1" 200 None
2025-12-02 19:02:57 [astonbarclay.gb] INFO: Scrape type for 117033189: 2
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F76fd3979-46e0-4b5a-9185-f38f4fdd5dc8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/76fd3979-46e0-4b5a-9185-f38f4fdd5dc8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F7eb09dd1-42a9-4d47-9ad4-9a30391523b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7eb09dd1-42a9-4d47-9ad4-9a30391523b0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117311708?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c8ab90>
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252Fbaf066c5-771d-4558-94b6-7ffbaf0e12c8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/baf066c5-771d-4558-94b6-7ffbaf0e12c8_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b
2025-12-02 19:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM18VOU/2025-12-02/image/bf4b9b9d-e080-4d1e-af32-184011b14adb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662383?view=catalogue)
2025-12-02 19:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08ebad0>
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252Ff4d0ed44-da4a-4691-b28e-e00693add82d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/f4d0ed44-da4a-4691-b28e-e00693add82d_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02f03d0>
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F50dbcbbb-296c-4ee0-b9bf-c25183032778_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/50dbcbbb-296c-4ee0-b9bf-c25183032778_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 506582ff-1440-5046-adbb-d8614199e03f
2025-12-02 19:02:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 115457692, 'registration': 'SH70XHZ', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '2.0 P400e HSE Dynamic 5dr Auto', 'mileage': 58856, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2532, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-11-18', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d9430313-a41a-4543-9e38-bb174b8d8c74_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3d6c4928-b0dd-41c5-a7d6-17da830727d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/afab8c24-aaba-47ee-a54d-3361df10d9a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/8b2b895a-acae-4376-99c6-99c321587142_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d46f2c47-217e-44aa-b227-81261cfcd068_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3676b677-aad7-4bb2-bd41-cd462779a256_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/f9a7c435-439a-4052-a22e-a9f6f0bdd4bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/84ead4fd-c425-4ac3-9f96-4083538f5e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3bd85656-5e16-4949-9800-c2c495b30acd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/22-15K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 24K, 28K, 53K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 75, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/301af9a9-f42c-416a-ba0f-e59c32faa699.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 115457692, 'registration': 'SH70XHZ', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '2.0 P400e HSE Dynamic 5dr Auto', 'mileage': 58856, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2532, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-11-18', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d9430313-a41a-4543-9e38-bb174b8d8c74_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3d6c4928-b0dd-41c5-a7d6-17da830727d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/afab8c24-aaba-47ee-a54d-3361df10d9a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/8b2b895a-acae-4376-99c6-99c321587142_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d46f2c47-217e-44aa-b227-81261cfcd068_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3676b677-aad7-4bb2-bd41-cd462779a256_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/f9a7c435-439a-4052-a22e-a9f6f0bdd4bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/84ead4fd-c425-4ac3-9f96-4083538f5e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3bd85656-5e16-4949-9800-c2c495b30acd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/22-15K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 24K, 28K, 53K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 75, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/301af9a9-f42c-416a-ba0f-e59c32faa699.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692
2025-12-02 19:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18c771c7-041e-5d53-ad17-7dea3f7e3abd with scrape type 2
2025-12-02 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18c771c7-041e-5d53-ad17-7dea3f7e3abd with scrape type 2
2025-12-02 19:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 18c771c7-041e-5d53-ad17-7dea3f7e3abd, identifier: 115457692
2025-12-02 19:02:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117079065, 'registration': 'CU19XNC', 'account': 'ZUT001', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2T [110] Elite Nav 5dr [Start Stop] Auto', 'mileage': 66357, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2516, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-08', 'fuel': 'Petrol', 'motExpiry': '2025-09-23', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CU19XNC/2025-11-11/image/23b2f51e-7b4a-4e69-8191-54ff4377ee27_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/eff1c07c-701c-48a8-b39a-5b286f3d7ae7_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/e89c2db8-e314-4ab2-8f4c-4342c392e94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/ce4b833e-47f9-4c5f-8f7d-645f08f691ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/dabb23ac-89cf-446a-a12f-9f41dfe36bdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/1d9949a8-87e0-4b75-a4e4-00df05a873c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/f1b0f023-abfd-4498-9d35-ad5ffc6e96b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/af45f735-9d10-41e9-83cb-b32bc0b011af_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/49b71a9d-3e78-4327-a084-99c8c64a6ea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/d0431ab4-be1b-4134-bdd8-5a1efc050594_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/20-11k,  04/21-17k,  03/22-29,', 'remarks': 'SPARE KEY, VOSA STATES 29K 39K 56K 63K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d9308124-5405-4035-b3b7-5a1053de6b26.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117079065, 'registration': 'CU19XNC', 'account': 'ZUT001', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2T [110] Elite Nav 5dr [Start Stop] Auto', 'mileage': 66357, 'mileageWarranty': False, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2516, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-08', 'fuel': 'Petrol', 'motExpiry': '2025-09-23', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CU19XNC/2025-11-11/image/23b2f51e-7b4a-4e69-8191-54ff4377ee27_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/eff1c07c-701c-48a8-b39a-5b286f3d7ae7_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/e89c2db8-e314-4ab2-8f4c-4342c392e94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/ce4b833e-47f9-4c5f-8f7d-645f08f691ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/dabb23ac-89cf-446a-a12f-9f41dfe36bdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/1d9949a8-87e0-4b75-a4e4-00df05a873c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/f1b0f023-abfd-4498-9d35-ad5ffc6e96b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/af45f735-9d10-41e9-83cb-b32bc0b011af_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/49b71a9d-3e78-4327-a084-99c8c64a6ea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/d0431ab4-be1b-4134-bdd8-5a1efc050594_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/20-11k,  04/21-17k,  03/22-29,', 'remarks': 'SPARE KEY, VOSA STATES 29K 39K 56K 63K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d9308124-5405-4035-b3b7-5a1053de6b26.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with identifier: 117079065
2025-12-02 19:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with scrape type 2
2025-12-02 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with scrape type 2
2025-12-02 19:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d873c126-6db5-56fc-8c00-0dd2dc4f08d9, identifier: 117079065
2025-12-02 19:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/2d1458ab-6f10-401b-9cd5-657de800e6e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue)
2025-12-02 19:02:58 [astonbarclay.gb] INFO: Found listing with ID: 117584308
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584308%27 HTTP/1.1" 200 None
2025-12-02 19:02:58 [astonbarclay.gb] INFO: Scrape type for 117584308: 2
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F60db119d-2458-45d3-b46a-a5b2f38cf516_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/60db119d-2458-45d3-b46a-a5b2f38cf516_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252Fc1aa0908-74af-41b5-9f61-a0fc4d6ffc84_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c1aa0908-74af-41b5-9f61-a0fc4d6ffc84_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692
2025-12-02 19:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692
2025-12-02 19:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692 to the API
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115457692?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 75,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '18c771c7-041e-5d53-ad17-7dea3f7e3abd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SH70XHZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115457692',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT ESTATE',
 'odometer': 58856,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': 'Mann Island Finance',
 'title': 'LAND ROVER RANGE ROVER SPORT ESTATE 2.0 P400e HSE Dynamic 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 P400e HSE Dynamic 5dr Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115457692%27 HTTP/1.1" 200 None
2025-12-02 19:02:58 [astonbarclay.gb] INFO: Saving data for 115457692: {'auction_closing_time': 1764756000.0, 'created_time': 1762283180.530747, 'last_price_update_time': 1764702178.492628}
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115457692') HTTP/1.1" 204 0
2025-12-02 19:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with identifier: 117079065
2025-12-02 19:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with identifier: 117079065
2025-12-02 19:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with identifier: 117079065 to the API
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117079065?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd873c126-6db5-56fc-8c00-0dd2dc4f08d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CU19XNC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117079065',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND X HATCHBACK',
 'odometer': 66357,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-08',
 'seller_name': 'Zuto',
 'title': 'VAUXHALL CROSSLAND X HATCHBACK 1.2T [110] Elite Nav 5dr [Start '
          'Stop] Auto',
 'transmission': 'automatic',
 'trim': '1.2T [110] Elite Nav 5dr [Start Stop] Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117079065%27 HTTP/1.1" 200 None
2025-12-02 19:02:58 [astonbarclay.gb] INFO: Saving data for 117079065: {'auction_closing_time': 1764756000.0, 'created_time': 1764097470.44529, 'last_price_update_time': 1764702178.890149}
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117079065') HTTP/1.1" 204 0
2025-12-02 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04ef250>
2025-12-02 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F8025b10f-087d-4932-9f67-9219f515c1ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/8025b10f-087d-4932-9f67-9219f515c1ae_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0919790>
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT22VVW%252F2025-12-02%252Fimage%252F683baaa5-4251-40f2-a49b-628d1c1b7bd7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT22VVW/2025-12-02/image/683baaa5-4251-40f2-a49b-628d1c1b7bd7_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b
2025-12-02 19:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10c872fd-9e40-56e1-abab-9ea4dadc8e0b, skipping ID generation
2025-12-02 19:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b with scrape type 1
2025-12-02 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b from tracking dictionaries
2025-12-02 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10c872fd-9e40-56e1-abab-9ea4dadc8e0b sending to next pipeline
2025-12-02 19:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 10c872fd-9e40-56e1-abab-9ea4dadc8e0b, identifier: 117627604
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09ced90>
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO71OFM%252F2025-12-02%252Fimage%252F18d56b22-0c94-4e7d-9175-26fe89ff82f3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO71OFM/2025-12-02/image/18d56b22-0c94-4e7d-9175-26fe89ff82f3_removebg.jpg?w=600 saved to cache
2025-12-02 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 506582ff-1440-5046-adbb-d8614199e03f
2025-12-02 19:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 506582ff-1440-5046-adbb-d8614199e03f, skipping ID generation
2025-12-02 19:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 506582ff-1440-5046-adbb-d8614199e03f with scrape type 1
2025-12-02 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 506582ff-1440-5046-adbb-d8614199e03f from tracking dictionaries
2025-12-02 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 506582ff-1440-5046-adbb-d8614199e03f sending to next pipeline
2025-12-02 19:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 506582ff-1440-5046-adbb-d8614199e03f, identifier: 117627985
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0919810>
2025-12-02 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252Fcf92d786-4b9d-488c-95ce-3b4525bb52ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/cf92d786-4b9d-488c-95ce-3b4525bb52ad_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52669e31-67d3-5cd8-9ca1-4e345de83c70
2025-12-02 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LM18VOU/2025-12-02/image/330395e3-4c8b-475b-9273-a16080df0a3a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662383?view=catalogue)
2025-12-02 19:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 10c872fd-9e40-56e1-abab-9ea4dadc8e0b with identifier: 117627604
2025-12-02 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:03:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREEN HTTP/1.1" 200 None
2025-12-02 19:03:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 10c872fd-9e40-56e1-abab-9ea4dadc8e0b with identifier: 117627604
2025-12-02 19:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 10c872fd-9e40-56e1-abab-9ea4dadc8e0b with identifier: 117627604 to the API
2025-12-02 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LT22VVW/2025-12-02/image/683baaa5-4251-40f2-a49b-628d1c1b7bd7_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'GREEN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '10c872fd-9e40-56e1-abab-9ea4dadc8e0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT22VVW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117627604',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'AYGO X HATCHBACK',
 'odometer': 16378,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33657,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/f1904dc5-a25a-4cac-926b-0b269acc8434_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29858,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/2b2b908f-ebed-4c6c-9d89-19c79b496cd2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30328,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e2750ea5-a799-47f9-b20a-fe9f4e3eda75_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28907,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5aeac550-dae8-45e1-ae75-065bc0e7bf75_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41174,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/5978c5df-90f8-4a20-8b61-d45427cb7d68_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45437,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/e8c97a5e-92de-4970-b44b-d2153ed642e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40523,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/c73a5cf2-c085-4eda-8389-c8efc01abfa7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54361,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/baf066c5-771d-4558-94b6-7ffbaf0e12c8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51621,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/372b7cde-d79c-4301-b12d-50aec7a4abb3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10c872fd-9e40-56e1-abab-9ea4dadc8e0b/10c872fd-9e40-56e1-abab-9ea4dadc8e0b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51728,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT22VVW/2025-12-02/image/683baaa5-4251-40f2-a49b-628d1c1b7bd7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-19',
 'seller_name': 'Hedin Automotive Mini',
 'title': 'TOYOTA AYGO X HATCHBACK 1.0 VVT-i Limited Edition 5dr',
 'transmission': 'manual',
 'trim': '1.0 VVT-i Limited Edition 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627604%27 HTTP/1.1" 200 None
2025-12-02 19:03:01 [astonbarclay.gb] INFO: Saving data for 117627604: {'created_time': 1764702181.201526, 'last_price_update_time': 1764702181.201536, 'auction_closing_time': 1764756000.0}
2025-12-02 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117627604') HTTP/1.1" 204 0
2025-12-02 19:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 506582ff-1440-5046-adbb-d8614199e03f with identifier: 117627985
2025-12-02 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:03:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE%2FBLACK HTTP/1.1" 200 None
2025-12-02 19:03:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 506582ff-1440-5046-adbb-d8614199e03f with identifier: 117627985
2025-12-02 19:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 506582ff-1440-5046-adbb-d8614199e03f with identifier: 117627985 to the API
2025-12-02 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LO71OFM/2025-12-02/image/18d56b22-0c94-4e7d-9175-26fe89ff82f3_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '506582ff-1440-5046-adbb-d8614199e03f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LO71OFM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117627985',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 50696,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29756,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/54aa7f6e-62eb-4408-9a6c-39cbeed1e0b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25247,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ee974730-016d-4060-a593-106a091b69db_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28466,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/21387fd4-ab1f-43a1-bb3e-ba800d44b816_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26279,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/79df732d-9c48-4c67-950f-1903b32b3a8c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55264,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/ab44aa71-90b0-4611-bb86-2992a8d3e64a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42545,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/c34b9904-d488-4ed1-bc85-4d0bee777443_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96713,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/6bf99182-fbab-403d-8b66-e832764e5e6e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76644,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/50dbcbbb-296c-4ee0-b9bf-c25183032778_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46236,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/51d63936-4432-42a2-bb12-c6ed3ec9e4f8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_506582ff-1440-5046-adbb-d8614199e03f/506582ff-1440-5046-adbb-d8614199e03f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46876,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO71OFM/2025-12-02/image/18d56b22-0c94-4e7d-9175-26fe89ff82f3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seller_name': 'Hedin Automotive Mini',
 'title': 'MINI HATCHBACK 1.5 Cooper Exclusive 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 Cooper Exclusive 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627985%27 HTTP/1.1" 200 None
2025-12-02 19:03:03 [astonbarclay.gb] INFO: Saving data for 117627985: {'created_time': 1764702183.605933, 'last_price_update_time': 1764702183.605977, 'auction_closing_time': 1764756000.0}
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117627985') HTTP/1.1" 204 0
2025-12-02 19:03:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117311708, 'registration': 'LP69DMZ', 'account': 'MAN037', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI EVO Match Edition 5dr', 'mileage': 93096, 'mileageWarranty': False, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1020, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-01-20', 'fuel': 'Petrol', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/a6843e07-c65b-4401-98c2-5f2271061044_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/0ec9d7ca-606f-4e93-b123-a89237bf5897_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/5939a1fc-290f-44a5-a2a1-ecae5e89b94e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/726b4923-419f-4f38-9155-f995c2259f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/d60cbfed-797e-4fcc-acee-e00ecdc60d60_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b9ca54e6-9f0f-4b3f-8847-213bf32e232c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b765dc8b-f8af-4847-ab12-9d441b98434e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/91dd433f-f5d1-4aa7-83d2-43ee144274ba_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 028/20 17K - 02/21 29K - 05/21 36K - 12/22 77K- 08/23 82K 08/24 86K 08/25 91K', 'remarks': 'VOSA STATES 77K- 83K- 87K - 92K SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/86461ec9-65eb-4cc8-9d9a-43dc6990f4fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117311708, 'registration': 'LP69DMZ', 'account': 'MAN037', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI EVO Match Edition 5dr', 'mileage': 93096, 'mileageWarranty': False, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1020, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-01-20', 'fuel': 'Petrol', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/a6843e07-c65b-4401-98c2-5f2271061044_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/0ec9d7ca-606f-4e93-b123-a89237bf5897_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/5939a1fc-290f-44a5-a2a1-ecae5e89b94e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/726b4923-419f-4f38-9155-f995c2259f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/d60cbfed-797e-4fcc-acee-e00ecdc60d60_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b9ca54e6-9f0f-4b3f-8847-213bf32e232c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b765dc8b-f8af-4847-ab12-9d441b98434e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/91dd433f-f5d1-4aa7-83d2-43ee144274ba_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 028/20 17K - 02/21 29K - 05/21 36K - 12/22 77K- 08/23 82K 08/24 86K 08/25 91K', 'remarks': 'VOSA STATES 77K- 83K- 87K - 92K SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/86461ec9-65eb-4cc8-9d9a-43dc6990f4fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708
2025-12-02 19:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 350707ad-cc6c-53bb-87b0-159f6e20ee05 with scrape type 2
2025-12-02 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 350707ad-cc6c-53bb-87b0-159f6e20ee05 with scrape type 2
2025-12-02 19:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 350707ad-cc6c-53bb-87b0-159f6e20ee05, identifier: 117311708
2025-12-02 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/ccb6a71e-365d-41f4-8dbf-7dbe615805d9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue)
2025-12-02 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN70XMC/2025-12-02/image/8ce4e6e7-becf-499d-8c4c-9780e7797d57_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626705?view=catalogue)
2025-12-02 19:03:03 [astonbarclay.gb] INFO: Found listing with ID: 117584298
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584298%27 HTTP/1.1" 200 None
2025-12-02 19:03:03 [astonbarclay.gb] INFO: Scrape type for 117584298: 2
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252Fdfc2e2a2-9bac-43fa-bab8-5fa7321f8b30_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/dfc2e2a2-9bac-43fa-bab8-5fa7321f8b30_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252Fd635a90a-a74a-4992-bdac-507087e1554e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/d635a90a-a74a-4992-bdac-507087e1554e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708
2025-12-02 19:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708
2025-12-02 19:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708 to the API
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27350707ad-cc6c-53bb-87b0-159f6e20ee05%27 HTTP/1.1" 200 None
2025-12-02 19:03:04 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 350707ad-cc6c-53bb-87b0-159f6e20ee05: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117311708?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '350707ad-cc6c-53bb-87b0-159f6e20ee05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP69DMZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117311708',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 93096,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-20',
 'seller_name': 'Manamanx Ltd',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI EVO Match Edition 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI EVO Match Edition 5dr',
 'vin': None,
 'year': 2020}
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311708%27 HTTP/1.1" 200 None
2025-12-02 19:03:04 [astonbarclay.gb] INFO: Saving data for 117311708: {'auction_closing_time': 1764756000.0, 'created_time': 1763492766.250229, 'last_price_update_time': 1764702184.039461}
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117311708') HTTP/1.1" 204 0
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0763650>
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252Fbf4b9b9d-e080-4d1e-af32-184011b14adb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/bf4b9b9d-e080-4d1e-af32-184011b14adb_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52669e31-67d3-5cd8-9ca1-4e345de83c70
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0690a90>
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F2d1458ab-6f10-401b-9cd5-657de800e6e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/2d1458ab-6f10-401b-9cd5-657de800e6e6_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/76fd3979-46e0-4b5a-9185-f38f4fdd5dc8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue)
2025-12-02 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7eb09dd1-42a9-4d47-9ad4-9a30391523b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626705?view=catalogue)
2025-12-02 19:03:04 [astonbarclay.gb] INFO: Found listing with ID: 117554820
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554820%27 HTTP/1.1" 200 None
2025-12-02 19:03:04 [astonbarclay.gb] INFO: Scrape type for 117554820: 0
2025-12-02 19:03:04 [astonbarclay.gb] INFO: Found listing with ID: 117554753
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554753%27 HTTP/1.1" 200 None
2025-12-02 19:03:04 [astonbarclay.gb] INFO: Scrape type for 117554753: 0
2025-12-02 19:03:04 [astonbarclay.gb] INFO: Found listing with ID: 117554783
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554783%27 HTTP/1.1" 200 None
2025-12-02 19:03:04 [astonbarclay.gb] INFO: Scrape type for 117554783: 0
2025-12-02 19:03:04 [astonbarclay.gb] INFO: Found listing with ID: 117554620
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554620%27 HTTP/1.1" 200 None
2025-12-02 19:03:04 [astonbarclay.gb] INFO: Scrape type for 117554620: 0
2025-12-02 19:03:04 [astonbarclay.gb] INFO: Found listing with ID: 117407507
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407507%27 HTTP/1.1" 200 None
2025-12-02 19:03:04 [astonbarclay.gb] INFO: Scrape type for 117407507: 2
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252Fb0e983b6-825a-4c33-b703-92505496bff1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/b0e983b6-825a-4c33-b703-92505496bff1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F142e7745-dc98-4e22-9b91-ece5e00b8850_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/142e7745-dc98-4e22-9b91-ece5e00b8850_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0768bd0>
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLM18VOU%252F2025-12-02%252Fimage%252F330395e3-4c8b-475b-9273-a16080df0a3a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LM18VOU/2025-12-02/image/330395e3-4c8b-475b-9273-a16080df0a3a_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52669e31-67d3-5cd8-9ca1-4e345de83c70
2025-12-02 19:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52669e31-67d3-5cd8-9ca1-4e345de83c70, skipping ID generation
2025-12-02 19:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52669e31-67d3-5cd8-9ca1-4e345de83c70 with scrape type 1
2025-12-02 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 52669e31-67d3-5cd8-9ca1-4e345de83c70 from tracking dictionaries
2025-12-02 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52669e31-67d3-5cd8-9ca1-4e345de83c70 sending to next pipeline
2025-12-02 19:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 52669e31-67d3-5cd8-9ca1-4e345de83c70, identifier: 117662383
2025-12-02 19:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 52669e31-67d3-5cd8-9ca1-4e345de83c70 with identifier: 117662383
2025-12-02 19:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 52669e31-67d3-5cd8-9ca1-4e345de83c70 with identifier: 117662383
2025-12-02 19:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'traveller diesel estate' containing 'traveller'
2025-12-02 19:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 52669e31-67d3-5cd8-9ca1-4e345de83c70 spider: astonbarclay.gb
2025-12-02 19:03:05 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 52669e31-67d3-5cd8-9ca1-4e345de83c70 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'traveller diesel estate' containing 'traveller'
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BROWN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '52669e31-67d3-5cd8-9ca1-4e345de83c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LM18VOU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662383',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'PEUGEOT',
 'model': 'TRAVELLER DIESEL ESTATE',
 'odometer': 76190,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23276,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/330395e3-4c8b-475b-9273-a16080df0a3a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22710,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/bf4b9b9d-e080-4d1e-af32-184011b14adb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24722,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/cf92d786-4b9d-488c-95ce-3b4525bb52ad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23005,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/3badfd6c-4ee2-47c3-8491-0ebd0a495466_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44357,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/c7e0059b-095e-42ff-98be-2932a418f62d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86538,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/a8e12838-1fd1-4e37-a66c-3393b69b6c16_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79158,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/8c42d6d1-95f6-4c67-b313-62db0833b36b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41119,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/ab181ea5-aa04-49b5-9fb1-c0525ba02149_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52669e31-67d3-5cd8-9ca1-4e345de83c70/52669e31-67d3-5cd8-9ca1-4e345de83c70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39069,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/090a5132-1f03-443e-96d4-96f401d70feb_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-25',
 'seller_name': 'TCB Group - Prime',
 'title': 'PEUGEOT TRAVELLER DIESEL ESTATE 2.0 BlueHDi 150 Allure Standard 5dr',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi 150 Allure Standard 5dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662383%27 HTTP/1.1" 200 None
2025-12-02 19:03:05 [astonbarclay.gb] INFO: Saving data for 117662383: {'created_time': 1764702185.183613, 'last_price_update_time': 1764702185.183623, 'auction_closing_time': 1764755100.0}
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662383') HTTP/1.1" 204 0
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac3850>
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252Fccb6a71e-365d-41f4-8dbf-7dbe615805d9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/ccb6a71e-365d-41f4-8dbf-7dbe615805d9_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06e4e50>
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F8ce4e6e7-becf-499d-8c4c-9780e7797d57_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/8ce4e6e7-becf-499d-8c4c-9780e7797d57_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c
2025-12-02 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c1aa0908-74af-41b5-9f61-a0fc4d6ffc84_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626705?view=catalogue)
2025-12-02 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/60db119d-2458-45d3-b46a-a5b2f38cf516_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue)
2025-12-02 19:03:05 [astonbarclay.gb] INFO: Found listing with ID: 117584452
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584452%27 HTTP/1.1" 200 None
2025-12-02 19:03:05 [astonbarclay.gb] INFO: Scrape type for 117584452: 2
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F267724db-2085-45c9-9827-f73807fc4c38_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/267724db-2085-45c9-9827-f73807fc4c38_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252Fc87d8e4a-c20e-4e83-93cb-4ec94df8362e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c87d8e4a-c20e-4e83-93cb-4ec94df8362e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06be010>
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F76fd3979-46e0-4b5a-9185-f38f4fdd5dc8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/76fd3979-46e0-4b5a-9185-f38f4fdd5dc8_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1fdd510>
2025-12-02 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F7eb09dd1-42a9-4d47-9ad4-9a30391523b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7eb09dd1-42a9-4d47-9ad4-9a30391523b0_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c
2025-12-02 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN70XMC/2025-12-02/image/d635a90a-a74a-4992-bdac-507087e1554e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626705?view=catalogue)
2025-12-02 19:03:06 [scrapy.extensions.logstats] INFO: Crawled 129 pages (at 39 pages/min), scraped 86 items (at 47 items/min)
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117554554
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554554%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117554554: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117584474
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584474%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117584474: 2
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F0ea6c0d9-8cf1-4a16-aa36-bb4f2bbbf300_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/0ea6c0d9-8cf1-4a16-aa36-bb4f2bbbf300_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F98887429-4eb6-4764-9c7b-8efb542f9cc1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/98887429-4eb6-4764-9c7b-8efb542f9cc1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570740?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584319?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/dfc2e2a2-9bac-43fa-bab8-5fa7321f8b30_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue)
2025-12-02 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507396?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN70XMC/2025-12-02/image/142e7745-dc98-4e22-9b91-ece5e00b8850_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626705?view=catalogue)
2025-12-02 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/b0e983b6-825a-4c33-b703-92505496bff1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue)
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117554834
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554834%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117554834: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117554643
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554643%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117554643: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117554606
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554606%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117554606: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117554856
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554856%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117554856: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117100098
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100098%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117100098: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117554665
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554665%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117554665: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117554583
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554583%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117554583: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117554799
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554799%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117554799: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117554544
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554544%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117554544: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117554715
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554715%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117554715: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117459261
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459261%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117459261: 0
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117364905
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364905%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117364905: 2
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F22a1e99b-d520-407f-8f96-21a1646aadb4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/22a1e99b-d520-407f-8f96-21a1646aadb4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584272?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c6e9d0>
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252Fc1aa0908-74af-41b5-9f61-a0fc4d6ffc84_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c1aa0908-74af-41b5-9f61-a0fc4d6ffc84_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06bed10>
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F60db119d-2458-45d3-b46a-a5b2f38cf516_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/60db119d-2458-45d3-b46a-a5b2f38cf516_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Found listing with ID: 117506955
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506955%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [astonbarclay.gb] INFO: Scrape type for 117506955: 2
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F7b9c579b-7c3e-45da-978a-b46db5be5f39_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7b9c579b-7c3e-45da-978a-b46db5be5f39_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c87d8e4a-c20e-4e83-93cb-4ec94df8362e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626705?view=catalogue)
2025-12-02 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116994676?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117421533?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584337?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584328?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0669710>
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252Fd635a90a-a74a-4992-bdac-507087e1554e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/d635a90a-a74a-4992-bdac-507087e1554e_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c
2025-12-02 19:03:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570740, 'registration': 'DY65CRJ', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'ASTRA DIESEL SPORTS TOURER', 'derivative': '1.6 CDTi 16V ecoFLEX Design 5dr', 'mileage': 68756, 'mileageWarranty': False, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1008, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-02-29', 'fuel': 'Diesel', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/49386a77-4a99-4c29-8421-4ef9bf9ec9f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/002960af-458d-43ff-be43-0ad326595abe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/e4d56d88-bcd7-4698-9912-698ecceeb53e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/2655c2c8-552f-4e73-9165-5c8f8027f270_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/29e78e0c-b1b3-4015-b111-4e50919cbf17_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/b9f32420-146b-4462-9924-eab672d21c5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/600914f7-e24b-447e-ad98-c6961bae2a3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/036a17a5-32c2-44d6-9b8f-1464c85954c2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 02/17 6K- 03/18 12K- 02/19 17K- 01/20 22K- 01/21 25K- 01/22 38K- 07/23 46K-  02/24 54K -02/25 61K', 'remarks': 'VOSA STATES 38K- 46K- 54K- 61K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cb34262d-48f9-46a5-addd-fbab36e32274.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570740, 'registration': 'DY65CRJ', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'ASTRA DIESEL SPORTS TOURER', 'derivative': '1.6 CDTi 16V ecoFLEX Design 5dr', 'mileage': 68756, 'mileageWarranty': False, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1008, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-02-29', 'fuel': 'Diesel', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/49386a77-4a99-4c29-8421-4ef9bf9ec9f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/002960af-458d-43ff-be43-0ad326595abe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/e4d56d88-bcd7-4698-9912-698ecceeb53e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/2655c2c8-552f-4e73-9165-5c8f8027f270_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/29e78e0c-b1b3-4015-b111-4e50919cbf17_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/b9f32420-146b-4462-9924-eab672d21c5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/600914f7-e24b-447e-ad98-c6961bae2a3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/036a17a5-32c2-44d6-9b8f-1464c85954c2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 02/17 6K- 03/18 12K- 02/19 17K- 01/20 22K- 01/21 25K- 01/22 38K- 07/23 46K-  02/24 54K -02/25 61K', 'remarks': 'VOSA STATES 38K- 46K- 54K- 61K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cb34262d-48f9-46a5-addd-fbab36e32274.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with identifier: 117570740
2025-12-02 19:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with scrape type 2
2025-12-02 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with scrape type 2
2025-12-02 19:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 35d30efe-ced7-5e4e-bf41-39ad7e9299d5, identifier: 117570740
2025-12-02 19:03:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584319, 'registration': 'SG68YVD', 'account': 'ARN235', 'make': 'INFINITI', 'model': 'Q30 HATCHBACK', 'derivative': '1.6T Luxe 5dr DCT [City Black]', 'mileage': 62274, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 19, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-29', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SG68YVD/2025-12-01/image/6ade37a8-ab72-477c-b463-46183a2dbb17_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/d866be11-838a-4705-95a1-48796461f2ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/5493c00a-df6a-43d7-8645-5ac554652032_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/d81ba247-4f8e-4995-a925-5b1616aea627_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/062dcc53-9069-4932-b990-5a407c1fa620_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/fbda8d10-f634-40b7-b10c-f6326417cb53_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/0c1775a7-f33f-42f7-9bb8-a255f638f8db_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/6d2ba988-e98f-4b98-9b28-fc3970880d1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/311c6824-4a43-4bf0-9757-c28d177170f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/0d9ce990-630a-46f2-b7e7-b02ed3919adf_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/05a996c4-7112-462d-91c8-87db9aac955c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/4d803e10-7d7b-47aa-be66-b1dae8d9e1c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/22957fed-be8b-44eb-bf09-2000b106977b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/c5d4df07-cb75-4e1e-895b-84528b167c6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/2b5ad533-57c6-44fc-bdd3-910f08590514_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/9f700c4d-6242-4abb-9607-789a61b7b386_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/45f9266f-34e5-4d8c-abd1-ea9faed3a268_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/98ada603-cdfe-442b-afe7-17e7711457a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/8e9569fa-b188-4b5d-8a8d-ff7e4ed18043_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/1a000ac3-c572-4dd0-a0c3-23dd203b31ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/061d5392-73b2-4fbd-93e9-15485f50ea5f_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa@ 16k, 23k, 32k, 40k, 50k, 61k, spare key in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6c209e81-7276-498d-b43e-f5bb6807c915.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584319, 'registration': 'SG68YVD', 'account': 'ARN235', 'make': 'INFINITI', 'model': 'Q30 HATCHBACK', 'derivative': '1.6T Luxe 5dr DCT [City Black]', 'mileage': 62274, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 19, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-29', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SG68YVD/2025-12-01/image/6ade37a8-ab72-477c-b463-46183a2dbb17_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/d866be11-838a-4705-95a1-48796461f2ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/5493c00a-df6a-43d7-8645-5ac554652032_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/d81ba247-4f8e-4995-a925-5b1616aea627_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/062dcc53-9069-4932-b990-5a407c1fa620_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/fbda8d10-f634-40b7-b10c-f6326417cb53_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/0c1775a7-f33f-42f7-9bb8-a255f638f8db_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/6d2ba988-e98f-4b98-9b28-fc3970880d1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/311c6824-4a43-4bf0-9757-c28d177170f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/0d9ce990-630a-46f2-b7e7-b02ed3919adf_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/05a996c4-7112-462d-91c8-87db9aac955c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/4d803e10-7d7b-47aa-be66-b1dae8d9e1c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/22957fed-be8b-44eb-bf09-2000b106977b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/c5d4df07-cb75-4e1e-895b-84528b167c6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/2b5ad533-57c6-44fc-bdd3-910f08590514_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/9f700c4d-6242-4abb-9607-789a61b7b386_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/45f9266f-34e5-4d8c-abd1-ea9faed3a268_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/98ada603-cdfe-442b-afe7-17e7711457a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/8e9569fa-b188-4b5d-8a8d-ff7e4ed18043_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/1a000ac3-c572-4dd0-a0c3-23dd203b31ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG68YVD/2025-12-01/image/061d5392-73b2-4fbd-93e9-15485f50ea5f_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa@ 16k, 23k, 32k, 40k, 50k, 61k, spare key in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6c209e81-7276-498d-b43e-f5bb6807c915.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b609225f-b83e-578c-9e85-cc0de1280aa7 with identifier: 117584319
2025-12-02 19:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b609225f-b83e-578c-9e85-cc0de1280aa7 with scrape type 2
2025-12-02 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b609225f-b83e-578c-9e85-cc0de1280aa7 with scrape type 2
2025-12-02 19:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b609225f-b83e-578c-9e85-cc0de1280aa7, identifier: 117584319
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0680790>
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252Fdfc2e2a2-9bac-43fa-bab8-5fa7321f8b30_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/dfc2e2a2-9bac-43fa-bab8-5fa7321f8b30_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:03:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117507396, 'registration': 'HJ67ULF', 'account': 'MOT075', 'make': 'VAUXHALL', 'model': 'ZAFIRA TOURER', 'derivative': '1.4T SRi 5dr Auto', 'mileage': 106979, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1002, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-11-17', 'fuel': 'Petrol', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/985b009d-3eab-415c-8cee-38f63b3e9ec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/b190c352-49e3-45ce-875b-04931732c880_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/929fa69c-3ab3-43c2-ba9d-56c9f4f1897d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/e1898b2f-002a-4730-9d59-92d8858ebf0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/11b21744-4a4b-43d4-9deb-729a0e4cf62f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/097360be-4259-4aa5-8eaa-cd8881bd0adf_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/726735e1-90da-41b0-931f-61e05c1ae630_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/eb34b7cd-afad-4930-b1a7-ac9b14cc8723_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/fc02f49e-c317-46a1-b134-ccbfb9a05d57_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/24 ?? - 02/25 ??', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 36K, 57K, 79K, 105K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 160, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b14a8a64-9e40-4aa6-a780-c119e6910721.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117507396, 'registration': 'HJ67ULF', 'account': 'MOT075', 'make': 'VAUXHALL', 'model': 'ZAFIRA TOURER', 'derivative': '1.4T SRi 5dr Auto', 'mileage': 106979, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1002, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-11-17', 'fuel': 'Petrol', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/985b009d-3eab-415c-8cee-38f63b3e9ec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/b190c352-49e3-45ce-875b-04931732c880_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/929fa69c-3ab3-43c2-ba9d-56c9f4f1897d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/e1898b2f-002a-4730-9d59-92d8858ebf0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/11b21744-4a4b-43d4-9deb-729a0e4cf62f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/097360be-4259-4aa5-8eaa-cd8881bd0adf_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/726735e1-90da-41b0-931f-61e05c1ae630_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/eb34b7cd-afad-4930-b1a7-ac9b14cc8723_removebg.jpg?w=600', 'https://abimg003.imgix.net/HJ67ULF/2025-11-27/image/fc02f49e-c317-46a1-b134-ccbfb9a05d57_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/24 ?? - 02/25 ??', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 36K, 57K, 79K, 105K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 160, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b14a8a64-9e40-4aa6-a780-c119e6910721.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec9cd98c-bfd3-5d3b-8678-bd9c02bd459d with identifier: 117507396
2025-12-02 19:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9cd98c-bfd3-5d3b-8678-bd9c02bd459d with scrape type 2
2025-12-02 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec9cd98c-bfd3-5d3b-8678-bd9c02bd459d with scrape type 2
2025-12-02 19:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec9cd98c-bfd3-5d3b-8678-bd9c02bd459d, identifier: 117507396
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03393d0>
2025-12-02 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F142e7745-dc98-4e22-9b91-ece5e00b8850_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/142e7745-dc98-4e22-9b91-ece5e00b8850_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c
2025-12-02 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a7b9d0>
2025-12-02 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252Fb0e983b6-825a-4c33-b703-92505496bff1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/b0e983b6-825a-4c33-b703-92505496bff1_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:03:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584272, 'registration': 'BN17VYS', 'account': 'ARN101', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 110 Flair 5dr', 'mileage': 92336, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 6, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-17', 'fuel': 'Petrol', 'motExpiry': '2026-04-10', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BN17VYS/2025-12-01/image/3027323d-99f4-42ee-9e7e-04599fe4c447_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/6d1c2df3-b14f-45f1-b809-558f3a7860b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/94152fa8-f93e-4c7e-8499-30622e3a17ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/59dc981a-c8ca-4f04-84f3-ff9df31681bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/9c950163-91a0-47bc-b865-e561d831d8c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/8a21cc39-d99d-4482-885c-2eca2ba7d98a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/9f978086-731e-4b4b-a644-ce834a9475dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/d5901ddd-f2e2-45e6-baee-a4f99f46eda4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/2654bec0-dbe0-44b4-bf62-8bf412840b2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/406b6198-bb23-4039-99c4-4306248c9414_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/6b2bcfb3-abc3-4b64-b9b5-bb9ba714f7d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/c8dbddcd-6b96-4c84-a3f5-ae975f96fa7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/ba4aeea3-80dd-43a6-9c79-869bb6ccaac7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/eb42b048-5e59-4a82-a681-86b5c4eecebb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/c9b50361-b81c-4e15-b624-e54fdab97504_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/6b755f6a-6a39-4bfd-911a-90e62612e821_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/c1518bc4-1e94-40ca-ba73-e61a47043264_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/ad5b3ae1-e778-4e2c-abd4-e5fe9e0ce163_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/7bdaef04-c9c0-4849-a8d0-5450efbd62d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/00942c0a-1e9c-49e6-982e-5addaca48dca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/9fbd42d6-b29e-494e-b175-372b73ddff80_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/e9bbb90d-1aa4-406a-96b1-e3870553f53e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/1b0898e6-2368-442e-9c1f-ae80025828de_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/cdb72f13-fc42-4e83-be11-9be755baa727_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/6a02f1f5-f456-40ed-9530-ca4fc0a14c42_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/4dfdf583-acd3-4041-ac08-cfd9dae15e29_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/1ff37efc-e042-437c-b77a-ed5d74f21233_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/0884330c-a489-4c56-93a2-5e2be5c4d651_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/18-6K 03/19-13K 07/20-? 09/22-59K 11/22-63K 12/23-81K 06/24-87K', 'remarks': 'vosa@ 21k, 26k, 47k, 69k, 85k, 90k, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b6e733c-eedc-4d8c-9f31-f6c63b22a1f8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584272, 'registration': 'BN17VYS', 'account': 'ARN101', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 110 Flair 5dr', 'mileage': 92336, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 6, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-17', 'fuel': 'Petrol', 'motExpiry': '2026-04-10', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BN17VYS/2025-12-01/image/3027323d-99f4-42ee-9e7e-04599fe4c447_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/6d1c2df3-b14f-45f1-b809-558f3a7860b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/94152fa8-f93e-4c7e-8499-30622e3a17ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/59dc981a-c8ca-4f04-84f3-ff9df31681bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/9c950163-91a0-47bc-b865-e561d831d8c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/8a21cc39-d99d-4482-885c-2eca2ba7d98a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/9f978086-731e-4b4b-a644-ce834a9475dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/d5901ddd-f2e2-45e6-baee-a4f99f46eda4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/2654bec0-dbe0-44b4-bf62-8bf412840b2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/406b6198-bb23-4039-99c4-4306248c9414_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/6b2bcfb3-abc3-4b64-b9b5-bb9ba714f7d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/c8dbddcd-6b96-4c84-a3f5-ae975f96fa7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/ba4aeea3-80dd-43a6-9c79-869bb6ccaac7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/eb42b048-5e59-4a82-a681-86b5c4eecebb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/c9b50361-b81c-4e15-b624-e54fdab97504_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/6b755f6a-6a39-4bfd-911a-90e62612e821_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/c1518bc4-1e94-40ca-ba73-e61a47043264_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/ad5b3ae1-e778-4e2c-abd4-e5fe9e0ce163_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/7bdaef04-c9c0-4849-a8d0-5450efbd62d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/00942c0a-1e9c-49e6-982e-5addaca48dca_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/9fbd42d6-b29e-494e-b175-372b73ddff80_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/e9bbb90d-1aa4-406a-96b1-e3870553f53e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/1b0898e6-2368-442e-9c1f-ae80025828de_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/cdb72f13-fc42-4e83-be11-9be755baa727_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/6a02f1f5-f456-40ed-9530-ca4fc0a14c42_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/4dfdf583-acd3-4041-ac08-cfd9dae15e29_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/1ff37efc-e042-437c-b77a-ed5d74f21233_removebg.jpg?w=600', 'https://abimg003.imgix.net/BN17VYS/2025-12-01/image/0884330c-a489-4c56-93a2-5e2be5c4d651_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/18-6K 03/19-13K 07/20-? 09/22-59K 11/22-63K 12/23-81K 06/24-87K', 'remarks': 'vosa@ 21k, 26k, 47k, 69k, 85k, 90k, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b6e733c-eedc-4d8c-9f31-f6c63b22a1f8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8b928f5-f0ee-53f3-ba72-0f75c5b4682f with identifier: 117584272
2025-12-02 19:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8b928f5-f0ee-53f3-ba72-0f75c5b4682f with scrape type 2
2025-12-02 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8b928f5-f0ee-53f3-ba72-0f75c5b4682f with scrape type 2
2025-12-02 19:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b8b928f5-f0ee-53f3-ba72-0f75c5b4682f, identifier: 117584272
2025-12-02 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN70XMC/2025-12-02/image/98887429-4eb6-4764-9c7b-8efb542f9cc1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626705?view=catalogue)
2025-12-02 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/267724db-2085-45c9-9827-f73807fc4c38_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue)
2025-12-02 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/0ea6c0d9-8cf1-4a16-aa36-bb4f2bbbf300_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616251?view=catalogue)
2025-12-02 19:03:08 [astonbarclay.gb] INFO: Found listing with ID: 117514814
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514814%27 HTTP/1.1" 200 None
2025-12-02 19:03:08 [astonbarclay.gb] INFO: Scrape type for 117514814: 2
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F0acade92-cb45-4857-b00a-ea0f94b88208_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/0acade92-cb45-4857-b00a-ea0f94b88208_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with identifier: 117570740
2025-12-02 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with identifier: 117570740
2025-12-02 19:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with identifier: 117570740 to the API
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117570740?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '35d30efe-ced7-5e4e-bf41-39ad7e9299d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DY65CRJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570740',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'ASTRA DIESEL SPORTS TOURER',
 'odometer': 68756,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': 'Manamanx Ltd',
 'title': 'VAUXHALL ASTRA DIESEL SPORTS TOURER 1.6 CDTi 16V ecoFLEX Design 5dr',
 'transmission': 'manual',
 'trim': '1.6 CDTi 16V ecoFLEX Design 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570740%27 HTTP/1.1" 200 None
2025-12-02 19:03:08 [astonbarclay.gb] INFO: Saving data for 117570740: {'auction_closing_time': 1764756000.0, 'created_time': 1764270128.609167, 'last_price_update_time': 1764702188.744272}
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570740') HTTP/1.1" 204 0
2025-12-02 19:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b609225f-b83e-578c-9e85-cc0de1280aa7 with identifier: 117584319
2025-12-02 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b609225f-b83e-578c-9e85-cc0de1280aa7 with identifier: 117584319
2025-12-02 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'arnold clark', 'price_includes_vat': False, 'title': 'infiniti q30 hatchback 1.6t luxe 5dr dct [city black]', 'price': 0, 'currency': 'gbp', 'make': 'infiniti', 'model': 'q30 hatchback', 'transmission': 'automatic', 'engine': '1.6l', 'fuel_type': 'petrol', 'odometer': 62274, 'odometer_reading_unit': 'mi', 'registration_date': '2018-11-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584319', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '1.6t luxe 5dr dct [city black]', 'license_plate': 'sg68yvd', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 148, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b609225f-b83e-578c-9e85-cc0de1280aa7', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'infiniti q30 hatchback', 'sanitized_make': 'infiniti', 'odometer_in_km': 100220}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 84,
     'auction_title': '',
     'c_o_2_emission_value': 148,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'petrol',
     'id': 'b609225f-b83e-578c-9e85-cc0de1280aa7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'sg68yvd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584319',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'infiniti',
     'make_model': 'infiniti q30 hatchback',
     'model': 'q30 hatchback',
     'odometer': 62274,
     'odometer_in_km': 100220,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-11-30',
     'sanitized_make': 'infiniti',
     'seller_name': 'arnold clark',
     'title': 'infiniti q30 hatchback 1.6t luxe 5dr dct [city black]',
     'transmission': 'automatic',
     'trim': '1.6t luxe 5dr dct [city black]',
     'vin': None,
     'year': 2018}
2025-12-02 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: b609225f-b83e-578c-9e85-cc0de1280aa7 spider: astonbarclay.gb
2025-12-02 19:03:09 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b609225f-b83e-578c-9e85-cc0de1280aa7 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'arnold clark', 'price_includes_vat': False, 'title': 'infiniti q30 hatchback 1.6t luxe 5dr dct [city black]', 'price': 0, 'currency': 'gbp', 'make': 'infiniti', 'model': 'q30 hatchback', 'transmission': 'automatic', 'engine': '1.6l', 'fuel_type': 'petrol', 'odometer': 62274, 'odometer_reading_unit': 'mi', 'registration_date': '2018-11-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584319', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '1.6t luxe 5dr dct [city black]', 'license_plate': 'sg68yvd', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 148, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b609225f-b83e-578c-9e85-cc0de1280aa7', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'infiniti q30 hatchback', 'sanitized_make': 'infiniti', 'odometer_in_km': 100220}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 84,
     'auction_title': '',
     'c_o_2_emission_value': 148,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'petrol',
     'id': 'b609225f-b83e-578c-9e85-cc0de1280aa7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'sg68yvd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584319',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'infiniti',
     'make_model': 'infiniti q30 hatchback',
     'model': 'q30 hatchback',
     'odometer': 62274,
     'odometer_in_km': 100220,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-11-30',
     'sanitized_make': 'infiniti',
     'seller_name': 'arnold clark',
     'title': 'infiniti q30 hatchback 1.6t luxe 5dr dct [city black]',
     'transmission': 'automatic',
     'trim': '1.6t luxe 5dr dct [city black]',
     'vin': None,
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b609225f-b83e-578c-9e85-cc0de1280aa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SG68YVD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584319',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'INFINITI',
 'model': 'Q30 HATCHBACK',
 'odometer': 62274,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-30',
 'seller_name': 'Arnold Clark',
 'title': 'INFINITI Q30 HATCHBACK 1.6T Luxe 5dr DCT [City Black]',
 'transmission': 'automatic',
 'trim': '1.6T Luxe 5dr DCT [City Black]',
 'vin': None,
 'year': 2018}
2025-12-02 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584319%27 HTTP/1.1" 200 None
2025-12-02 19:03:09 [astonbarclay.gb] INFO: Saving data for 117584319: {'auction_closing_time': 1764842400.0, 'created_time': 1764356591.780444, 'last_price_update_time': 1764702189.050283}
2025-12-02 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584319') HTTP/1.1" 204 0
2025-12-02 19:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec9cd98c-bfd3-5d3b-8678-bd9c02bd459d with identifier: 117507396
2025-12-02 19:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec9cd98c-bfd3-5d3b-8678-bd9c02bd459d with identifier: 117507396
2025-12-02 19:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172165 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172165
2025-12-02 19:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ec9cd98c-bfd3-5d3b-8678-bd9c02bd459d spider: astonbarclay.gb
2025-12-02 19:03:09 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ec9cd98c-bfd3-5d3b-8678-bd9c02bd459d due to rule: high_mileage_for_country.json, error: 172165 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172165
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ec9cd98c-bfd3-5d3b-8678-bd9c02bd459d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HJ67ULF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507396',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'ZAFIRA TOURER',
 'odometer': 106979,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-17',
 'seller_name': 'MotoNovo Finance',
 'title': 'VAUXHALL ZAFIRA TOURER 1.4T SRi 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.4T SRi 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-02 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507396%27 HTTP/1.1" 200 None
2025-12-02 19:03:09 [astonbarclay.gb] INFO: Saving data for 117507396: {'auction_closing_time': 1764756000.0, 'created_time': 1764234063.28068, 'last_price_update_time': 1764702189.274389}
2025-12-02 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507396') HTTP/1.1" 204 0
2025-12-02 19:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b8b928f5-f0ee-53f3-ba72-0f75c5b4682f with identifier: 117584272
2025-12-02 19:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b8b928f5-f0ee-53f3-ba72-0f75c5b4682f with identifier: 117584272
2025-12-02 19:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b8b928f5-f0ee-53f3-ba72-0f75c5b4682f with identifier: 117584272 to the API
2025-12-02 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b8b928f5-f0ee-53f3-ba72-0f75c5b4682f%27 HTTP/1.1" 200 None
2025-12-02 19:03:10 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b8b928f5-f0ee-53f3-ba72-0f75c5b4682f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:09 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584272?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b8b928f5-f0ee-53f3-ba72-0f75c5b4682f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BN17VYS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584272',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'CITROEN',
 'model': 'C3 HATCHBACK',
 'odometer': 92336,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-17',
 'seller_name': 'Arnold Clark',
 'title': 'CITROEN C3 HATCHBACK 1.2 PureTech 110 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 110 Flair 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584272%27 HTTP/1.1" 200 None
2025-12-02 19:03:10 [astonbarclay.gb] INFO: Saving data for 117584272: {'auction_closing_time': 1764842400.0, 'created_time': 1764356596.643118, 'last_price_update_time': 1764702190.159573}
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584272') HTTP/1.1" 204 0
2025-12-02 19:03:10 [astonbarclay.gb] INFO: Found listing with ID: 117590985
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590985%27 HTTP/1.1" 200 None
2025-12-02 19:03:10 [astonbarclay.gb] INFO: Scrape type for 117590985: 1
2025-12-02 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf046be90>
2025-12-02 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252Fc87d8e4a-c20e-4e83-93cb-4ec94df8362e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c87d8e4a-c20e-4e83-93cb-4ec94df8362e_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c
2025-12-02 19:03:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116994676, 'registration': 'LA70WBL', 'account': 'RIC072', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Elite 5dr Auto', 'mileage': 34873, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2533, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-02-16', 'fuel': 'Petrol', 'motExpiry': '2026-05-21', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e0d6548-607b-482e-adb1-f475e672cd06_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2831fe1e-078f-47b7-8cf7-210553a349b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e2fa0f8-791a-4aa6-a600-dfa9827c0425_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/bbbbf86a-955f-4e96-8afa-77d7478de6ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/fe6ce191-71a7-4ef0-bef4-2920d01fa878_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/d79e0f74-8d8f-4809-a114-bee2346e222f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/905e19e4-65ac-4458-b125-ff9910f36a12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/3d10a9d3-dd71-4675-9034-acbd1976d202_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/c90b1af9-ccf5-4cf5-94ca-b60d446913f8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 5/24 23K', 'remarks': 'VOSA STATES 22K, 23K, 32K', 'virtual': False, 'seller': 'Richard Nash Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4136264-5507-4695-8198-54c833c850cc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116994676, 'registration': 'LA70WBL', 'account': 'RIC072', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Elite 5dr Auto', 'mileage': 34873, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 2533, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-02-16', 'fuel': 'Petrol', 'motExpiry': '2026-05-21', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e0d6548-607b-482e-adb1-f475e672cd06_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2831fe1e-078f-47b7-8cf7-210553a349b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e2fa0f8-791a-4aa6-a600-dfa9827c0425_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/bbbbf86a-955f-4e96-8afa-77d7478de6ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/fe6ce191-71a7-4ef0-bef4-2920d01fa878_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/d79e0f74-8d8f-4809-a114-bee2346e222f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/905e19e4-65ac-4458-b125-ff9910f36a12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/3d10a9d3-dd71-4675-9034-acbd1976d202_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/c90b1af9-ccf5-4cf5-94ca-b60d446913f8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 5/24 23K', 'remarks': 'VOSA STATES 22K, 23K, 32K', 'virtual': False, 'seller': 'Richard Nash Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4136264-5507-4695-8198-54c833c850cc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676
2025-12-02 19:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6004262-a547-515d-91d0-1af151fe54f7 with scrape type 2
2025-12-02 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6004262-a547-515d-91d0-1af151fe54f7 with scrape type 2
2025-12-02 19:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a6004262-a547-515d-91d0-1af151fe54f7, identifier: 116994676
2025-12-02 19:03:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117421533, 'registration': 'SJ16VYP', 'account': 'MAN037', 'make': 'TOYOTA', 'model': 'VERSO ESTATE', 'derivative': '1.6 V-matic Icon 5dr', 'mileage': 70345, 'mileageWarranty': False, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1019, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-04-13', 'fuel': 'Petrol', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1596, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/8d739e29-df5b-4556-b26b-584384ad8344_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/3bceab4f-9a09-4dd4-9d61-c296e0192166_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/d5dd2f0f-950c-4c2f-a679-cea20776587f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/670d8f56-0d80-4568-85a2-b07820f5f671_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/c97d6156-7195-42b3-ba50-2cbc5a3571e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/e45789ca-15b3-4b89-a0bb-412700d9bfcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/d3263473-04ea-481c-af37-b4bf03833f02_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 04/17 18K - 04/18 24K - 04/19 30K - 06/20 38K - 05/21 42K - 05/22 46K - 05/23 53K - 05/23 60K - 05/24 ??05/25 ??', 'remarks': 'VOSA STATES 42K- 48K - 53K - 60K - 67K -  SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9470baae-37af-440a-a48c-ee05af6560aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117421533, 'registration': 'SJ16VYP', 'account': 'MAN037', 'make': 'TOYOTA', 'model': 'VERSO ESTATE', 'derivative': '1.6 V-matic Icon 5dr', 'mileage': 70345, 'mileageWarranty': False, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-03T10:00Z', 'lot': 1019, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-04-13', 'fuel': 'Petrol', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1596, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/8d739e29-df5b-4556-b26b-584384ad8344_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/3bceab4f-9a09-4dd4-9d61-c296e0192166_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/d5dd2f0f-950c-4c2f-a679-cea20776587f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/670d8f56-0d80-4568-85a2-b07820f5f671_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/c97d6156-7195-42b3-ba50-2cbc5a3571e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/e45789ca-15b3-4b89-a0bb-412700d9bfcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/d3263473-04ea-481c-af37-b4bf03833f02_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 04/17 18K - 04/18 24K - 04/19 30K - 06/20 38K - 05/21 42K - 05/22 46K - 05/23 53K - 05/23 60K - 05/24 ??05/25 ??', 'remarks': 'VOSA STATES 42K- 48K - 53K - 60K - 67K -  SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9470baae-37af-440a-a48c-ee05af6560aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c19369b-b993-5a83-b20d-1521432bf963 with identifier: 117421533
2025-12-02 19:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c19369b-b993-5a83-b20d-1521432bf963 with scrape type 2
2025-12-02 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c19369b-b993-5a83-b20d-1521432bf963 with scrape type 2
2025-12-02 19:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6c19369b-b993-5a83-b20d-1521432bf963, identifier: 117421533
2025-12-02 19:03:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584337, 'registration': 'GD67ENC', 'account': 'ARN102', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '1.4 TFSI S Line 5dr', 'mileage': 48335, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 14, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-12-20', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GD67ENC/2025-12-01/image/4701d022-8cd6-4678-a319-7627cd5c546c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/d86f3600-94ec-4590-8893-900aad432689_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/891ea5c5-b3fd-41ed-b532-f5680714c6e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/09823a05-3fa2-4336-8655-8f3f69113d09_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/0ad9e556-3e62-49c4-8f42-f8374e26de04_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/f20cf7eb-98dc-4524-91aa-e8c6106acb53_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/83a24e2a-2c51-4fc6-b201-ac2462651385_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/e079de6a-d1b6-431a-ba8f-7acd3c0cf5d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/fb2699eb-6ec4-4f2f-896b-d20ab2bb1187_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/7aa1a4e7-2ff6-45b5-9d29-4f26eaa60b78_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/72d2d592-8ba3-48b2-b442-426cec5014c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/3745b66b-c334-488b-b624-6e0c53c571a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/1dace502-317f-47ea-9b81-0e3c4196da35_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/f7d5bc71-f5c8-4364-a0e6-bfec0356c238_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/b4efec72-1129-4d93-b5e4-06c5a0726159_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/50f96e27-8ec0-46fa-9256-a1ee4ae0850c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/18-13K 11/19-19K', 'remarks': 'vosa@ 23k, 26k, 30k, 37k, 43k, SPARE KEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/67b6ee6b-015c-433f-9c07-da89bee056b2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584337, 'registration': 'GD67ENC', 'account': 'ARN102', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '1.4 TFSI S Line 5dr', 'mileage': 48335, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 14, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-12-20', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GD67ENC/2025-12-01/image/4701d022-8cd6-4678-a319-7627cd5c546c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/d86f3600-94ec-4590-8893-900aad432689_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/891ea5c5-b3fd-41ed-b532-f5680714c6e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/09823a05-3fa2-4336-8655-8f3f69113d09_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/0ad9e556-3e62-49c4-8f42-f8374e26de04_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/f20cf7eb-98dc-4524-91aa-e8c6106acb53_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/83a24e2a-2c51-4fc6-b201-ac2462651385_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/e079de6a-d1b6-431a-ba8f-7acd3c0cf5d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/fb2699eb-6ec4-4f2f-896b-d20ab2bb1187_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/7aa1a4e7-2ff6-45b5-9d29-4f26eaa60b78_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/72d2d592-8ba3-48b2-b442-426cec5014c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/3745b66b-c334-488b-b624-6e0c53c571a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/1dace502-317f-47ea-9b81-0e3c4196da35_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/f7d5bc71-f5c8-4364-a0e6-bfec0356c238_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/b4efec72-1129-4d93-b5e4-06c5a0726159_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD67ENC/2025-12-01/image/50f96e27-8ec0-46fa-9256-a1ee4ae0850c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/18-13K 11/19-19K', 'remarks': 'vosa@ 23k, 26k, 30k, 37k, 43k, SPARE KEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/67b6ee6b-015c-433f-9c07-da89bee056b2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dcc44b8-a8d9-55dc-9499-ea04ce6283d3 with identifier: 117584337
2025-12-02 19:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dcc44b8-a8d9-55dc-9499-ea04ce6283d3 with scrape type 2
2025-12-02 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dcc44b8-a8d9-55dc-9499-ea04ce6283d3 with scrape type 2
2025-12-02 19:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9dcc44b8-a8d9-55dc-9499-ea04ce6283d3, identifier: 117584337
2025-12-02 19:03:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584328, 'registration': 'SF68YVK', 'account': 'ARN235', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 5dr', 'mileage': 72948, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 9, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-01-19', 'fuel': 'Petrol', 'motExpiry': '2026-03-14', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SF68YVK/2025-12-01/image/5ac60e75-d71e-408b-afe0-f2734e584045_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/7cdfa098-198a-4ba5-a957-7c5bd48e0add_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/09786862-58bb-405e-b3f2-eaa19d435d86_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/d366d2b0-7487-4d86-9df9-167674b2abbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/32f34002-97b8-4272-abce-df78991592e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/ca433693-5062-4f4f-b85c-dc139d814ad3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/797a9b7a-f1c6-4987-8560-5fb29f13a961_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/6f802c6d-730d-4067-8286-6ea9deb9f73e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/5cc6e0bd-770a-470f-8b52-0a6902282f18_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/e16edf65-7a5b-42d0-be01-c456df0c4643_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20-13k 01/21-23k 02/22-30k 03/23-42k 02/24-54k 03/25-67k', 'remarks': 'vosa@ 26k, 36k, 48k, 60k, 67k, spare key in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29967584-eb7b-40eb-a0e9-7bb6c468c3cd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584328, 'registration': 'SF68YVK', 'account': 'ARN235', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 5dr', 'mileage': 72948, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 9, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-01-19', 'fuel': 'Petrol', 'motExpiry': '2026-03-14', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SF68YVK/2025-12-01/image/5ac60e75-d71e-408b-afe0-f2734e584045_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/7cdfa098-198a-4ba5-a957-7c5bd48e0add_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/09786862-58bb-405e-b3f2-eaa19d435d86_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/d366d2b0-7487-4d86-9df9-167674b2abbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/32f34002-97b8-4272-abce-df78991592e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/ca433693-5062-4f4f-b85c-dc139d814ad3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/797a9b7a-f1c6-4987-8560-5fb29f13a961_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/6f802c6d-730d-4067-8286-6ea9deb9f73e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/5cc6e0bd-770a-470f-8b52-0a6902282f18_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF68YVK/2025-12-01/image/e16edf65-7a5b-42d0-be01-c456df0c4643_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20-13k 01/21-23k 02/22-30k 03/23-42k 02/24-54k 03/25-67k', 'remarks': 'vosa@ 26k, 36k, 48k, 60k, 67k, spare key in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29967584-eb7b-40eb-a0e9-7bb6c468c3cd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb111fc-0b09-5d40-bb5c-d92f387a2b67 with identifier: 117584328
2025-12-02 19:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb111fc-0b09-5d40-bb5c-d92f387a2b67 with scrape type 2
2025-12-02 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcb111fc-0b09-5d40-bb5c-d92f387a2b67 with scrape type 2
2025-12-02 19:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dcb111fc-0b09-5d40-bb5c-d92f387a2b67, identifier: 117584328
2025-12-02 19:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676
2025-12-02 19:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676
2025-12-02 19:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676 to the API
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116994676?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a6004262-a547-515d-91d0-1af151fe54f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LA70WBL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116994676',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND HATCHBACK',
 'odometer': 34873,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-16',
 'seller_name': 'Richard Nash Group',
 'title': 'VAUXHALL CROSSLAND HATCHBACK 1.2 Turbo [130] Elite 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo [130] Elite 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116994676%27 HTTP/1.1" 200 None
2025-12-02 19:03:11 [astonbarclay.gb] INFO: Saving data for 116994676: {'auction_closing_time': 1764756000.0, 'created_time': 1763024478.604471, 'last_price_update_time': 1764702191.235179}
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116994676') HTTP/1.1" 204 0
2025-12-02 19:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6c19369b-b993-5a83-b20d-1521432bf963 with identifier: 117421533
2025-12-02 19:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6c19369b-b993-5a83-b20d-1521432bf963 with identifier: 117421533
2025-12-02 19:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6c19369b-b993-5a83-b20d-1521432bf963 with identifier: 117421533 to the API
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117421533?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6c19369b-b993-5a83-b20d-1521432bf963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SJ16VYP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117421533',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'VERSO ESTATE',
 'odometer': 70345,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-13',
 'seller_name': 'Manamanx Ltd',
 'title': 'TOYOTA VERSO ESTATE 1.6 V-matic Icon 5dr',
 'transmission': 'manual',
 'trim': '1.6 V-matic Icon 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421533%27 HTTP/1.1" 200 None
2025-12-02 19:03:11 [astonbarclay.gb] INFO: Saving data for 117421533: {'auction_closing_time': 1764756000.0, 'created_time': 1763751904.036755, 'last_price_update_time': 1764702191.533208}
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117421533') HTTP/1.1" 204 0
2025-12-02 19:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9dcc44b8-a8d9-55dc-9499-ea04ce6283d3 with identifier: 117584337
2025-12-02 19:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9dcc44b8-a8d9-55dc-9499-ea04ce6283d3 with identifier: 117584337
2025-12-02 19:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9dcc44b8-a8d9-55dc-9499-ea04ce6283d3 with identifier: 117584337 to the API
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279dcc44b8-a8d9-55dc-9499-ea04ce6283d3%27 HTTP/1.1" 200 None
2025-12-02 19:03:11 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9dcc44b8-a8d9-55dc-9499-ea04ce6283d3: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:10 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584337?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9dcc44b8-a8d9-55dc-9499-ea04ce6283d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GD67ENC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584337',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 48335,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-20',
 'seller_name': 'Arnold Clark',
 'title': 'AUDI Q2 ESTATE 1.4 TFSI S Line 5dr',
 'transmission': 'manual',
 'trim': '1.4 TFSI S Line 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584337%27 HTTP/1.1" 200 None
2025-12-02 19:03:11 [astonbarclay.gb] INFO: Saving data for 117584337: {'auction_closing_time': 1764842400.0, 'created_time': 1764356594.332863, 'last_price_update_time': 1764702191.797493}
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584337') HTTP/1.1" 204 0
2025-12-02 19:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dcb111fc-0b09-5d40-bb5c-d92f387a2b67 with identifier: 117584328
2025-12-02 19:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dcb111fc-0b09-5d40-bb5c-d92f387a2b67 with identifier: 117584328
2025-12-02 19:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: dcb111fc-0b09-5d40-bb5c-d92f387a2b67 with identifier: 117584328 to the API
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27dcb111fc-0b09-5d40-bb5c-d92f387a2b67%27 HTTP/1.1" 200 None
2025-12-02 19:03:12 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id dcb111fc-0b09-5d40-bb5c-d92f387a2b67: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:10 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584328?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'dcb111fc-0b09-5d40-bb5c-d92f387a2b67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SF68YVK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584328',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 72948,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-19',
 'seller_name': 'Arnold Clark',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 ST-Line 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584328%27 HTTP/1.1" 200 None
2025-12-02 19:03:12 [astonbarclay.gb] INFO: Saving data for 117584328: {'auction_closing_time': 1764842400.0, 'created_time': 1764356593.028016, 'last_price_update_time': 1764702192.117212}
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584328') HTTP/1.1" 204 0
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0468190>
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F98887429-4eb6-4764-9c7b-8efb542f9cc1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/98887429-4eb6-4764-9c7b-8efb542f9cc1_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04f4e50>
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F267724db-2085-45c9-9827-f73807fc4c38_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/267724db-2085-45c9-9827-f73807fc4c38_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0822210>
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV17RDZ%252F2025-12-02%252Fimage%252F0ea6c0d9-8cf1-4a16-aa36-bb4f2bbbf300_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/0ea6c0d9-8cf1-4a16-aa36-bb4f2bbbf300_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 37ea0390-0aee-5e2b-b7dc-184334f54095
2025-12-02 19:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37ea0390-0aee-5e2b-b7dc-184334f54095, skipping ID generation
2025-12-02 19:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37ea0390-0aee-5e2b-b7dc-184334f54095 with scrape type 1
2025-12-02 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 37ea0390-0aee-5e2b-b7dc-184334f54095 from tracking dictionaries
2025-12-02 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37ea0390-0aee-5e2b-b7dc-184334f54095 sending to next pipeline
2025-12-02 19:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 37ea0390-0aee-5e2b-b7dc-184334f54095, identifier: 117616251
2025-12-02 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7b9c579b-7c3e-45da-978a-b46db5be5f39_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626705?view=catalogue)
2025-12-02 19:03:12 [astonbarclay.gb] INFO: Found listing with ID: 117600796
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600796%27 HTTP/1.1" 200 None
2025-12-02 19:03:13 [astonbarclay.gb] INFO: Scrape type for 117600796: 2
2025-12-02 19:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 37ea0390-0aee-5e2b-b7dc-184334f54095 with identifier: 117616251
2025-12-02 19:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 37ea0390-0aee-5e2b-b7dc-184334f54095 with identifier: 117616251
2025-12-02 19:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 37ea0390-0aee-5e2b-b7dc-184334f54095 with identifier: 117616251 to the API
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/0ea6c0d9-8cf1-4a16-aa36-bb4f2bbbf300_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '37ea0390-0aee-5e2b-b7dc-184334f54095',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GV17RDZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117616251',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 32519,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39214,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/3dd01e1f-b757-476a-8670-6e08a3e41777_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38043,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/f4d0ed44-da4a-4691-b28e-e00693add82d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36014,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/8025b10f-087d-4932-9f67-9219f515c1ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28218,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/2d1458ab-6f10-401b-9cd5-657de800e6e6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53562,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/ccb6a71e-365d-41f4-8dbf-7dbe615805d9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47360,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/76fd3979-46e0-4b5a-9185-f38f4fdd5dc8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45793,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/60db119d-2458-45d3-b46a-a5b2f38cf516_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47349,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/dfc2e2a2-9bac-43fa-bab8-5fa7321f8b30_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41825,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/b0e983b6-825a-4c33-b703-92505496bff1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42231,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/267724db-2085-45c9-9827-f73807fc4c38_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ea0390-0aee-5e2b-b7dc-184334f54095/37ea0390-0aee-5e2b-b7dc-184334f54095_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49706,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV17RDZ/2025-12-02/image/0ea6c0d9-8cf1-4a16-aa36-bb4f2bbbf300_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'MINI HATCHBACK 1.5 Cooper 3dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 Cooper 3dr Auto',
 'vin': None,
 'year': 2017}
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616251%27 HTTP/1.1" 200 None
2025-12-02 19:03:13 [astonbarclay.gb] INFO: Saving data for 117616251: {'created_time': 1764702193.387646, 'last_price_update_time': 1764702193.387659, 'auction_closing_time': 1764756000.0}
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117616251') HTTP/1.1" 204 0
2025-12-02 19:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN70XMC/2025-12-02/image/22a1e99b-d520-407f-8f96-21a1646aadb4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626705?view=catalogue)
2025-12-02 19:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GN70XMC/2025-12-02/image/0acade92-cb45-4857-b00a-ea0f94b88208_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626705?view=catalogue)
2025-12-02 19:03:13 [astonbarclay.gb] INFO: Found listing with ID: 117676352
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117676352%27 HTTP/1.1" 200 None
2025-12-02 19:03:13 [astonbarclay.gb] INFO: Scrape type for 117676352: 1
2025-12-02 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf031ec90>
2025-12-02 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F7b9c579b-7c3e-45da-978a-b46db5be5f39_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7b9c579b-7c3e-45da-978a-b46db5be5f39_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c
2025-12-02 19:03:13 [astonbarclay.gb] INFO: Found listing with ID: 117662004
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662004%27 HTTP/1.1" 200 None
2025-12-02 19:03:13 [astonbarclay.gb] INFO: Scrape type for 117662004: 1
2025-12-02 19:03:13 [astonbarclay.gb] INFO: Found listing with ID: 117662061
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662061%27 HTTP/1.1" 200 None
2025-12-02 19:03:13 [astonbarclay.gb] INFO: Scrape type for 117662061: 1
2025-12-02 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf080ba50>
2025-12-02 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F22a1e99b-d520-407f-8f96-21a1646aadb4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/22a1e99b-d520-407f-8f96-21a1646aadb4_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c
2025-12-02 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06e34d0>
2025-12-02 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGN70XMC%252F2025-12-02%252Fimage%252F0acade92-cb45-4857-b00a-ea0f94b88208_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GN70XMC/2025-12-02/image/0acade92-cb45-4857-b00a-ea0f94b88208_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c
2025-12-02 19:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b72ee729-55bc-52a5-989d-ac2b2b7aba2c, skipping ID generation
2025-12-02 19:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c with scrape type 1
2025-12-02 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b72ee729-55bc-52a5-989d-ac2b2b7aba2c from tracking dictionaries
2025-12-02 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b72ee729-55bc-52a5-989d-ac2b2b7aba2c sending to next pipeline
2025-12-02 19:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b72ee729-55bc-52a5-989d-ac2b2b7aba2c, identifier: 117626705
2025-12-02 19:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b72ee729-55bc-52a5-989d-ac2b2b7aba2c with identifier: 117626705
2025-12-02 19:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b72ee729-55bc-52a5-989d-ac2b2b7aba2c with identifier: 117626705
2025-12-02 19:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b72ee729-55bc-52a5-989d-ac2b2b7aba2c with identifier: 117626705 to the API
2025-12-02 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/GN70XMC/2025-12-02/image/0acade92-cb45-4857-b00a-ea0f94b88208_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b72ee729-55bc-52a5-989d-ac2b2b7aba2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GN70XMC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117626705',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 29254,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32568,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/8ce4e6e7-becf-499d-8c4c-9780e7797d57_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33199,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7eb09dd1-42a9-4d47-9ad4-9a30391523b0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35793,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c1aa0908-74af-41b5-9f61-a0fc4d6ffc84_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30000,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/d635a90a-a74a-4992-bdac-507087e1554e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36422,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/142e7745-dc98-4e22-9b91-ece5e00b8850_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88668,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/c87d8e4a-c20e-4e83-93cb-4ec94df8362e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 19871,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/98887429-4eb6-4764-9c7b-8efb542f9cc1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82527,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/22a1e99b-d520-407f-8f96-21a1646aadb4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54271,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/7b9c579b-7c3e-45da-978a-b46db5be5f39_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ee729-55bc-52a5-989d-ac2b2b7aba2c/b72ee729-55bc-52a5-989d-ac2b2b7aba2c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44133,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GN70XMC/2025-12-02/image/0acade92-cb45-4857-b00a-ea0f94b88208_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-05',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Exclusive 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.5 T-GDI Exclusive 5dr DCT',
 'vin': None,
 'year': 2020}
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117626705%27 HTTP/1.1" 200 None
2025-12-02 19:03:16 [astonbarclay.gb] INFO: Saving data for 117626705: {'created_time': 1764702196.917812, 'last_price_update_time': 1764702196.917822, 'auction_closing_time': 1764756000.0}
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117626705') HTTP/1.1" 204 0
2025-12-02 19:03:16 [astonbarclay.gb] INFO: Found listing with ID: 117550564
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550564%27 HTTP/1.1" 200 None
2025-12-02 19:03:16 [astonbarclay.gb] INFO: Scrape type for 117550564: 0
2025-12-02 19:03:16 [astonbarclay.gb] INFO: Found listing with ID: 117546383
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546383%27 HTTP/1.1" 200 None
2025-12-02 19:03:16 [astonbarclay.gb] INFO: Scrape type for 117546383: 0
2025-12-02 19:03:16 [astonbarclay.gb] INFO: Found listing with ID: 117550544
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550544%27 HTTP/1.1" 200 None
2025-12-02 19:03:16 [astonbarclay.gb] INFO: Scrape type for 117550544: 0
2025-12-02 19:03:16 [astonbarclay.gb] INFO: Found listing with ID: 117600118
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600118%27 HTTP/1.1" 200 None
2025-12-02 19:03:16 [astonbarclay.gb] INFO: Scrape type for 117600118: 1
2025-12-02 19:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576849?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117033189?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584261?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584298?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576600?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584474?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117407507?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117600165
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600165%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117600165: 1
2025-12-02 19:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584452?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117571526
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571526%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117571526: 2
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117214042
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214042%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117214042: 0
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117085617
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117085617%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117085617: 2
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117523804
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117523804%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117523804: 2
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117058987
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058987%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117058987: 0
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117403071
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117403071%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117403071: 2
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117329064
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117329064%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117329064: 0
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117492465
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492465%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117492465: 2
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117576849, 'registration': 'YR68KBN', 'account': 'RBA001', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost 182 Titanium 5dr Auto', 'mileage': 78734, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2502, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-10-16', 'fuel': 'Petrol', 'motExpiry': '2026-08-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YR68KBN/2025-12-01/image/8ae35a47-0458-4a9c-a4fa-1716a9023f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/75c035a0-6059-4d2d-9eae-bb0484b5cd61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/a4109bdc-41f4-4357-bd69-f720674e5cef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/63a07bc9-7896-403e-b749-f3dd32158f7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/8ee66786-d321-4ed6-a027-e6410ccd0500_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/1fd1baeb-a55c-43df-9acd-7ba5a7f55dd1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book SB 10/19 9K 09/21 29K / SP 10/20 19K / INV 07/23 52K', 'remarks': 'SKEY', 'virtual': False, 'seller': '.', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29fe4ff4-89c6-4690-b9c7-33c7669734fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117576849, 'registration': 'YR68KBN', 'account': 'RBA001', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost 182 Titanium 5dr Auto', 'mileage': 78734, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2502, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-10-16', 'fuel': 'Petrol', 'motExpiry': '2026-08-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YR68KBN/2025-12-01/image/8ae35a47-0458-4a9c-a4fa-1716a9023f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/75c035a0-6059-4d2d-9eae-bb0484b5cd61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/a4109bdc-41f4-4357-bd69-f720674e5cef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/63a07bc9-7896-403e-b749-f3dd32158f7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/8ee66786-d321-4ed6-a027-e6410ccd0500_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/1fd1baeb-a55c-43df-9acd-7ba5a7f55dd1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book SB 10/19 9K 09/21 29K / SP 10/20 19K / INV 07/23 52K', 'remarks': 'SKEY', 'virtual': False, 'seller': '.', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29fe4ff4-89c6-4690-b9c7-33c7669734fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with identifier: 117576849
2025-12-02 19:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7ef74a89-3021-5833-8b27-7b3f0a37ff2a, identifier: 117576849
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117033189, 'registration': 'SA71TNV', 'account': 'ARN217', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 SE 5dr', 'mileage': 81723, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 21, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-09-20', 'fuel': 'Petrol', 'motExpiry': '2025-10-15', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SA71TNV/2025-11-13/image/4138c84a-08c7-4cd1-b9ce-e23fee231b17_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/70166543-7e02-4377-83ee-5d645785800d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/16aea886-cc43-4512-9b39-f185e4db2e87_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/8e2beaa6-308b-47da-ba30-c29be83b1ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/a483ee0e-1c9f-47b1-b6b6-0671c4c886f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/fb402764-fa86-4b4b-97d0-4087918127f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/bcae2029-a983-4c55-a65e-955c5eef2504_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/a571477b-6d27-4517-a87b-1b1a228da748_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/2d0c166d-1158-434f-9436-d78dcf3b72d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/f3654a7e-36e5-4485-a52d-9e83cab9fb2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/d8a70e91-c443-4e78-bc73-34e43e83310e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 06/22-15K, 09/23-42K', 'remarks': 'VOSA@ 63k spare key', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cfc6525e-cd1c-48b7-b623-0cfac2c356c6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117033189, 'registration': 'SA71TNV', 'account': 'ARN217', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 SE 5dr', 'mileage': 81723, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 21, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-09-20', 'fuel': 'Petrol', 'motExpiry': '2025-10-15', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SA71TNV/2025-11-13/image/4138c84a-08c7-4cd1-b9ce-e23fee231b17_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/70166543-7e02-4377-83ee-5d645785800d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/16aea886-cc43-4512-9b39-f185e4db2e87_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/8e2beaa6-308b-47da-ba30-c29be83b1ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/a483ee0e-1c9f-47b1-b6b6-0671c4c886f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/fb402764-fa86-4b4b-97d0-4087918127f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/bcae2029-a983-4c55-a65e-955c5eef2504_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/a571477b-6d27-4517-a87b-1b1a228da748_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/2d0c166d-1158-434f-9436-d78dcf3b72d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/f3654a7e-36e5-4485-a52d-9e83cab9fb2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71TNV/2025-11-13/image/d8a70e91-c443-4e78-bc73-34e43e83310e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 06/22-15K, 09/23-42K', 'remarks': 'VOSA@ 63k spare key', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cfc6525e-cd1c-48b7-b623-0cfac2c356c6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 554e2769-0d3c-5b4a-b357-adfa8a72bd28 with identifier: 117033189
2025-12-02 19:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 554e2769-0d3c-5b4a-b357-adfa8a72bd28 with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 554e2769-0d3c-5b4a-b357-adfa8a72bd28 with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 554e2769-0d3c-5b4a-b357-adfa8a72bd28, identifier: 117033189
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584261, 'registration': 'SE65OYW', 'account': 'ARN065', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 220d 4Matic AMG Line 5dr 9G-Tronic', 'mileage': 49205, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 20, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-01-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-21', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SE65OYW/2025-12-01/image/7455f816-b01d-4ea7-be33-9b6d7bcb6a95_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/dc6238ea-02db-4ee4-aa46-e79b1bad2956_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/eb594bbb-3512-4ecb-96ce-a87b5d69c433_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/b34b564b-52bf-4c43-91c5-d9dc709adb12_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/f4c95c76-12b0-4957-ba11-06f8b4aaade4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/c74ab6be-d629-4dd8-81a9-7f8982fa0dec_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/d17c0288-6d93-4dc1-b279-7bd0fa1744d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/50f2e5ce-b59f-4295-a0b9-23342ddf2ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/08f4a472-c089-40fd-a17f-c3903e6afe4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/7cdc878a-9907-4950-aafd-da36203f0d35_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/b5b885f0-c513-40ef-97a1-8c271724757d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/17-4K 01/18-10K', 'remarks': 'vosa@ 14k, 36k, 39k, 41k, 45k, 48k, SPAR EKEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c5ca5e42-bbf5-457c-9f46-e189a44e235f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584261, 'registration': 'SE65OYW', 'account': 'ARN065', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 220d 4Matic AMG Line 5dr 9G-Tronic', 'mileage': 49205, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 20, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-01-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-21', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SE65OYW/2025-12-01/image/7455f816-b01d-4ea7-be33-9b6d7bcb6a95_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/dc6238ea-02db-4ee4-aa46-e79b1bad2956_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/eb594bbb-3512-4ecb-96ce-a87b5d69c433_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/b34b564b-52bf-4c43-91c5-d9dc709adb12_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/f4c95c76-12b0-4957-ba11-06f8b4aaade4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/c74ab6be-d629-4dd8-81a9-7f8982fa0dec_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/d17c0288-6d93-4dc1-b279-7bd0fa1744d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/50f2e5ce-b59f-4295-a0b9-23342ddf2ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/08f4a472-c089-40fd-a17f-c3903e6afe4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/7cdc878a-9907-4950-aafd-da36203f0d35_removebg.jpg?w=600', 'https://abimg003.imgix.net/SE65OYW/2025-12-01/image/b5b885f0-c513-40ef-97a1-8c271724757d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/17-4K 01/18-10K', 'remarks': 'vosa@ 14k, 36k, 39k, 41k, 45k, 48k, SPAR EKEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c5ca5e42-bbf5-457c-9f46-e189a44e235f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9e0c537-1bdc-5ff2-abbd-f3229349cfe1 with identifier: 117584261
2025-12-02 19:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9e0c537-1bdc-5ff2-abbd-f3229349cfe1 with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9e0c537-1bdc-5ff2-abbd-f3229349cfe1 with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a9e0c537-1bdc-5ff2-abbd-f3229349cfe1, identifier: 117584261
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584298, 'registration': 'LD69UZF', 'account': 'ARN027', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.3 DiG-T N-Connecta 5dr DCT', 'mileage': 40428, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 24, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-11-18', 'fuel': 'Petrol', 'motExpiry': '2026-05-18', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/LD69UZF/2025-12-01/image/f2183d31-2e5b-47f7-b77c-df78e911c135_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/04916cb5-7845-4cb8-bcc6-7fa8551a31b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/371287ee-2703-4373-9557-136342d22a95_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/07c26889-8303-4315-bf5f-5f014720155b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/19f863fa-67d3-46aa-bc8c-b5d65f745c4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/f56d0539-d1ba-456a-8fea-b2d4afd3840c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/b0957d16-8b29-4643-9ba1-3befd9ba62bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/c458efc7-2335-42a6-a991-853e212ad9d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/00c07b8d-95da-4fd7-8521-68f6b6e2aea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/c9146e6f-1891-4424-acce-36435c2c8541_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/bbf2c1e2-9f74-45aa-8a16-f2442f03794e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/798607f3-4cc0-478d-b40a-29e70cf7d441_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/b3415e05-1909-4bda-93fd-0d8b5804fa2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/3d741c97-ee0b-4380-bb97-fbcaf859d6ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/3bfd4c74-69c8-4b66-9ccb-cfe571ca137a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/1a816d35-99e0-42a6-af77-fb57db3a000e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/e88be2d4-451d-4139-a000-38550e804e63_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/60064058-5dfc-4d8e-83d1-7167b3663714_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/480891a5-4685-4a39-820d-9bb44b45c5a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/6630cb4f-8180-4555-ae4b-9a71e7766815_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/536b3992-6768-4b45-9f4f-312cbb0834cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/871faf56-a550-474d-be3a-6b35b0859670_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/0ad6ad2f-dd6e-439c-8df9-d39a7240d5c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/0a71ae90-2865-463d-9a55-de91ad2bc1e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/38820838-7f81-4605-9313-eac603751bc6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/23-33k', 'remarks': 'vosa@ 15k, 25k, 33k, 33k sd card in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6eaf8e11-b774-4c5b-bdef-aa8838da329b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584298, 'registration': 'LD69UZF', 'account': 'ARN027', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.3 DiG-T N-Connecta 5dr DCT', 'mileage': 40428, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 24, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-11-18', 'fuel': 'Petrol', 'motExpiry': '2026-05-18', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/LD69UZF/2025-12-01/image/f2183d31-2e5b-47f7-b77c-df78e911c135_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/04916cb5-7845-4cb8-bcc6-7fa8551a31b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/371287ee-2703-4373-9557-136342d22a95_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/07c26889-8303-4315-bf5f-5f014720155b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/19f863fa-67d3-46aa-bc8c-b5d65f745c4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/f56d0539-d1ba-456a-8fea-b2d4afd3840c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/b0957d16-8b29-4643-9ba1-3befd9ba62bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/c458efc7-2335-42a6-a991-853e212ad9d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/00c07b8d-95da-4fd7-8521-68f6b6e2aea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/c9146e6f-1891-4424-acce-36435c2c8541_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/bbf2c1e2-9f74-45aa-8a16-f2442f03794e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/798607f3-4cc0-478d-b40a-29e70cf7d441_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/b3415e05-1909-4bda-93fd-0d8b5804fa2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/3d741c97-ee0b-4380-bb97-fbcaf859d6ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/3bfd4c74-69c8-4b66-9ccb-cfe571ca137a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/1a816d35-99e0-42a6-af77-fb57db3a000e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/e88be2d4-451d-4139-a000-38550e804e63_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/60064058-5dfc-4d8e-83d1-7167b3663714_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/480891a5-4685-4a39-820d-9bb44b45c5a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/6630cb4f-8180-4555-ae4b-9a71e7766815_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/536b3992-6768-4b45-9f4f-312cbb0834cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/871faf56-a550-474d-be3a-6b35b0859670_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/0ad6ad2f-dd6e-439c-8df9-d39a7240d5c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/0a71ae90-2865-463d-9a55-de91ad2bc1e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD69UZF/2025-12-01/image/38820838-7f81-4605-9313-eac603751bc6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/23-33k', 'remarks': 'vosa@ 15k, 25k, 33k, 33k sd card in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6eaf8e11-b774-4c5b-bdef-aa8838da329b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1243083c-1e11-517b-b602-e377131f3e4d with identifier: 117584298
2025-12-02 19:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1243083c-1e11-517b-b602-e377131f3e4d with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1243083c-1e11-517b-b602-e377131f3e4d with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1243083c-1e11-517b-b602-e377131f3e4d, identifier: 117584298
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117576600, 'registration': 'AF16FJJ', 'account': 'CHE048', 'make': 'AUDI', 'model': 'A5 COUPE', 'derivative': '1.8T FSI 177 S Line 2dr [Nav]', 'mileage': 71699, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2504, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-04', 'fuel': 'Petrol', 'motExpiry': '2026-04-02', 'doors': 2, 'engineSize': 1798, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/15dd9240-3898-4efd-a3c9-bd81ee64cd53_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/5f81ef00-47dc-4283-9202-0587f4350409_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/43dc29a6-66cd-4659-a67d-fbe5878824d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/b92493ce-41dc-4162-a8bd-eedcd343cb87_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/f8824cca-9def-4662-8aee-f35a9ede1c27_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/abb4b8cf-7a35-465a-be38-c3e1af963b5f_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 02/18 19K 03/19 26K 03/21 38K', 'remarks': 'SKEY - POSSIBLE CLUTCH FAULT', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1edb9500-a602-42ee-b68e-1d21647e293d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117576600, 'registration': 'AF16FJJ', 'account': 'CHE048', 'make': 'AUDI', 'model': 'A5 COUPE', 'derivative': '1.8T FSI 177 S Line 2dr [Nav]', 'mileage': 71699, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-03T09:45Z', 'lot': 2504, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-04', 'fuel': 'Petrol', 'motExpiry': '2026-04-02', 'doors': 2, 'engineSize': 1798, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/15dd9240-3898-4efd-a3c9-bd81ee64cd53_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/5f81ef00-47dc-4283-9202-0587f4350409_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/43dc29a6-66cd-4659-a67d-fbe5878824d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/b92493ce-41dc-4162-a8bd-eedcd343cb87_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/f8824cca-9def-4662-8aee-f35a9ede1c27_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/abb4b8cf-7a35-465a-be38-c3e1af963b5f_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 02/18 19K 03/19 26K 03/21 38K', 'remarks': 'SKEY - POSSIBLE CLUTCH FAULT', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1edb9500-a602-42ee-b68e-1d21647e293d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with identifier: 117576600
2025-12-02 19:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6bf3a580-1b4e-5647-a719-b1f2c197c1cf, identifier: 117576600
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584474, 'registration': 'SA71ZZG', 'account': 'ARN133', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK SPECIAL EDITION', 'derivative': '1.0 T3 GSE Night Eagle II 5dr', 'mileage': 1, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 35, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-10-25', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/5e0276aa-0b8f-49a2-bd09-02769c16d2c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/cd45ee3c-a153-4b85-a079-fed75b9a8298_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/02d82998-4bda-4eb8-97c0-7c0e40f458a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/3bfd4b8b-093b-469c-9073-f1cf60e3f3d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/4aa219d1-befd-4a21-8ea7-0890183a369f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/3950e512-d3a8-44cb-bae5-b71463fa59db_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/9af7aa16-8878-45ab-bb6d-725ec7001bad_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/cac2d23b-4f19-4206-833a-a4f18e975ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/63802217-f5af-40ff-88d3-851d2ccc89e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/85308b15-9c1f-4206-8272-464758748254_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/a695e251-4909-42fa-a7b2-bdd33b801598_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/84f25bde-8454-42c7-b41a-dac2040737e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/78bd6c97-fd14-47e6-ad8f-e12954f98b72_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/199fe254-405c-46dc-b2ec-e8d53125d9e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/3498ae42-3c64-493e-9fbb-b2034b00602e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/e3e081a8-8195-482d-9c4f-950d0563297a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/22-11K 02/25-36K', 'remarks': 'vosa@ 36k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/556688bc-ae7e-484b-ab5c-f5b2416288bc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584474, 'registration': 'SA71ZZG', 'account': 'ARN133', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK SPECIAL EDITION', 'derivative': '1.0 T3 GSE Night Eagle II 5dr', 'mileage': 1, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 35, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-10-25', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/5e0276aa-0b8f-49a2-bd09-02769c16d2c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/cd45ee3c-a153-4b85-a079-fed75b9a8298_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/02d82998-4bda-4eb8-97c0-7c0e40f458a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/3bfd4b8b-093b-469c-9073-f1cf60e3f3d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/4aa219d1-befd-4a21-8ea7-0890183a369f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/3950e512-d3a8-44cb-bae5-b71463fa59db_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/9af7aa16-8878-45ab-bb6d-725ec7001bad_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/cac2d23b-4f19-4206-833a-a4f18e975ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/63802217-f5af-40ff-88d3-851d2ccc89e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/85308b15-9c1f-4206-8272-464758748254_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/a695e251-4909-42fa-a7b2-bdd33b801598_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/84f25bde-8454-42c7-b41a-dac2040737e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/78bd6c97-fd14-47e6-ad8f-e12954f98b72_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/199fe254-405c-46dc-b2ec-e8d53125d9e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/3498ae42-3c64-493e-9fbb-b2034b00602e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA71ZZG/2025-12-02/image/e3e081a8-8195-482d-9c4f-950d0563297a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/22-11K 02/25-36K', 'remarks': 'vosa@ 36k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/556688bc-ae7e-484b-ab5c-f5b2416288bc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc62d7f-3f9e-5c85-af7a-0a318e812b70 with identifier: 117584474
2025-12-02 19:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc62d7f-3f9e-5c85-af7a-0a318e812b70 with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dc62d7f-3f9e-5c85-af7a-0a318e812b70 with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0dc62d7f-3f9e-5c85-af7a-0a318e812b70, identifier: 117584474
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117407507, 'registration': 'SA16PVL', 'account': 'ARN001', 'make': 'KIA', 'model': 'SORENTO DIESEL STATION WAGON', 'derivative': '2.2 CRDi KX-2 5dr', 'mileage': 148604, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 32, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-04-09', 'doors': 5, 'engineSize': 2199, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/SA16PVL/2025-11-26/image/b9624c94-aeb6-47ff-a7dc-a847fe316eb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/07b3d847-7ee3-4561-b3e4-789a182a22ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/03c4feb0-b0a2-4037-9664-88249c7fb7f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/66f345b9-03a2-428e-9bd7-82ddb04d7f74_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/ce975c34-0337-4402-866f-41107e155332_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/987c016d-b07e-49b1-9c8e-a297686db5ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/5649a579-ac1e-4292-bcdc-242c72188aa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/7cb1be62-4a85-4206-97bb-c5a2bbc0aa40_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 03/17- 10k, 02/18- 19k, 03/19- 29k, 03/20- 45k, 07/21- 69k, 09/22- 89k, 03/23- 97k, 03/25- 140k', 'remarks': 'vosa@ 29k, 45k, 61k, 79k, 97k, 117k, 140k spare key, sd card', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c8b38dd0-51d4-41cd-9db5-ae90535e1ae1.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117407507, 'registration': 'SA16PVL', 'account': 'ARN001', 'make': 'KIA', 'model': 'SORENTO DIESEL STATION WAGON', 'derivative': '2.2 CRDi KX-2 5dr', 'mileage': 148604, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 32, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-04-09', 'doors': 5, 'engineSize': 2199, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/SA16PVL/2025-11-26/image/b9624c94-aeb6-47ff-a7dc-a847fe316eb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/07b3d847-7ee3-4561-b3e4-789a182a22ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/03c4feb0-b0a2-4037-9664-88249c7fb7f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/66f345b9-03a2-428e-9bd7-82ddb04d7f74_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/ce975c34-0337-4402-866f-41107e155332_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/987c016d-b07e-49b1-9c8e-a297686db5ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/5649a579-ac1e-4292-bcdc-242c72188aa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA16PVL/2025-11-26/image/7cb1be62-4a85-4206-97bb-c5a2bbc0aa40_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 03/17- 10k, 02/18- 19k, 03/19- 29k, 03/20- 45k, 07/21- 69k, 09/22- 89k, 03/23- 97k, 03/25- 140k', 'remarks': 'vosa@ 29k, 45k, 61k, 79k, 97k, 117k, 140k spare key, sd card', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c8b38dd0-51d4-41cd-9db5-ae90535e1ae1.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 270aa9cd-bed8-59ad-9a39-0b213c7742fb with identifier: 117407507
2025-12-02 19:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 270aa9cd-bed8-59ad-9a39-0b213c7742fb with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 270aa9cd-bed8-59ad-9a39-0b213c7742fb with scrape type 2
2025-12-02 19:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 270aa9cd-bed8-59ad-9a39-0b213c7742fb, identifier: 117407507
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117277530
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117277530%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117277530: 0
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117242484
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242484%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117242484: 0
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 116833742
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116833742%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 116833742: 0
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117069859
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117069859%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117069859: 0
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Found listing with ID: 117140776
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140776%27 HTTP/1.1" 200 None
2025-12-02 19:03:17 [astonbarclay.gb] INFO: Scrape type for 117140776: 2
2025-12-02 19:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with identifier: 117576849
2025-12-02 19:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with identifier: 117576849
2025-12-02 19:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with identifier: 117576849 to the API
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277ef74a89-3021-5833-8b27-7b3f0a37ff2a%27 HTTP/1.1" 200 None
2025-12-02 19:03:18 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7ef74a89-3021-5833-8b27-7b3f0a37ff2a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:17 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117576849?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7ef74a89-3021-5833-8b27-7b3f0a37ff2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YR68KBN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576849',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 78734,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-16',
 'seller_name': '.',
 'title': 'FORD KUGA ESTATE 1.5 EcoBoost 182 Titanium 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 EcoBoost 182 Titanium 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576849%27 HTTP/1.1" 200 None
2025-12-02 19:03:18 [astonbarclay.gb] INFO: Saving data for 117576849: {'auction_closing_time': 1764755100.0, 'created_time': 1764356524.973468, 'last_price_update_time': 1764702198.287742}
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576849') HTTP/1.1" 204 0
2025-12-02 19:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 554e2769-0d3c-5b4a-b357-adfa8a72bd28 with identifier: 117033189
2025-12-02 19:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 554e2769-0d3c-5b4a-b357-adfa8a72bd28 with identifier: 117033189
2025-12-02 19:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 554e2769-0d3c-5b4a-b357-adfa8a72bd28 with identifier: 117033189 to the API
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27554e2769-0d3c-5b4a-b357-adfa8a72bd28%27 HTTP/1.1" 200 None
2025-12-02 19:03:18 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 554e2769-0d3c-5b4a-b357-adfa8a72bd28: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:17 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117033189?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '554e2769-0d3c-5b4a-b357-adfa8a72bd28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SA71TNV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117033189',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK',
 'odometer': 81723,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seller_name': 'Arnold Clark',
 'title': 'VAUXHALL CORSA HATCHBACK 1.2 SE 5dr',
 'transmission': 'manual',
 'trim': '1.2 SE 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117033189%27 HTTP/1.1" 200 None
2025-12-02 19:03:18 [astonbarclay.gb] INFO: Saving data for 117033189: {'auction_closing_time': 1764842400.0, 'created_time': 1762542190.410445, 'last_price_update_time': 1764702198.671026}
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117033189') HTTP/1.1" 204 0
2025-12-02 19:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a9e0c537-1bdc-5ff2-abbd-f3229349cfe1 with identifier: 117584261
2025-12-02 19:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a9e0c537-1bdc-5ff2-abbd-f3229349cfe1 with identifier: 117584261
2025-12-02 19:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a9e0c537-1bdc-5ff2-abbd-f3229349cfe1 with identifier: 117584261 to the API
2025-12-02 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a9e0c537-1bdc-5ff2-abbd-f3229349cfe1%27 HTTP/1.1" 200 None
2025-12-02 19:03:19 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a9e0c537-1bdc-5ff2-abbd-f3229349cfe1: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:18 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584261?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'a9e0c537-1bdc-5ff2-abbd-f3229349cfe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SE65OYW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584261',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MERCEDES-BENZ',
 'model': 'GLC DIESEL ESTATE',
 'odometer': 49205,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-31',
 'seller_name': 'Arnold Clark',
 'title': 'MERCEDES-BENZ GLC DIESEL ESTATE GLC 220d 4Matic AMG Line 5dr '
          '9G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLC 220d 4Matic AMG Line 5dr 9G-Tronic',
 'vin': None,
 'year': 2016}
2025-12-02 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584261%27 HTTP/1.1" 200 None
2025-12-02 19:03:19 [astonbarclay.gb] INFO: Saving data for 117584261: {'auction_closing_time': 1764842400.0, 'created_time': 1764356584.069197, 'last_price_update_time': 1764702199.762356}
2025-12-02 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584261') HTTP/1.1" 204 0
2025-12-02 19:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1243083c-1e11-517b-b602-e377131f3e4d with identifier: 117584298
2025-12-02 19:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1243083c-1e11-517b-b602-e377131f3e4d with identifier: 117584298
2025-12-02 19:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1243083c-1e11-517b-b602-e377131f3e4d with identifier: 117584298 to the API
2025-12-02 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%271243083c-1e11-517b-b602-e377131f3e4d%27 HTTP/1.1" 200 None
2025-12-02 19:03:20 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 1243083c-1e11-517b-b602-e377131f3e4d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:18 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584298?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1243083c-1e11-517b-b602-e377131f3e4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LD69UZF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584298',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'NISSAN',
 'model': 'X-TRAIL STATION WAGON',
 'odometer': 40428,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-18',
 'seller_name': 'Arnold Clark',
 'title': 'NISSAN X-TRAIL STATION WAGON 1.3 DiG-T N-Connecta 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T N-Connecta 5dr DCT',
 'vin': None,
 'year': 2019}
2025-12-02 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584298%27 HTTP/1.1" 200 None
2025-12-02 19:03:20 [astonbarclay.gb] INFO: Saving data for 117584298: {'auction_closing_time': 1764842400.0, 'created_time': 1764356591.559711, 'last_price_update_time': 1764702200.055621}
2025-12-02 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584298') HTTP/1.1" 204 0
2025-12-02 19:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with identifier: 117576600
2025-12-02 19:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with identifier: 117576600
2025-12-02 19:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with identifier: 117576600 to the API
2025-12-02 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276bf3a580-1b4e-5647-a719-b1f2c197c1cf%27 HTTP/1.1" 200 None
2025-12-02 19:03:21 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6bf3a580-1b4e-5647-a719-b1f2c197c1cf: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:20 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117576600?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '6bf3a580-1b4e-5647-a719-b1f2c197c1cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AF16FJJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576600',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'AUDI',
 'model': 'A5 COUPE',
 'odometer': 71699,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-04',
 'seller_name': 'Local Dealer Group',
 'title': 'AUDI A5 COUPE 1.8T FSI 177 S Line 2dr [Nav]',
 'transmission': 'manual',
 'trim': '1.8T FSI 177 S Line 2dr [Nav]',
 'vin': None,
 'year': 2016}
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576600%27 HTTP/1.1" 200 None
2025-12-02 19:03:21 [astonbarclay.gb] INFO: Saving data for 117576600: {'auction_closing_time': 1764755100.0, 'created_time': 1764356528.300502, 'last_price_update_time': 1764702201.255082}
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576600') HTTP/1.1" 204 0
2025-12-02 19:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0dc62d7f-3f9e-5c85-af7a-0a318e812b70 with identifier: 117584474
2025-12-02 19:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0dc62d7f-3f9e-5c85-af7a-0a318e812b70 with identifier: 117584474
2025-12-02 19:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0dc62d7f-3f9e-5c85-af7a-0a318e812b70 with identifier: 117584474 to the API
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270dc62d7f-3f9e-5c85-af7a-0a318e812b70%27 HTTP/1.1" 200 None
2025-12-02 19:03:21 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0dc62d7f-3f9e-5c85-af7a-0a318e812b70: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:20 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584474?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0dc62d7f-3f9e-5c85-af7a-0a318e812b70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SA71ZZG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584474',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'JEEP',
 'model': 'RENEGADE HATCHBACK SPECIAL EDITION',
 'odometer': 1,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seller_name': 'Arnold Clark',
 'title': 'JEEP RENEGADE HATCHBACK SPECIAL EDITION 1.0 T3 GSE Night Eagle II '
          '5dr',
 'transmission': 'manual',
 'trim': '1.0 T3 GSE Night Eagle II 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584474%27 HTTP/1.1" 200 None
2025-12-02 19:03:21 [astonbarclay.gb] INFO: Saving data for 117584474: {'auction_closing_time': 1764842400.0, 'created_time': 1764356575.820432, 'last_price_update_time': 1764702201.652214}
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584474') HTTP/1.1" 204 0
2025-12-02 19:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 270aa9cd-bed8-59ad-9a39-0b213c7742fb with identifier: 117407507
2025-12-02 19:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 270aa9cd-bed8-59ad-9a39-0b213c7742fb with identifier: 117407507
2025-12-02 19:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'arnold clark', 'price_includes_vat': False, 'title': 'kia sorento diesel station wagon 2.2 crdi kx-2 5dr', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'sorento diesel station wagon', 'transmission': 'manual', 'engine': '2.2l', 'fuel_type': 'diesel', 'odometer': 148604, 'odometer_reading_unit': 'mi', 'registration_date': '2016-03-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407507', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '2.2 crdi kx-2 5dr', 'license_plate': 'sa16pvl', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 159, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '270aa9cd-bed8-59ad-9a39-0b213c7742fb', 'current_year_diff': 9, 'age_in_months': 116, 'make_model': 'kia sorento diesel station wagon', 'sanitized_make': 'kia', 'odometer_in_km': 239154}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 116,
     'auction_title': '',
     'c_o_2_emission_value': 159,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.2l',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'diesel',
     'id': '270aa9cd-bed8-59ad-9a39-0b213c7742fb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'sa16pvl',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407507',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'kia',
     'make_model': 'kia sorento diesel station wagon',
     'model': 'sorento diesel station wagon',
     'odometer': 148604,
     'odometer_in_km': 239154,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-03-29',
     'sanitized_make': 'kia',
     'seller_name': 'arnold clark',
     'title': 'kia sorento diesel station wagon 2.2 crdi kx-2 5dr',
     'transmission': 'manual',
     'trim': '2.2 crdi kx-2 5dr',
     'vin': None,
     'year': 2016}
2025-12-02 19:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 270aa9cd-bed8-59ad-9a39-0b213c7742fb spider: astonbarclay.gb
2025-12-02 19:03:21 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 270aa9cd-bed8-59ad-9a39-0b213c7742fb due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'arnold clark', 'price_includes_vat': False, 'title': 'kia sorento diesel station wagon 2.2 crdi kx-2 5dr', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'sorento diesel station wagon', 'transmission': 'manual', 'engine': '2.2l', 'fuel_type': 'diesel', 'odometer': 148604, 'odometer_reading_unit': 'mi', 'registration_date': '2016-03-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407507', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '2.2 crdi kx-2 5dr', 'license_plate': 'sa16pvl', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 159, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '270aa9cd-bed8-59ad-9a39-0b213c7742fb', 'current_year_diff': 9, 'age_in_months': 116, 'make_model': 'kia sorento diesel station wagon', 'sanitized_make': 'kia', 'odometer_in_km': 239154}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 116,
     'auction_title': '',
     'c_o_2_emission_value': 159,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.2l',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'diesel',
     'id': '270aa9cd-bed8-59ad-9a39-0b213c7742fb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'sa16pvl',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407507',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'kia',
     'make_model': 'kia sorento diesel station wagon',
     'model': 'sorento diesel station wagon',
     'odometer': 148604,
     'odometer_in_km': 239154,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-03-29',
     'sanitized_make': 'kia',
     'seller_name': 'arnold clark',
     'title': 'kia sorento diesel station wagon 2.2 crdi kx-2 5dr',
     'transmission': 'manual',
     'trim': '2.2 crdi kx-2 5dr',
     'vin': None,
     'year': 2016}
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '270aa9cd-bed8-59ad-9a39-0b213c7742fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SA16PVL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407507',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'KIA',
 'model': 'SORENTO DIESEL STATION WAGON',
 'odometer': 148604,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': 'Arnold Clark',
 'title': 'KIA SORENTO DIESEL STATION WAGON 2.2 CRDi KX-2 5dr',
 'transmission': 'manual',
 'trim': '2.2 CRDi KX-2 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407507%27 HTTP/1.1" 200 None
2025-12-02 19:03:21 [astonbarclay.gb] INFO: Saving data for 117407507: {'auction_closing_time': 1764842400.0, 'created_time': 1763751824.043368, 'last_price_update_time': 1764702201.859388}
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117407507') HTTP/1.1" 204 0
2025-12-02 19:03:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584452, 'registration': 'SB17TTU', 'account': 'ARN245', 'make': 'HONDA', 'model': 'CIVIC HATCHBACK', 'derivative': '1.0 VTEC Turbo SR 5dr', 'mileage': 80629, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 33, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-05-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-30', 'doors': 5, 'engineSize': 988, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SB17TTU/2025-12-02/image/a4de6b23-541e-4809-8fda-8d7f9a790adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/1759cf86-107d-4bad-970e-1d92cdab11ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/f1654f48-bb33-477e-9f36-be2a2e1ed11a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/0789cdbd-b9c3-4f84-9e82-be675af5ac46_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/504f5f33-a0b2-477d-811e-1610526b387e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/45c99390-acd0-46cf-8e30-5b0144367cbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/cc50804f-dae7-4c53-ba3d-ee6e8e641c71_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/9346de28-5e60-4008-ae08-62e83ff9cc97_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/6c3bd342-7bd2-4833-90c7-15a180d78689_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/f7491eb8-4ce7-4c72-ada3-244b8d5a84a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/2a854071-7263-4d66-8ca8-b9c5b4737610_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/4900fba4-da10-427b-a402-5de262b53b11_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/cd0c6208-a8d8-4ce0-b33f-1025e9383878_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/cda51bec-bd61-4396-984b-860e1a6c76a5_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa@ 48k, 56k, 61k, 67k, 74k, spare key in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31caf1f1-f8f3-4041-9fe5-8be92fbc1d0f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584452, 'registration': 'SB17TTU', 'account': 'ARN245', 'make': 'HONDA', 'model': 'CIVIC HATCHBACK', 'derivative': '1.0 VTEC Turbo SR 5dr', 'mileage': 80629, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 33, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-05-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-30', 'doors': 5, 'engineSize': 988, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SB17TTU/2025-12-02/image/a4de6b23-541e-4809-8fda-8d7f9a790adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/1759cf86-107d-4bad-970e-1d92cdab11ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/f1654f48-bb33-477e-9f36-be2a2e1ed11a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/0789cdbd-b9c3-4f84-9e82-be675af5ac46_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/504f5f33-a0b2-477d-811e-1610526b387e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/45c99390-acd0-46cf-8e30-5b0144367cbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/cc50804f-dae7-4c53-ba3d-ee6e8e641c71_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/9346de28-5e60-4008-ae08-62e83ff9cc97_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/6c3bd342-7bd2-4833-90c7-15a180d78689_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/f7491eb8-4ce7-4c72-ada3-244b8d5a84a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/2a854071-7263-4d66-8ca8-b9c5b4737610_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/4900fba4-da10-427b-a402-5de262b53b11_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/cd0c6208-a8d8-4ce0-b33f-1025e9383878_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB17TTU/2025-12-02/image/cda51bec-bd61-4396-984b-860e1a6c76a5_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa@ 48k, 56k, 61k, 67k, 74k, spare key in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31caf1f1-f8f3-4041-9fe5-8be92fbc1d0f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34772b53-8759-5849-a894-e51f434b084c with identifier: 117584452
2025-12-02 19:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34772b53-8759-5849-a894-e51f434b084c with scrape type 2
2025-12-02 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34772b53-8759-5849-a894-e51f434b084c with scrape type 2
2025-12-02 19:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 34772b53-8759-5849-a894-e51f434b084c, identifier: 117584452
2025-12-02 19:03:21 [astonbarclay.gb] INFO: Found listing with ID: 117407917
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407917%27 HTTP/1.1" 200 None
2025-12-02 19:03:21 [astonbarclay.gb] INFO: Scrape type for 117407917: 2
2025-12-02 19:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 34772b53-8759-5849-a894-e51f434b084c with identifier: 117584452
2025-12-02 19:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 34772b53-8759-5849-a894-e51f434b084c with identifier: 117584452
2025-12-02 19:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 34772b53-8759-5849-a894-e51f434b084c with identifier: 117584452 to the API
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2734772b53-8759-5849-a894-e51f434b084c%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 34772b53-8759-5849-a894-e51f434b084c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584452?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '34772b53-8759-5849-a894-e51f434b084c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SB17TTU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584452',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HONDA',
 'model': 'CIVIC HATCHBACK',
 'odometer': 80629,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': 'Arnold Clark',
 'title': 'HONDA CIVIC HATCHBACK 1.0 VTEC Turbo SR 5dr',
 'transmission': 'manual',
 'trim': '1.0 VTEC Turbo SR 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584452%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Saving data for 117584452: {'auction_closing_time': 1764842400.0, 'created_time': 1764356593.733549, 'last_price_update_time': 1764702202.289731}
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584452') HTTP/1.1" 204 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116280997
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116280997%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116280997: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117085521
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117085521%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117085521: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117209040
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209040%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117209040: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116699879
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699879%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116699879: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117369086
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117369086%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117369086: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117256307
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256307%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117256307: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116772841
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116772841%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116772841: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117364404
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364404%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117364404: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117422017
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422017%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117422017: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117099256
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099256%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117099256: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116361929
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116361929%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116361929: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117178728
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178728%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117178728: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116963745
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116963745%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116963745: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116666877
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116666877%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116666877: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117099210
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099210%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117099210: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116183620
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116183620%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116183620: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117262801
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117262801%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117262801: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117235504
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117235504%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117235504: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117424159
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424159%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117424159: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117101358
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101358%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117101358: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116941457
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116941457%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116941457: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117364152
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364152%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117364152: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117264969
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117264969%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117264969: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117308707
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117308707%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117308707: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117058008
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058008%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117058008: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117024845
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024845%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117024845: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116560193
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116560193%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116560193: 2
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117402247
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402247%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117402247: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117402830
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402830%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117402830: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116995130
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116995130%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116995130: 1
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116305284
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116305284%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116305284: 1
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117495107
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495107%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117495107: 0
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117536701
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117536701%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117536701: 1
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117429174
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117429174%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117429174: 1
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117220839
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117220839%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117220839: 1
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117381174
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381174%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117381174: 2
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117383402
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117383402%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117383402: 1
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117381561
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381561%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117381561: 1
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116725518
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116725518%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116725518: 2
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117190866
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117190866%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117190866: 2
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116954790
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116954790%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116954790: 2
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116655276
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116655276%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116655276: 2
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117577591
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117577591%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117577591: 1
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117605321
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605321%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 117605321: 2
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 116496702
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116496702%27 HTTP/1.1" 200 None
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Scrape type for 116496702: 2
2025-12-02 19:03:22 [astonbarclay.gb] INFO: Found listing with ID: 117121049
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121049%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117121049: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117099421
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099421%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117099421: 0
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 115997019
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115997019%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 115997019: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117457493
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457493%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117457493: 1
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117431475
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117431475%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117431475: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117056499
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117056499%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117056499: 1
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117344303
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117344303%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117344303: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117492502
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492502%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117492502: 1
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117362156
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362156%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117362156: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 116016591
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116016591%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 116016591: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117157384
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117157384%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117157384: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 116470730
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116470730%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 116470730: 1
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117495072
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495072%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117495072: 0
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117500036
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117500036%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117500036: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117391120
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117391120%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117391120: 1
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117495054
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495054%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117495054: 0
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117495085
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495085%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117495085: 0
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117314112
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117314112%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117314112: 1
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117006204
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117006204%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117006204: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117288373
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288373%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117288373: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117289497
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289497%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117289497: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117433187
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433187%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117433187: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117399936
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399936%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117399936: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 116931547
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116931547%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 116931547: 2
2025-12-02 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 116152721
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152721%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 116152721: 2
2025-12-02 19:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117364905?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 116996626
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116996626%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 116996626: 2
2025-12-02 19:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117260057
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117260057%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117260057: 2
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117662184
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662184%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117662184: 1
2025-12-02 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117600796?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117625064
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625064%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117625064: 1
2025-12-02 19:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117363031
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117363031%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117363031: 1
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117609383
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609383%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117609383: 1
2025-12-02 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117514814?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117506955?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117480129
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117480129%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117480129: 1
2025-12-02 19:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117590985, 'registration': 'PX68XYL', 'account': 'THE109', 'make': 'FORD', 'model': 'FOCUS DIESEL HATCHBACK', 'derivative': '2.0 EcoBlue ST-Line X 5dr', 'mileage': 60097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 108, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-10-19', 'fuel': 'Diesel', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b23d06a7-b4b6-41c6-bd7e-095b8b10a14e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b57135eb-720c-4442-9ceb-0f18db403817_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/863df404-cf96-49f7-bac4-cdba94a8e373_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/bd6732cc-850d-418b-ae4d-1b61adcc4c2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f92a86b4-4cf3-4a58-b643-b9b875b16321_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/eb7ce05f-923f-428a-acde-7145d9a17118_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/65bc4fc5-1f03-4556-bb7c-a583debfffe7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/a6809671-ebbc-4657-85ef-efaa94845cdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f7c3ff6c-7664-4e92-a411-fea4d8c0cdc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/260d71ec-5b29-4b5e-b035-37900241a482_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/14825501-6618-43e2-9f86-16f5c6a71aea_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/c3e30827-2c5b-4c84-9fa1-ea37060945d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/fde35cd9-4564-449f-a9b8-366a069edade_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/e057fba8-0088-4a13-9bed-28ee0836b935_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/38ade57c-88ab-4332-a336-6c61604e9de9_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/20-10K, 12/22-30K, 10/23-40K, 05/25-55K', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is front end and all over vosa @ 13k 28k 40k 49k 59k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d288861d-4686-4ecc-9891-b1a5f7a1d3fd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117590985, 'registration': 'PX68XYL', 'account': 'THE109', 'make': 'FORD', 'model': 'FOCUS DIESEL HATCHBACK', 'derivative': '2.0 EcoBlue ST-Line X 5dr', 'mileage': 60097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 108, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-10-19', 'fuel': 'Diesel', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b23d06a7-b4b6-41c6-bd7e-095b8b10a14e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b57135eb-720c-4442-9ceb-0f18db403817_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/863df404-cf96-49f7-bac4-cdba94a8e373_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/bd6732cc-850d-418b-ae4d-1b61adcc4c2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f92a86b4-4cf3-4a58-b643-b9b875b16321_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/eb7ce05f-923f-428a-acde-7145d9a17118_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/65bc4fc5-1f03-4556-bb7c-a583debfffe7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/a6809671-ebbc-4657-85ef-efaa94845cdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f7c3ff6c-7664-4e92-a411-fea4d8c0cdc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/260d71ec-5b29-4b5e-b035-37900241a482_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/14825501-6618-43e2-9f86-16f5c6a71aea_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/c3e30827-2c5b-4c84-9fa1-ea37060945d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/fde35cd9-4564-449f-a9b8-366a069edade_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/e057fba8-0088-4a13-9bed-28ee0836b935_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/38ade57c-88ab-4332-a336-6c61604e9de9_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/20-10K, 12/22-30K, 10/23-40K, 05/25-55K', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is front end and all over vosa @ 13k 28k 40k 49k 59k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d288861d-4686-4ecc-9891-b1a5f7a1d3fd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15d0105f-1358-503b-a6ef-e3234f03ddd3 with identifier: 117590985
2025-12-02 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15d0105f-1358-503b-a6ef-e3234f03ddd3 with scrape type 1
2025-12-02 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fb23d06a7-b4b6-41c6-bd7e-095b8b10a14e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b23d06a7-b4b6-41c6-bd7e-095b8b10a14e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117662195
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662195%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117662195: 1
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fb57135eb-720c-4442-9ceb-0f18db403817_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b57135eb-720c-4442-9ceb-0f18db403817_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662004, 'registration': 'NL68JBX', 'account': 'KEN008', 'make': 'SEAT', 'model': 'ATECA DIESEL ESTATE', 'derivative': '1.6 TDI SE Technology [EZ] 5dr', 'mileage': 55430, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 144, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-09-26', 'fuel': 'Diesel', 'motExpiry': '2026-11-10', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5d137294-3663-4e0d-bc22-109a05effe4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/7ad4494c-8fb5-42ed-9c39-a4c450d907db_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e7f80ee4-b832-4398-bead-401ee8512cbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f09c3fbe-0903-4fbd-8efa-b0f82ae6fba9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/50eb3746-08f7-4e7f-a736-cdca303c4d12_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/ee00062b-ba04-4b88-9458-dca1a3cde696_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/28fa9e83-1a5c-4b83-9537-ac9b5941629d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e34f508f-8c72-4b18-a707-17d3f6d0eb5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/4f68fab2-f04e-4be6-bc9b-da9c96f9c52f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/82547d79-7aaa-40a0-ac61-a6e2ba11b588_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/35948979-e976-4c6a-9307-b51c8434213a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5f66a6a6-bab6-42a8-9e70-1f6e63d819fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f168c1b6-2fa4-4bcb-bccd-e09beea1a947_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/b3fa3821-7a3b-4f14-99f9-c5715602c1b3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa@ 26k, 30k, 38k, 46k, 54k SD CARD + SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9bd34448-e2da-4557-ac68-09c9b3b96b2c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662004, 'registration': 'NL68JBX', 'account': 'KEN008', 'make': 'SEAT', 'model': 'ATECA DIESEL ESTATE', 'derivative': '1.6 TDI SE Technology [EZ] 5dr', 'mileage': 55430, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 144, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-09-26', 'fuel': 'Diesel', 'motExpiry': '2026-11-10', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5d137294-3663-4e0d-bc22-109a05effe4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/7ad4494c-8fb5-42ed-9c39-a4c450d907db_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e7f80ee4-b832-4398-bead-401ee8512cbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f09c3fbe-0903-4fbd-8efa-b0f82ae6fba9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/50eb3746-08f7-4e7f-a736-cdca303c4d12_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/ee00062b-ba04-4b88-9458-dca1a3cde696_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/28fa9e83-1a5c-4b83-9537-ac9b5941629d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e34f508f-8c72-4b18-a707-17d3f6d0eb5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/4f68fab2-f04e-4be6-bc9b-da9c96f9c52f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/82547d79-7aaa-40a0-ac61-a6e2ba11b588_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/35948979-e976-4c6a-9307-b51c8434213a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5f66a6a6-bab6-42a8-9e70-1f6e63d819fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f168c1b6-2fa4-4bcb-bccd-e09beea1a947_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/b3fa3821-7a3b-4f14-99f9-c5715602c1b3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa@ 26k, 30k, 38k, 46k, 54k SD CARD + SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9bd34448-e2da-4557-ac68-09c9b3b96b2c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9036fa43-3ae7-57f6-83b4-7cade4a76fb1 with identifier: 117662004
2025-12-02 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1 with scrape type 1
2025-12-02 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F5d137294-3663-4e0d-bc22-109a05effe4a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5d137294-3663-4e0d-bc22-109a05effe4a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117364905, 'registration': 'HG19YML', 'account': 'THE109', 'make': 'HYUNDAI', 'model': 'KONA HATCHBACK', 'derivative': '1.0T GDi Blue Drive Premium 5dr', 'mileage': 125819, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 102, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-04-23', 'fuel': 'Petrol', 'motExpiry': '2026-01-10', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HG19YML/2025-11-21/image/1483d20c-5f1c-47cf-964c-79e3f100a68d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/48779c8d-6373-4d0f-9850-651812ad202f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/6857f0e0-cee6-496e-baeb-c29cb0b25c12_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/d026a14f-2206-4b3a-a6a7-1ac99a49891f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/4a7dc908-05b5-4ccd-9f9a-b3f03ef2b336_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/e89362b7-e81d-4d24-a012-03b6c7bb050a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/2f4b3f6b-f079-46a0-bac3-50aed4ac6014_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/cde833cc-6d13-4ca6-abf4-1294aab30157_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/9992292c-58e7-43bb-b647-4e3628faf4d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/e11db5b5-f17f-4c85-aded-ba522ea189c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/a61fa706-df38-44f0-89ea-d2f24f7c4fa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/084fae59-63a1-4373-a6c6-c3abbfbdb010_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 08/19- 13k, 01/20- 26k, 08/20- 38k, 01/21- 50k, 06/21- 66k, ?- 87k, 03/22- 101k', 'remarks': 'vosa - 104k, 108k, 114k, 120k spare key', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/21a98ca8-f9ea-4982-8aa7-0a8d13c5c788.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117364905, 'registration': 'HG19YML', 'account': 'THE109', 'make': 'HYUNDAI', 'model': 'KONA HATCHBACK', 'derivative': '1.0T GDi Blue Drive Premium 5dr', 'mileage': 125819, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 102, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-04-23', 'fuel': 'Petrol', 'motExpiry': '2026-01-10', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HG19YML/2025-11-21/image/1483d20c-5f1c-47cf-964c-79e3f100a68d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/48779c8d-6373-4d0f-9850-651812ad202f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/6857f0e0-cee6-496e-baeb-c29cb0b25c12_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/d026a14f-2206-4b3a-a6a7-1ac99a49891f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/4a7dc908-05b5-4ccd-9f9a-b3f03ef2b336_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/e89362b7-e81d-4d24-a012-03b6c7bb050a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/2f4b3f6b-f079-46a0-bac3-50aed4ac6014_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/cde833cc-6d13-4ca6-abf4-1294aab30157_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/9992292c-58e7-43bb-b647-4e3628faf4d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/e11db5b5-f17f-4c85-aded-ba522ea189c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/a61fa706-df38-44f0-89ea-d2f24f7c4fa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG19YML/2025-11-21/image/084fae59-63a1-4373-a6c6-c3abbfbdb010_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 08/19- 13k, 01/20- 26k, 08/20- 38k, 01/21- 50k, 06/21- 66k, ?- 87k, 03/22- 101k', 'remarks': 'vosa - 104k, 108k, 114k, 120k spare key', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/21a98ca8-f9ea-4982-8aa7-0a8d13c5c788.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac417cae-f6f2-5973-9f8d-c144bf3c115d with identifier: 117364905
2025-12-02 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac417cae-f6f2-5973-9f8d-c144bf3c115d with scrape type 2
2025-12-02 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac417cae-f6f2-5973-9f8d-c144bf3c115d with scrape type 2
2025-12-02 19:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ac417cae-f6f2-5973-9f8d-c144bf3c115d, identifier: 117364905
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117117971
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117117971%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117117971: 0
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117584826
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584826%27 HTTP/1.1" 200 None
2025-12-02 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117584826: 1
2025-12-02 19:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ac417cae-f6f2-5973-9f8d-c144bf3c115d with identifier: 117364905
2025-12-02 19:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ac417cae-f6f2-5973-9f8d-c144bf3c115d with identifier: 117364905
2025-12-02 19:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'tcb group - prime', 'price_includes_vat': False, 'title': 'hyundai kona hatchback 1.0t gdi blue drive premium 5dr', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona hatchback', 'transmission': 'manual', 'engine': '1.0l', 'fuel_type': 'petrol', 'odometer': 125819, 'odometer_reading_unit': 'mi', 'registration_date': '2019-04-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364905', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '1.0t gdi blue drive premium 5dr', 'license_plate': 'hg19yml', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 127, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ac417cae-f6f2-5973-9f8d-c144bf3c115d', 'current_year_diff': 6, 'age_in_months': 79, 'make_model': 'hyundai kona hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 202485}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.0l',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'petrol',
     'id': 'ac417cae-f6f2-5973-9f8d-c144bf3c115d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'hg19yml',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364905',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'hyundai',
     'make_model': 'hyundai kona hatchback',
     'model': 'kona hatchback',
     'odometer': 125819,
     'odometer_in_km': 202485,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-04-23',
     'sanitized_make': 'hyundai',
     'seller_name': 'tcb group - prime',
     'title': 'hyundai kona hatchback 1.0t gdi blue drive premium 5dr',
     'transmission': 'manual',
     'trim': '1.0t gdi blue drive premium 5dr',
     'vin': None,
     'year': 2019}
2025-12-02 19:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: ac417cae-f6f2-5973-9f8d-c144bf3c115d spider: astonbarclay.gb
2025-12-02 19:03:24 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ac417cae-f6f2-5973-9f8d-c144bf3c115d due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'tcb group - prime', 'price_includes_vat': False, 'title': 'hyundai kona hatchback 1.0t gdi blue drive premium 5dr', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona hatchback', 'transmission': 'manual', 'engine': '1.0l', 'fuel_type': 'petrol', 'odometer': 125819, 'odometer_reading_unit': 'mi', 'registration_date': '2019-04-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364905', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '1.0t gdi blue drive premium 5dr', 'license_plate': 'hg19yml', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 127, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ac417cae-f6f2-5973-9f8d-c144bf3c115d', 'current_year_diff': 6, 'age_in_months': 79, 'make_model': 'hyundai kona hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 202485}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.0l',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'petrol',
     'id': 'ac417cae-f6f2-5973-9f8d-c144bf3c115d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'hg19yml',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364905',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'hyundai',
     'make_model': 'hyundai kona hatchback',
     'model': 'kona hatchback',
     'odometer': 125819,
     'odometer_in_km': 202485,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-04-23',
     'sanitized_make': 'hyundai',
     'seller_name': 'tcb group - prime',
     'title': 'hyundai kona hatchback 1.0t gdi blue drive premium 5dr',
     'transmission': 'manual',
     'trim': '1.0t gdi blue drive premium 5dr',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ac417cae-f6f2-5973-9f8d-c144bf3c115d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HG19YML',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364905',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HYUNDAI',
 'model': 'KONA HATCHBACK',
 'odometer': 125819,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-23',
 'seller_name': 'TCB Group - Prime',
 'title': 'HYUNDAI KONA HATCHBACK 1.0T GDi Blue Drive Premium 5dr',
 'transmission': 'manual',
 'trim': '1.0T GDi Blue Drive Premium 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364905%27 HTTP/1.1" 200 None
2025-12-02 19:03:24 [astonbarclay.gb] INFO: Saving data for 117364905: {'auction_closing_time': 1764842400.0, 'created_time': 1763751927.429669, 'last_price_update_time': 1764702204.073157}
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117364905') HTTP/1.1" 204 0
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252F863df404-cf96-49f7-bac4-cdba94a8e373_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/863df404-cf96-49f7-bac4-cdba94a8e373_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F7ad4494c-8fb5-42ed-9c39-a4c450d907db_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/7ad4494c-8fb5-42ed-9c39-a4c450d907db_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117676352?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:24 [astonbarclay.gb] INFO: Found listing with ID: 117584133
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584133%27 HTTP/1.1" 200 None
2025-12-02 19:03:24 [astonbarclay.gb] INFO: Scrape type for 117584133: 1
2025-12-02 19:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fbd6732cc-850d-418b-ae4d-1b61adcc4c2f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/bd6732cc-850d-418b-ae4d-1b61adcc4c2f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Fe7f80ee4-b832-4398-bead-401ee8512cbe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e7f80ee4-b832-4398-bead-401ee8512cbe_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117600796, 'registration': 'DY17VTG', 'account': 'PIN004', 'make': 'TOYOTA', 'model': 'RAV4 DIESEL ESTATE', 'derivative': '2.0 D-4D Business Edition TSS 5dr 2WD', 'mileage': 85376, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 125, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-03-05', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DY17VTG/2025-12-02/image/f581755d-adda-4e28-ac85-2a243c78243b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/2cdce1d0-912d-413c-a8d4-8f6f020ca5c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/1fb23770-0f7e-4efb-bb49-cd4b2cb118dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/12f025b1-a7fd-4cdb-9a77-0e7aac393e58_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/a24d7a3c-8136-487a-a690-7572708dcd31_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/82aaea9a-8df7-4867-913a-444c55b0a82c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/6a20663b-91c2-4e1a-b7a3-c756b7826cbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/a5139689-2be1-4251-b814-eff896315121_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/d09f1936-1e7b-4335-95dc-675767c84318_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/4ebc2269-f451-4519-8707-5d069c7e9cce_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/fd2a14ab-2e7f-4b7d-ab41-8437ba94fb46_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/49a3a41f-97f1-463d-aeba-39b5e8060916_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/18e5616d-f686-4359-ad2a-5bbfa20fcc2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/590fd048-6808-48a5-806a-b5a520e16729_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/ed5912dc-31f6-4825-af5d-76b82f5fac5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/af9f1849-6919-44af-9062-b9155b5b7458_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/c087c428-ad5b-43d4-8ddc-56e92b13f785_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/f599ac2d-0121-4e36-ae98-23472286f860_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/2ee815ce-5f68-49a2-9bec-0f8ef3c55580_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/18-11K, 09/19-29K, 05/20-36K, 03/22-58K', 'remarks': 'vosa@ 36k, 47k, 58k, 65k, 71k, 79k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Pinkstones', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93bec163-dcae-4fd6-8680-95adc6a6b59c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117600796, 'registration': 'DY17VTG', 'account': 'PIN004', 'make': 'TOYOTA', 'model': 'RAV4 DIESEL ESTATE', 'derivative': '2.0 D-4D Business Edition TSS 5dr 2WD', 'mileage': 85376, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 125, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-03-05', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DY17VTG/2025-12-02/image/f581755d-adda-4e28-ac85-2a243c78243b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/2cdce1d0-912d-413c-a8d4-8f6f020ca5c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/1fb23770-0f7e-4efb-bb49-cd4b2cb118dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/12f025b1-a7fd-4cdb-9a77-0e7aac393e58_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/a24d7a3c-8136-487a-a690-7572708dcd31_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/82aaea9a-8df7-4867-913a-444c55b0a82c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/6a20663b-91c2-4e1a-b7a3-c756b7826cbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/a5139689-2be1-4251-b814-eff896315121_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/d09f1936-1e7b-4335-95dc-675767c84318_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/4ebc2269-f451-4519-8707-5d069c7e9cce_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/fd2a14ab-2e7f-4b7d-ab41-8437ba94fb46_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/49a3a41f-97f1-463d-aeba-39b5e8060916_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/18e5616d-f686-4359-ad2a-5bbfa20fcc2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/590fd048-6808-48a5-806a-b5a520e16729_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/ed5912dc-31f6-4825-af5d-76b82f5fac5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/af9f1849-6919-44af-9062-b9155b5b7458_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/c087c428-ad5b-43d4-8ddc-56e92b13f785_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/f599ac2d-0121-4e36-ae98-23472286f860_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY17VTG/2025-12-02/image/2ee815ce-5f68-49a2-9bec-0f8ef3c55580_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/18-11K, 09/19-29K, 05/20-36K, 03/22-58K', 'remarks': 'vosa@ 36k, 47k, 58k, 65k, 71k, 79k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Pinkstones', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93bec163-dcae-4fd6-8680-95adc6a6b59c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a240bfd8-36bb-54a8-85c8-73f091b50830 with identifier: 117600796
2025-12-02 19:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a240bfd8-36bb-54a8-85c8-73f091b50830 with scrape type 2
2025-12-02 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a240bfd8-36bb-54a8-85c8-73f091b50830 with scrape type 2
2025-12-02 19:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a240bfd8-36bb-54a8-85c8-73f091b50830, identifier: 117600796
2025-12-02 19:03:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117514814, 'registration': 'YK66YFW', 'account': 'THE109', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E220d SE 4dr 9G-Tronic', 'mileage': 98880, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 107, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-09-27', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YK66YFW/2025-12-01/image/f7782562-1e82-4a54-9812-b3869ab97155_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/474246eb-b43c-4665-ad56-a4d502c47951_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/6631a63e-3778-4847-b766-d4ec930f6356_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/d04cf419-0bda-41aa-94d6-90be644718ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/181dd9f2-f890-4a26-a6a3-4a0f1f8835ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/c861b254-b4f3-40ae-a305-a06aeb9b1388_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/13547b34-7cd7-4f38-b5b6-815a656916e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/7be972ea-b984-4543-90ad-b4895414d86d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/a29dcb17-4372-438b-b64a-baf79324e655_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service invoice 05/17-16K, 02/18-31K, 01/19-46K, 11/19-62K, 11/20-77K, 12/22-??, 11/25-??', 'remarks': 'vosa - 59k, 74k, 87k, 89k, 91k, 93k, 94k SPARE KEY + SD CARD IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 102, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ac47475-1aa5-4bdb-872c-a0c75d4f8d88.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117514814, 'registration': 'YK66YFW', 'account': 'THE109', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E220d SE 4dr 9G-Tronic', 'mileage': 98880, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 107, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-09-27', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YK66YFW/2025-12-01/image/f7782562-1e82-4a54-9812-b3869ab97155_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/474246eb-b43c-4665-ad56-a4d502c47951_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/6631a63e-3778-4847-b766-d4ec930f6356_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/d04cf419-0bda-41aa-94d6-90be644718ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/181dd9f2-f890-4a26-a6a3-4a0f1f8835ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/c861b254-b4f3-40ae-a305-a06aeb9b1388_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/13547b34-7cd7-4f38-b5b6-815a656916e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/7be972ea-b984-4543-90ad-b4895414d86d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK66YFW/2025-12-01/image/a29dcb17-4372-438b-b64a-baf79324e655_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service invoice 05/17-16K, 02/18-31K, 01/19-46K, 11/19-62K, 11/20-77K, 12/22-??, 11/25-??', 'remarks': 'vosa - 59k, 74k, 87k, 89k, 91k, 93k, 94k SPARE KEY + SD CARD IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 102, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ac47475-1aa5-4bdb-872c-a0c75d4f8d88.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7be57d0-6d04-5d29-8c17-a844de556e61 with identifier: 117514814
2025-12-02 19:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7be57d0-6d04-5d29-8c17-a844de556e61 with scrape type 2
2025-12-02 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7be57d0-6d04-5d29-8c17-a844de556e61 with scrape type 2
2025-12-02 19:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b7be57d0-6d04-5d29-8c17-a844de556e61, identifier: 117514814
2025-12-02 19:03:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117506955, 'registration': 'DL19ZKC', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'GRANDLAND X DIESEL HATCHBACK', 'derivative': '1.5 Turbo D SE 5dr', 'mileage': 145025, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 106, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-02', 'fuel': 'Diesel', 'motExpiry': '2026-04-04', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/b27ced25-a186-478c-bf18-48aefd23ca6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/8e7e41f1-aa25-4578-9c5f-9875ea8bc3db_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/89cc3278-d65f-4c06-934a-f66c49f7d6e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/fce6c6fc-0695-4da1-80e9-2c923ee0798c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/719ef19f-943e-418c-a0cb-cda624c457d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/bd842aa1-5779-491e-ad4a-37f098eccfff_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/e3cf25f5-5907-44b0-ad40-1f92fcac01e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/ae115c4e-e3aa-4f70-afc7-c7269e62f9ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/1d3a6de0-12e1-4a55-bfd1-cc6a6ed32fa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/6b52f6b3-d0ca-441c-88a3-9e51e56be360_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/54fd345e-9145-4ef2-a348-8a6c152b43b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/d50242a9-09d7-4a87-bcf9-33d23f574523_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/bb65ed25-a883-43e5-b1ed-ca9cdd6c9197_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/39507369-4b98-4a7d-9229-bc1ccd70a47b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/e391aff4-1d2d-4dd9-a029-02dedae373d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/788f7482-ad9b-467c-8c29-90da9701da90_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/108ff1ac-16e0-4caf-9019-b31e93f443ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/441037bc-698c-48e4-8f54-60b2d2eefc42_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/2102b4fc-2ba3-4400-82b2-dc2d141efb98_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/19-21K, 04/20-40K, 10/20-59K, 09/21-81K, 02/22-93K, 02/23-117K', 'remarks': 'vosa - 98k, 117k, 132k, 138k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5718dfe3-07e5-4bb3-9d77-ce67fcc32ed9.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117506955, 'registration': 'DL19ZKC', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'GRANDLAND X DIESEL HATCHBACK', 'derivative': '1.5 Turbo D SE 5dr', 'mileage': 145025, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 106, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-02', 'fuel': 'Diesel', 'motExpiry': '2026-04-04', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/b27ced25-a186-478c-bf18-48aefd23ca6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/8e7e41f1-aa25-4578-9c5f-9875ea8bc3db_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/89cc3278-d65f-4c06-934a-f66c49f7d6e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/fce6c6fc-0695-4da1-80e9-2c923ee0798c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/719ef19f-943e-418c-a0cb-cda624c457d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/bd842aa1-5779-491e-ad4a-37f098eccfff_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/e3cf25f5-5907-44b0-ad40-1f92fcac01e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/ae115c4e-e3aa-4f70-afc7-c7269e62f9ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/1d3a6de0-12e1-4a55-bfd1-cc6a6ed32fa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/6b52f6b3-d0ca-441c-88a3-9e51e56be360_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/54fd345e-9145-4ef2-a348-8a6c152b43b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/d50242a9-09d7-4a87-bcf9-33d23f574523_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/bb65ed25-a883-43e5-b1ed-ca9cdd6c9197_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/39507369-4b98-4a7d-9229-bc1ccd70a47b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/e391aff4-1d2d-4dd9-a029-02dedae373d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/788f7482-ad9b-467c-8c29-90da9701da90_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/108ff1ac-16e0-4caf-9019-b31e93f443ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/441037bc-698c-48e4-8f54-60b2d2eefc42_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL19ZKC/2025-12-01/image/2102b4fc-2ba3-4400-82b2-dc2d141efb98_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/19-21K, 04/20-40K, 10/20-59K, 09/21-81K, 02/22-93K, 02/23-117K', 'remarks': 'vosa - 98k, 117k, 132k, 138k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5718dfe3-07e5-4bb3-9d77-ce67fcc32ed9.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051 with identifier: 117506955
2025-12-02 19:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051 with scrape type 2
2025-12-02 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051 with scrape type 2
2025-12-02 19:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051, identifier: 117506955
2025-12-02 19:03:24 [astonbarclay.gb] INFO: Found listing with ID: 117458227
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458227%27 HTTP/1.1" 200 None
2025-12-02 19:03:24 [astonbarclay.gb] INFO: Scrape type for 117458227: 1
2025-12-02 19:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a240bfd8-36bb-54a8-85c8-73f091b50830 with identifier: 117600796
2025-12-02 19:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a240bfd8-36bb-54a8-85c8-73f091b50830 with identifier: 117600796
2025-12-02 19:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a240bfd8-36bb-54a8-85c8-73f091b50830 with identifier: 117600796 to the API
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a240bfd8-36bb-54a8-85c8-73f091b50830%27 HTTP/1.1" 200 None
2025-12-02 19:03:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a240bfd8-36bb-54a8-85c8-73f091b50830: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117600796?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'a240bfd8-36bb-54a8-85c8-73f091b50830',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DY17VTG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600796',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'TOYOTA',
 'model': 'RAV4 DIESEL ESTATE',
 'odometer': 85376,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': 'Pinkstones',
 'title': 'TOYOTA RAV4 DIESEL ESTATE 2.0 D-4D Business Edition TSS 5dr 2WD',
 'transmission': 'manual',
 'trim': '2.0 D-4D Business Edition TSS 5dr 2WD',
 'vin': None,
 'year': 2017}
2025-12-02 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600796%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [astonbarclay.gb] INFO: Saving data for 117600796: {'auction_closing_time': 1764842400.0, 'created_time': 1764356579.572251, 'last_price_update_time': 1764702205.001848}
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117600796') HTTP/1.1" 204 0
2025-12-02 19:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b7be57d0-6d04-5d29-8c17-a844de556e61 with identifier: 117514814
2025-12-02 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b7be57d0-6d04-5d29-8c17-a844de556e61 with identifier: 117514814
2025-12-02 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159131 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159131
2025-12-02 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b7be57d0-6d04-5d29-8c17-a844de556e61 spider: astonbarclay.gb
2025-12-02 19:03:25 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b7be57d0-6d04-5d29-8c17-a844de556e61 due to rule: high_mileage_for_country.json, error: 159131 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159131
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b7be57d0-6d04-5d29-8c17-a844de556e61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YK66YFW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117514814',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS DIESEL SALOON',
 'odometer': 98880,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-27',
 'seller_name': 'TCB Group - Prime',
 'title': 'MERCEDES-BENZ E CLASS DIESEL SALOON E220d SE 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'E220d SE 4dr 9G-Tronic',
 'vin': None,
 'year': 2016}
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514814%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [astonbarclay.gb] INFO: Saving data for 117514814: {'auction_closing_time': 1764842400.0, 'created_time': 1764356584.293516, 'last_price_update_time': 1764702205.222154}
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117514814') HTTP/1.1" 204 0
2025-12-02 19:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051 with identifier: 117506955
2025-12-02 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051 with identifier: 117506955
2025-12-02 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'tcb group - prime', 'price_includes_vat': False, 'title': 'vauxhall grandland x diesel hatchback 1.5 turbo d se 5dr', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'grandland x diesel hatchback', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 145025, 'odometer_reading_unit': 'mi', 'registration_date': '2019-05-02', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117506955', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '1.5 turbo d se 5dr', 'license_plate': 'dl19zkc', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 111, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051', 'current_year_diff': 6, 'age_in_months': 79, 'make_model': 'vauxhall grandland x diesel hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 233394}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 111,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'diesel',
     'id': '9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'dl19zkc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117506955',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'vauxhall',
     'make_model': 'vauxhall grandland x diesel hatchback',
     'model': 'grandland x diesel hatchback',
     'odometer': 145025,
     'odometer_in_km': 233394,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-05-02',
     'sanitized_make': 'vauxhall',
     'seller_name': 'tcb group - prime',
     'title': 'vauxhall grandland x diesel hatchback 1.5 turbo d se 5dr',
     'transmission': 'manual',
     'trim': '1.5 turbo d se 5dr',
     'vin': None,
     'year': 2019}
2025-12-02 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051 spider: astonbarclay.gb
2025-12-02 19:03:25 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'tcb group - prime', 'price_includes_vat': False, 'title': 'vauxhall grandland x diesel hatchback 1.5 turbo d se 5dr', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'grandland x diesel hatchback', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 145025, 'odometer_reading_unit': 'mi', 'registration_date': '2019-05-02', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117506955', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '1.5 turbo d se 5dr', 'license_plate': 'dl19zkc', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 111, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051', 'current_year_diff': 6, 'age_in_months': 79, 'make_model': 'vauxhall grandland x diesel hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 233394}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 111,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'diesel',
     'id': '9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'dl19zkc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117506955',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'vauxhall',
     'make_model': 'vauxhall grandland x diesel hatchback',
     'model': 'grandland x diesel hatchback',
     'odometer': 145025,
     'odometer_in_km': 233394,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-05-02',
     'sanitized_make': 'vauxhall',
     'seller_name': 'tcb group - prime',
     'title': 'vauxhall grandland x diesel hatchback 1.5 turbo d se 5dr',
     'transmission': 'manual',
     'trim': '1.5 turbo d se 5dr',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9bfb8f53-f7e1-5bba-8a3b-4125d1eb7051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DL19ZKC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117506955',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND X DIESEL HATCHBACK',
 'odometer': 145025,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-02',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL GRANDLAND X DIESEL HATCHBACK 1.5 Turbo D SE 5dr',
 'transmission': 'manual',
 'trim': '1.5 Turbo D SE 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506955%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [astonbarclay.gb] INFO: Saving data for 117506955: {'auction_closing_time': 1764842400.0, 'created_time': 1764356587.394224, 'last_price_update_time': 1764702205.433791}
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117506955') HTTP/1.1" 204 0
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Ff92a86b4-4cf3-4a58-b643-b9b875b16321_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f92a86b4-4cf3-4a58-b643-b9b875b16321_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Ff09c3fbe-0903-4fbd-8efa-b0f82ae6fba9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f09c3fbe-0903-4fbd-8efa-b0f82ae6fba9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:25 [astonbarclay.gb] INFO: Found listing with ID: 117571604
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571604%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [astonbarclay.gb] INFO: Scrape type for 117571604: 1
2025-12-02 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117600118?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117600165?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584308?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117676352, 'registration': 'AJ72MWF', 'account': 'PIN011', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'RWD 5dr Auto', 'mileage': 15014, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 126, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-12-13', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Pinkstones', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117676352, 'registration': 'AJ72MWF', 'account': 'PIN011', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'RWD 5dr Auto', 'mileage': 15014, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 126, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-12-13', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Pinkstones', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb59dfe3-44f4-5fa8-a6fa-3a691f1f2e0b with identifier: 117676352
2025-12-02 19:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb59dfe3-44f4-5fa8-a6fa-3a691f1f2e0b with scrape type 1
2025-12-02 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item eb59dfe3-44f4-5fa8-a6fa-3a691f1f2e0b
2025-12-02 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item eb59dfe3-44f4-5fa8-a6fa-3a691f1f2e0b
2025-12-02 19:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eb59dfe3-44f4-5fa8-a6fa-3a691f1f2e0b, identifier: 117676352
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Feb7ce05f-923f-428a-acde-7145d9a17118_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/eb7ce05f-923f-428a-acde-7145d9a17118_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F50eb3746-08f7-4e7f-a736-cdca303c4d12_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/50eb3746-08f7-4e7f-a736-cdca303c4d12_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eb59dfe3-44f4-5fa8-a6fa-3a691f1f2e0b with identifier: 117676352
2025-12-02 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eb59dfe3-44f4-5fa8-a6fa-3a691f1f2e0b with identifier: 117676352
2025-12-02 19:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: eb59dfe3-44f4-5fa8-a6fa-3a691f1f2e0b with identifier: 117676352 to the API
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27eb59dfe3-44f4-5fa8-a6fa-3a691f1f2e0b%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id eb59dfe3-44f4-5fa8-a6fa-3a691f1f2e0b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117676352?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'eb59dfe3-44f4-5fa8-a6fa-3a691f1f2e0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AJ72MWF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117676352',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'TESLA',
 'model': 'MODEL Y HATCHBACK',
 'odometer': 15014,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-13',
 'seller_name': 'Pinkstones',
 'title': 'TESLA MODEL Y HATCHBACK RWD 5dr Auto',
 'transmission': 'automatic',
 'trim': 'RWD 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117676352%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [astonbarclay.gb] INFO: Saving data for 117676352: {'created_time': 1764702205.912998, 'last_price_update_time': 1764702205.913008, 'auction_closing_time': 1764842400.0}
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117676352') HTTP/1.1" 204 0
2025-12-02 19:03:25 [astonbarclay.gb] INFO: Found listing with ID: 117473837
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117473837%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [astonbarclay.gb] INFO: Scrape type for 117473837: 1
2025-12-02 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/7ad4494c-8fb5-42ed-9c39-a4c450d907db_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252F65bc4fc5-1f03-4556-bb7c-a583debfffe7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/65bc4fc5-1f03-4556-bb7c-a583debfffe7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Fee00062b-ba04-4b88-9458-dca1a3cde696_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/ee00062b-ba04-4b88-9458-dca1a3cde696_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:25 [astonbarclay.gb] INFO: Found listing with ID: 117143069
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117143069%27 HTTP/1.1" 200 None
2025-12-02 19:03:26 [astonbarclay.gb] INFO: Scrape type for 117143069: 2
2025-12-02 19:03:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117600118, 'registration': 'CP66OUA', 'account': 'ART001', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 110 Allure 5dr', 'mileage': 66038, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 161, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-12-16', 'fuel': 'Petrol', 'motExpiry': '2026-11-20', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 26k 31k 36k 43k 50k 52k 60k 66k', 'virtual': False, 'seller': 'Arthurs Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117600118, 'registration': 'CP66OUA', 'account': 'ART001', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 110 Allure 5dr', 'mileage': 66038, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 161, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-12-16', 'fuel': 'Petrol', 'motExpiry': '2026-11-20', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 26k 31k 36k 43k 50k 52k 60k 66k', 'virtual': False, 'seller': 'Arthurs Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a805ca9-6176-5d34-b037-aaf7836f7582 with identifier: 117600118
2025-12-02 19:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a805ca9-6176-5d34-b037-aaf7836f7582 with scrape type 1
2025-12-02 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6a805ca9-6176-5d34-b037-aaf7836f7582
2025-12-02 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6a805ca9-6176-5d34-b037-aaf7836f7582
2025-12-02 19:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6a805ca9-6176-5d34-b037-aaf7836f7582, identifier: 117600118
2025-12-02 19:03:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117600165, 'registration': 'SE16KCN', 'account': 'ART001', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper 5dr', 'mileage': 99398, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 163, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-06', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 39k 48k 49k 58k 67k 79k 91k', 'virtual': False, 'seller': 'Arthurs Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117600165, 'registration': 'SE16KCN', 'account': 'ART001', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper 5dr', 'mileage': 99398, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 163, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-06', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 39k 48k 49k 58k 67k 79k 91k', 'virtual': False, 'seller': 'Arthurs Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e97f9306-03cf-52c3-b712-34193571a9a2 with identifier: 117600165
2025-12-02 19:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e97f9306-03cf-52c3-b712-34193571a9a2 with scrape type 1
2025-12-02 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e97f9306-03cf-52c3-b712-34193571a9a2
2025-12-02 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e97f9306-03cf-52c3-b712-34193571a9a2
2025-12-02 19:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e97f9306-03cf-52c3-b712-34193571a9a2, identifier: 117600165
2025-12-02 19:03:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662061, 'registration': 'DT66HCG', 'account': 'KEN008', 'make': 'SUZUKI', 'model': 'IGNIS HATCHBACK', 'derivative': '1.2 Dualjet SHVS SZ5 ALLGRIP 5dr', 'mileage': 19459, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 145, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-01-29', 'fuel': 'Petrol', 'motExpiry': '2026-01-28', 'doors': 5, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DT66HCG/2025-12-02/image/42114b84-8030-460e-8f99-7b60c133cd66_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/2323e321-f80b-4c33-b04b-b389ac7b4374_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/5e7299c4-9b38-4ce5-81c1-bcbeb579adb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/88281e3e-d9b3-4a42-a5b3-e1b700c739f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/44ac9e17-e096-4a4e-9e3f-942d244de5c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/f0ea1203-fa13-4729-bd6c-24039de07c24_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/51b3ed8c-926f-4f07-93d2-f643ddce9cc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/773f1439-4679-4989-8df0-f6695895c7a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/09f48a99-c714-4322-a7eb-bb2d8cdd9963_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/6d670a03-f832-484f-8cc5-3c92855b351a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/ff0af178-05d4-4ef8-8a70-515eb742a0b8_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/18-3K, 01/19-7K, 01/20-11K, 02/21-12K, 01/22-13K, 01/23-15K, 01/24-16K', 'remarks': 'vosa@ 11k, 12k, 13k, 15k, 16k, 18k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5d829d3b-4cf6-4f9d-8968-ad031fe492ba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662061, 'registration': 'DT66HCG', 'account': 'KEN008', 'make': 'SUZUKI', 'model': 'IGNIS HATCHBACK', 'derivative': '1.2 Dualjet SHVS SZ5 ALLGRIP 5dr', 'mileage': 19459, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 145, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-01-29', 'fuel': 'Petrol', 'motExpiry': '2026-01-28', 'doors': 5, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DT66HCG/2025-12-02/image/42114b84-8030-460e-8f99-7b60c133cd66_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/2323e321-f80b-4c33-b04b-b389ac7b4374_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/5e7299c4-9b38-4ce5-81c1-bcbeb579adb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/88281e3e-d9b3-4a42-a5b3-e1b700c739f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/44ac9e17-e096-4a4e-9e3f-942d244de5c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/f0ea1203-fa13-4729-bd6c-24039de07c24_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/51b3ed8c-926f-4f07-93d2-f643ddce9cc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/773f1439-4679-4989-8df0-f6695895c7a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/09f48a99-c714-4322-a7eb-bb2d8cdd9963_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/6d670a03-f832-484f-8cc5-3c92855b351a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/ff0af178-05d4-4ef8-8a70-515eb742a0b8_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/18-3K, 01/19-7K, 01/20-11K, 02/21-12K, 01/22-13K, 01/23-15K, 01/24-16K', 'remarks': 'vosa@ 11k, 12k, 13k, 15k, 16k, 18k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5d829d3b-4cf6-4f9d-8968-ad031fe492ba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11303b88-fb35-5bef-8d98-38e213a77f32 with identifier: 117662061
2025-12-02 19:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11303b88-fb35-5bef-8d98-38e213a77f32 with scrape type 1
2025-12-02 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F42114b84-8030-460e-8f99-7b60c133cd66_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/42114b84-8030-460e-8f99-7b60c133cd66_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584308, 'registration': 'SG16KBU', 'account': 'ARN027', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.2 TCE Dynamique Nav 5dr', 'mileage': 66801, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 23, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-07', 'fuel': 'Petrol', 'motExpiry': '2026-03-11', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SG16KBU/2025-12-01/image/2370a9e7-fa07-44ca-bd43-7a7a7707c9fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/290b2cbd-c783-416e-905f-69205f68018a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/8ebe43be-2425-4fd4-9391-07155dc6fab3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/03569a55-bcab-4ea3-8025-bafa34b2fed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/1f39c9f0-90d8-4cfe-beb5-84251c9e92bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/18b2d6c6-e286-4a82-86e0-b4a98bd8991e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/d602e608-0362-42bf-93cf-bf272b6a8033_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/c7bda6df-6ed8-4909-ae82-36735d29676b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/1018581c-be2f-4350-a795-647084338537_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/fd468b67-d2d3-4780-a4da-37b8f659973f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/12-6k 03/18-12k 03/19-19k03/20-27k', 'remarks': 'vosa@ 18k, 27k, 32k, 41k, 48k, 55k, 63k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/56420e5c-004c-48da-9770-ce25f8ffeb5c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584308, 'registration': 'SG16KBU', 'account': 'ARN027', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.2 TCE Dynamique Nav 5dr', 'mileage': 66801, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 23, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-07', 'fuel': 'Petrol', 'motExpiry': '2026-03-11', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SG16KBU/2025-12-01/image/2370a9e7-fa07-44ca-bd43-7a7a7707c9fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/290b2cbd-c783-416e-905f-69205f68018a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/8ebe43be-2425-4fd4-9391-07155dc6fab3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/03569a55-bcab-4ea3-8025-bafa34b2fed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/1f39c9f0-90d8-4cfe-beb5-84251c9e92bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/18b2d6c6-e286-4a82-86e0-b4a98bd8991e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/d602e608-0362-42bf-93cf-bf272b6a8033_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/c7bda6df-6ed8-4909-ae82-36735d29676b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/1018581c-be2f-4350-a795-647084338537_removebg.jpg?w=600', 'https://abimg003.imgix.net/SG16KBU/2025-12-01/image/fd468b67-d2d3-4780-a4da-37b8f659973f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/12-6k 03/18-12k 03/19-19k03/20-27k', 'remarks': 'vosa@ 18k, 27k, 32k, 41k, 48k, 55k, 63k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/56420e5c-004c-48da-9770-ce25f8ffeb5c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab4db58-a7be-56d8-8572-716c77de3fbf with identifier: 117584308
2025-12-02 19:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab4db58-a7be-56d8-8572-716c77de3fbf with scrape type 2
2025-12-02 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ab4db58-a7be-56d8-8572-716c77de3fbf with scrape type 2
2025-12-02 19:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4ab4db58-a7be-56d8-8572-716c77de3fbf, identifier: 117584308
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fa6809671-ebbc-4657-85ef-efaa94845cdb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/a6809671-ebbc-4657-85ef-efaa94845cdb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F28fa9e83-1a5c-4b83-9537-ac9b5941629d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/28fa9e83-1a5c-4b83-9537-ac9b5941629d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6a805ca9-6176-5d34-b037-aaf7836f7582 with identifier: 117600118
2025-12-02 19:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6a805ca9-6176-5d34-b037-aaf7836f7582 with identifier: 117600118
2025-12-02 19:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6a805ca9-6176-5d34-b037-aaf7836f7582 with identifier: 117600118 to the API
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276a805ca9-6176-5d34-b037-aaf7836f7582%27 HTTP/1.1" 200 None
2025-12-02 19:03:26 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6a805ca9-6176-5d34-b037-aaf7836f7582: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:25 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117600118?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6a805ca9-6176-5d34-b037-aaf7836f7582',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CP66OUA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600118',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 66038,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-16',
 'seller_name': 'Arthurs Motor Group',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech 110 Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 110 Allure 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600118%27 HTTP/1.1" 200 None
2025-12-02 19:03:26 [astonbarclay.gb] INFO: Saving data for 117600118: {'created_time': 1764702206.623429, 'last_price_update_time': 1764702206.623438, 'auction_closing_time': 1764842400.0}
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117600118') HTTP/1.1" 204 0
2025-12-02 19:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e97f9306-03cf-52c3-b712-34193571a9a2 with identifier: 117600165
2025-12-02 19:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e97f9306-03cf-52c3-b712-34193571a9a2 with identifier: 117600165
2025-12-02 19:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159965 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159965
2025-12-02 19:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e97f9306-03cf-52c3-b712-34193571a9a2 spider: astonbarclay.gb
2025-12-02 19:03:26 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e97f9306-03cf-52c3-b712-34193571a9a2 due to rule: high_mileage_for_country.json, error: 159965 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159965
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e97f9306-03cf-52c3-b712-34193571a9a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SE16KCN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600165',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 99398,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-31',
 'seller_name': 'Arthurs Motor Group',
 'title': 'MINI HATCHBACK 1.5 Cooper 5dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600165%27 HTTP/1.1" 200 None
2025-12-02 19:03:26 [astonbarclay.gb] INFO: Saving data for 117600165: {'created_time': 1764702206.843323, 'last_price_update_time': 1764702206.843332, 'auction_closing_time': 1764842400.0}
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117600165') HTTP/1.1" 204 0
2025-12-02 19:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4ab4db58-a7be-56d8-8572-716c77de3fbf with identifier: 117584308
2025-12-02 19:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4ab4db58-a7be-56d8-8572-716c77de3fbf with identifier: 117584308
2025-12-02 19:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4ab4db58-a7be-56d8-8572-716c77de3fbf with identifier: 117584308 to the API
2025-12-02 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274ab4db58-a7be-56d8-8572-716c77de3fbf%27 HTTP/1.1" 200 None
2025-12-02 19:03:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4ab4db58-a7be-56d8-8572-716c77de3fbf: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584308?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4ab4db58-a7be-56d8-8572-716c77de3fbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SG16KBU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584308',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'RENAULT',
 'model': 'KADJAR HATCHBACK',
 'odometer': 66801,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-07',
 'seller_name': 'Arnold Clark',
 'title': 'RENAULT KADJAR HATCHBACK 1.2 TCE Dynamique Nav 5dr',
 'transmission': 'manual',
 'trim': '1.2 TCE Dynamique Nav 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584308%27 HTTP/1.1" 200 None
2025-12-02 19:03:27 [astonbarclay.gb] INFO: Saving data for 117584308: {'auction_closing_time': 1764842400.0, 'created_time': 1764356587.062529, 'last_price_update_time': 1764702207.116881}
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584308') HTTP/1.1" 204 0
2025-12-02 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f92a86b4-4cf3-4a58-b643-b9b875b16321_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f09c3fbe-0903-4fbd-8efa-b0f82ae6fba9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:27 [astonbarclay.gb] INFO: Found listing with ID: 117101420
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101420%27 HTTP/1.1" 200 None
2025-12-02 19:03:27 [astonbarclay.gb] INFO: Scrape type for 117101420: 1
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F2323e321-f80b-4c33-b04b-b389ac7b4374_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/2323e321-f80b-4c33-b04b-b389ac7b4374_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/50eb3746-08f7-4e7f-a736-cdca303c4d12_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Ff7c3ff6c-7664-4e92-a411-fea4d8c0cdc6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f7c3ff6c-7664-4e92-a411-fea4d8c0cdc6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Fe34f508f-8c72-4b18-a707-17d3f6d0eb5f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e34f508f-8c72-4b18-a707-17d3f6d0eb5f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117571526?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117403071?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117085617?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08fab90>
2025-12-02 19:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F7ad4494c-8fb5-42ed-9c39-a4c450d907db_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/7ad4494c-8fb5-42ed-9c39-a4c450d907db_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:27 [astonbarclay.gb] INFO: Found listing with ID: 117574882
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117574882%27 HTTP/1.1" 200 None
2025-12-02 19:03:27 [astonbarclay.gb] INFO: Scrape type for 117574882: 1
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F5e7299c4-9b38-4ce5-81c1-bcbeb579adb1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/5e7299c4-9b38-4ce5-81c1-bcbeb579adb1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117523804?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252F260d71ec-5b29-4b5e-b035-37900241a482_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/260d71ec-5b29-4b5e-b035-37900241a482_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F4f68fab2-f04e-4be6-bc9b-da9c96f9c52f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/4f68fab2-f04e-4be6-bc9b-da9c96f9c52f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090ead0>
2025-12-02 19:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Ff92a86b4-4cf3-4a58-b643-b9b875b16321_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f92a86b4-4cf3-4a58-b643-b9b875b16321_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0464950>
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Ff09c3fbe-0903-4fbd-8efa-b0f82ae6fba9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f09c3fbe-0903-4fbd-8efa-b0f82ae6fba9_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:28 [astonbarclay.gb] INFO: Found listing with ID: 117662175
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662175%27 HTTP/1.1" 200 None
2025-12-02 19:03:28 [astonbarclay.gb] INFO: Scrape type for 117662175: 1
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F88281e3e-d9b3-4a42-a5b3-e1b700c739f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/88281e3e-d9b3-4a42-a5b3-e1b700c739f1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08fb710>
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F50eb3746-08f7-4e7f-a736-cdca303c4d12_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/50eb3746-08f7-4e7f-a736-cdca303c4d12_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117571526, 'registration': 'DW19ZVN', 'account': 'GAT003', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2T [130] Elite 5dr [Start Stop]', 'mileage': 49828, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 181, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-25', 'fuel': 'Petrol', 'motExpiry': '2026-02-01', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/7b691f6e-735b-48ac-b3e8-d79cadefd150_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/28ae7cd0-f84f-462a-9d0b-830e30564f11_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/0e18c514-0476-4cb1-b1fb-102d70530c05_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/beb86b3f-c380-45a5-8ecb-6a5646057ac6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/cb57d407-a3b4-4f7f-a82e-22b9b5ff910c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/ab75943d-e802-492c-af97-89f05235e70c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/2ad24b06-de7e-4114-8853-e0b2fc42961c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/d508b833-aa2d-423f-a001-2030abbbfd24_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/364b257e-46c4-408c-b6e2-c479f9052c82_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/60750d31-42d6-4d4c-9139-40f5f5d3b066_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/528ba004-bfd2-457a-9f40-badf0ba7bf6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/f654d887-7427-41bb-bd35-8c0af1f57b83_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 02/25-46K', 'remarks': 'vosa @ 20k 32k 42k 46k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gateway Peugeot', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc7d4bf1-9652-480b-acf6-eb23e8418265.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117571526, 'registration': 'DW19ZVN', 'account': 'GAT003', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2T [130] Elite 5dr [Start Stop]', 'mileage': 49828, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 181, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-25', 'fuel': 'Petrol', 'motExpiry': '2026-02-01', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/7b691f6e-735b-48ac-b3e8-d79cadefd150_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/28ae7cd0-f84f-462a-9d0b-830e30564f11_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/0e18c514-0476-4cb1-b1fb-102d70530c05_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/beb86b3f-c380-45a5-8ecb-6a5646057ac6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/cb57d407-a3b4-4f7f-a82e-22b9b5ff910c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/ab75943d-e802-492c-af97-89f05235e70c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/2ad24b06-de7e-4114-8853-e0b2fc42961c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/d508b833-aa2d-423f-a001-2030abbbfd24_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/364b257e-46c4-408c-b6e2-c479f9052c82_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/60750d31-42d6-4d4c-9139-40f5f5d3b066_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/528ba004-bfd2-457a-9f40-badf0ba7bf6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DW19ZVN/2025-12-02/image/f654d887-7427-41bb-bd35-8c0af1f57b83_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 02/25-46K', 'remarks': 'vosa @ 20k 32k 42k 46k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gateway Peugeot', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc7d4bf1-9652-480b-acf6-eb23e8418265.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dade69f-058b-522a-9eff-ddb0cfd5df46 with identifier: 117571526
2025-12-02 19:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dade69f-058b-522a-9eff-ddb0cfd5df46 with scrape type 2
2025-12-02 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dade69f-058b-522a-9eff-ddb0cfd5df46 with scrape type 2
2025-12-02 19:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1dade69f-058b-522a-9eff-ddb0cfd5df46, identifier: 117571526
2025-12-02 19:03:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117403071, 'registration': 'DG67YLN', 'account': 'CHE004', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 GDi Blue Drive SE Nav 5dr 2WD', 'mileage': 54336, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 201, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-09-08', 'fuel': 'Petrol', 'motExpiry': '2026-09-10', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DG67YLN/2025-11-21/image/629a3bae-4da4-410a-a75e-b328e2dfe4c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/86c25d0e-f39b-443b-b80d-3e7a41729273_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/ed3dd262-e302-4aca-a602-a6bcc0120683_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/be1e29cf-db8c-4b3f-98d9-bee6513d2842_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/b1b0c8c3-a9ee-4538-97e8-796386cabf42_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/223f2d06-8e7e-45cc-8bb1-62178d4778d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/81ba0b0a-4881-4a28-a4a8-ea23d8d4545c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/74ab8923-8d4e-429d-9530-1434f1ac69b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/19715bc7-6ddd-486a-bcf3-b11a21b5a74f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/f8893eb8-e665-4e33-a81e-b4ac51483531_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/6512a567-cbe4-4111-9c48-e3ecde3875c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/292d7c37-045f-43bb-a161-8ac5a42cc13d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/87e725ab-2b77-494c-be0f-04f1b159fde3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/0462ffa9-74c8-4ddc-8af3-0ce67bf980f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/b7e64452-2023-4b3f-bbc4-88bce9b88895_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/103c1294-eafe-4ff0-9ef8-6a4b9f5284cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/8f60c620-e9e8-4243-9b5d-3d006a192a57_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/88ba9222-4815-47b8-8d0d-f834df60ad4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/fd8477cd-9fc6-41a8-9369-80996fd528a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/c4496aea-ce92-4372-be60-8ec558f17320_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/38de8612-5971-47c4-b1c8-e39d45db8a1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/b5ca9aec-9a15-400a-98da-cb4a8ecc4752_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/d38606a5-6eae-4d95-bd6b-81015ab2c661_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/d9f79359-6aa5-4d24-9efc-a98bfec773df_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/b13dda39-a4f0-49cc-ad91-d0263621b753_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 09/18-6k 10/19-13k 08/20-17k 06/21-20k 06/22-28k 06/23-35k 06/24-42k 06/25-50k', 'remarks': 'vosa - 17k, 20k, 28k, 35k, 42k, 50k, 51k back page of v5 only', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1c942c11-8f7d-417e-b46a-a8f3b3f7770c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117403071, 'registration': 'DG67YLN', 'account': 'CHE004', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 GDi Blue Drive SE Nav 5dr 2WD', 'mileage': 54336, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 201, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-09-08', 'fuel': 'Petrol', 'motExpiry': '2026-09-10', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DG67YLN/2025-11-21/image/629a3bae-4da4-410a-a75e-b328e2dfe4c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/86c25d0e-f39b-443b-b80d-3e7a41729273_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/ed3dd262-e302-4aca-a602-a6bcc0120683_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/be1e29cf-db8c-4b3f-98d9-bee6513d2842_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/b1b0c8c3-a9ee-4538-97e8-796386cabf42_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/223f2d06-8e7e-45cc-8bb1-62178d4778d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/81ba0b0a-4881-4a28-a4a8-ea23d8d4545c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/74ab8923-8d4e-429d-9530-1434f1ac69b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/19715bc7-6ddd-486a-bcf3-b11a21b5a74f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/f8893eb8-e665-4e33-a81e-b4ac51483531_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/6512a567-cbe4-4111-9c48-e3ecde3875c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/292d7c37-045f-43bb-a161-8ac5a42cc13d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/87e725ab-2b77-494c-be0f-04f1b159fde3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/0462ffa9-74c8-4ddc-8af3-0ce67bf980f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/b7e64452-2023-4b3f-bbc4-88bce9b88895_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/103c1294-eafe-4ff0-9ef8-6a4b9f5284cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/8f60c620-e9e8-4243-9b5d-3d006a192a57_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/88ba9222-4815-47b8-8d0d-f834df60ad4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/fd8477cd-9fc6-41a8-9369-80996fd528a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/c4496aea-ce92-4372-be60-8ec558f17320_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/38de8612-5971-47c4-b1c8-e39d45db8a1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/b5ca9aec-9a15-400a-98da-cb4a8ecc4752_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/d38606a5-6eae-4d95-bd6b-81015ab2c661_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/d9f79359-6aa5-4d24-9efc-a98bfec773df_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG67YLN/2025-11-21/image/b13dda39-a4f0-49cc-ad91-d0263621b753_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 09/18-6k 10/19-13k 08/20-17k 06/21-20k 06/22-28k 06/23-35k 06/24-42k 06/25-50k', 'remarks': 'vosa - 17k, 20k, 28k, 35k, 42k, 50k, 51k back page of v5 only', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1c942c11-8f7d-417e-b46a-a8f3b3f7770c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d43c55-4c02-53ad-9a0d-333c3e875535 with identifier: 117403071
2025-12-02 19:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87d43c55-4c02-53ad-9a0d-333c3e875535 with scrape type 2
2025-12-02 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87d43c55-4c02-53ad-9a0d-333c3e875535 with scrape type 2
2025-12-02 19:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 87d43c55-4c02-53ad-9a0d-333c3e875535, identifier: 117403071
2025-12-02 19:03:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117085617, 'registration': 'BV72ZLX', 'account': 'KIN032', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE HATCHBACK', 'derivative': '1.5 P300e R-Dynamic HSE 5dr Auto', 'mileage': 22216, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 200, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-14', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/edbdfb7b-c353-44e4-a76f-bc1f97ed66a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/fa8ac1dc-269d-4c59-8c67-c2078d18daff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/d26dfd1c-c71c-403f-83c6-cb0ba1652d5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/392d9b24-2d61-4513-a0ef-e53699bf40bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/cf571e52-4326-480c-a671-d663204d3429_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/97183b46-866d-4c27-be66-878bdef27cb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/de12a99b-6496-4f90-95b1-085b166adc61_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/b0b94e2a-ecbb-4261-904b-06e63802b0db_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24-15k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 34, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cb53fe50-4d45-42b2-98df-cc69bc8c07a0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117085617, 'registration': 'BV72ZLX', 'account': 'KIN032', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE HATCHBACK', 'derivative': '1.5 P300e R-Dynamic HSE 5dr Auto', 'mileage': 22216, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 200, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-14', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/edbdfb7b-c353-44e4-a76f-bc1f97ed66a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/fa8ac1dc-269d-4c59-8c67-c2078d18daff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/d26dfd1c-c71c-403f-83c6-cb0ba1652d5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/392d9b24-2d61-4513-a0ef-e53699bf40bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/cf571e52-4326-480c-a671-d663204d3429_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/97183b46-866d-4c27-be66-878bdef27cb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/de12a99b-6496-4f90-95b1-085b166adc61_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV72ZLX/2025-11-28/image/b0b94e2a-ecbb-4261-904b-06e63802b0db_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24-15k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 34, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cb53fe50-4d45-42b2-98df-cc69bc8c07a0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06f6094f-2478-583f-99fd-5a774f283dad with identifier: 117085617
2025-12-02 19:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06f6094f-2478-583f-99fd-5a774f283dad with scrape type 2
2025-12-02 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06f6094f-2478-583f-99fd-5a774f283dad with scrape type 2
2025-12-02 19:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 06f6094f-2478-583f-99fd-5a774f283dad, identifier: 117085617
2025-12-02 19:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DT66HCG/2025-12-02/image/42114b84-8030-460e-8f99-7b60c133cd66_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue)
2025-12-02 19:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/a6809671-ebbc-4657-85ef-efaa94845cdb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/28fa9e83-1a5c-4b83-9537-ac9b5941629d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252F14825501-6618-43e2-9f86-16f5c6a71aea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/14825501-6618-43e2-9f86-16f5c6a71aea_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F82547d79-7aaa-40a0-ac61-a6e2ba11b588_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/82547d79-7aaa-40a0-ac61-a6e2ba11b588_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1dade69f-058b-522a-9eff-ddb0cfd5df46 with identifier: 117571526
2025-12-02 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1dade69f-058b-522a-9eff-ddb0cfd5df46 with identifier: 117571526
2025-12-02 19:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1dade69f-058b-522a-9eff-ddb0cfd5df46 with identifier: 117571526 to the API
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%271dade69f-058b-522a-9eff-ddb0cfd5df46%27 HTTP/1.1" 200 None
2025-12-02 19:03:29 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 1dade69f-058b-522a-9eff-ddb0cfd5df46: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:29 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117571526?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1dade69f-058b-522a-9eff-ddb0cfd5df46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DW19ZVN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117571526',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND X HATCHBACK',
 'odometer': 49828,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-25',
 'seller_name': 'Gateway Peugeot',
 'title': 'VAUXHALL CROSSLAND X HATCHBACK 1.2T [130] Elite 5dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.2T [130] Elite 5dr [Start Stop]',
 'vin': None,
 'year': 2019}
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571526%27 HTTP/1.1" 200 None
2025-12-02 19:03:29 [astonbarclay.gb] INFO: Saving data for 117571526: {'auction_closing_time': 1764842400.0, 'created_time': 1764615692.029024, 'last_price_update_time': 1764702209.347931}
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117571526') HTTP/1.1" 204 0
2025-12-02 19:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 87d43c55-4c02-53ad-9a0d-333c3e875535 with identifier: 117403071
2025-12-02 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 87d43c55-4c02-53ad-9a0d-333c3e875535 with identifier: 117403071
2025-12-02 19:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 87d43c55-4c02-53ad-9a0d-333c3e875535 with identifier: 117403071 to the API
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2787d43c55-4c02-53ad-9a0d-333c3e875535%27 HTTP/1.1" 200 None
2025-12-02 19:03:29 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 87d43c55-4c02-53ad-9a0d-333c3e875535: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:29 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117403071?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '87d43c55-4c02-53ad-9a0d-333c3e875535',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DG67YLN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117403071',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 54336,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-08',
 'seller_name': 'Local Dealer Group',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 GDi Blue Drive SE Nav 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 GDi Blue Drive SE Nav 5dr 2WD',
 'vin': None,
 'year': 2017}
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117403071%27 HTTP/1.1" 200 None
2025-12-02 19:03:29 [astonbarclay.gb] INFO: Saving data for 117403071: {'auction_closing_time': 1764842400.0, 'created_time': 1763665307.338917, 'last_price_update_time': 1764702209.643349}
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117403071') HTTP/1.1" 204 0
2025-12-02 19:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 06f6094f-2478-583f-99fd-5a774f283dad with identifier: 117085617
2025-12-02 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 06f6094f-2478-583f-99fd-5a774f283dad with identifier: 117085617
2025-12-02 19:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 06f6094f-2478-583f-99fd-5a774f283dad with identifier: 117085617 to the API
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117085617?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 34,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '06f6094f-2478-583f-99fd-5a774f283dad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BV72ZLX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117085617',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE HATCHBACK',
 'odometer': 22216,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-14',
 'seller_name': 'Kinto',
 'title': 'LAND ROVER RANGE ROVER EVOQUE HATCHBACK 1.5 P300e R-Dynamic HSE 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '1.5 P300e R-Dynamic HSE 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117085617%27 HTTP/1.1" 200 None
2025-12-02 19:03:29 [astonbarclay.gb] INFO: Saving data for 117085617: {'auction_closing_time': 1764842400.0, 'created_time': 1764356596.382664, 'last_price_update_time': 1764702209.919598}
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117085617') HTTP/1.1" 204 0
2025-12-02 19:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DT66HCG/2025-12-02/image/2323e321-f80b-4c33-b04b-b389ac7b4374_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue)
2025-12-02 19:03:29 [astonbarclay.gb] INFO: Found listing with ID: 117397431
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397431%27 HTTP/1.1" 200 None
2025-12-02 19:03:29 [astonbarclay.gb] INFO: Scrape type for 117397431: 1
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F44ac9e17-e096-4a4e-9e3f-942d244de5c0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/44ac9e17-e096-4a4e-9e3f-942d244de5c0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116152721?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117399936?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116931547?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117492465?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117523804, 'registration': 'VT19FMD', 'account': 'CHE004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T Tekna 5dr', 'mileage': 62856, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 200, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VT19FMD/2025-11-26/image/975f5b19-354d-4fff-a61e-938d30e450e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/0351e65b-b7eb-42a7-8fcc-5df5ac2e8e77_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/0a778009-3538-4171-849f-361112a807a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/b1e07ea7-1570-46a7-91ef-ac4e0784fa8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/4fe7e5dd-5ef7-415b-8141-69d72f0f2dee_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/88bd60ce-f8b6-46e0-ac79-fef0f63a923c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/0dc23069-91aa-4834-a8f2-e9b034aa02a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/857c6b89-3e4a-4cc2-af85-906be1b17253_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/526a1707-1d0a-4d43-b31f-98a0a27d19ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/42105f0d-1539-4ae0-9eff-84caac298a9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/51e2082f-c28d-4b8d-ab88-d4edf9088fe8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/20-10k 05/21-17k 04/22-29k 03/24-47k', 'remarks': 'vosa @ 30k 39k 49k 59k 62k spare key in office', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/79dcc091-ea01-46a9-aecd-5914b4a87991.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117523804, 'registration': 'VT19FMD', 'account': 'CHE004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T Tekna 5dr', 'mileage': 62856, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 200, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VT19FMD/2025-11-26/image/975f5b19-354d-4fff-a61e-938d30e450e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/0351e65b-b7eb-42a7-8fcc-5df5ac2e8e77_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/0a778009-3538-4171-849f-361112a807a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/b1e07ea7-1570-46a7-91ef-ac4e0784fa8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/4fe7e5dd-5ef7-415b-8141-69d72f0f2dee_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/88bd60ce-f8b6-46e0-ac79-fef0f63a923c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/0dc23069-91aa-4834-a8f2-e9b034aa02a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/857c6b89-3e4a-4cc2-af85-906be1b17253_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/526a1707-1d0a-4d43-b31f-98a0a27d19ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/42105f0d-1539-4ae0-9eff-84caac298a9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VT19FMD/2025-11-26/image/51e2082f-c28d-4b8d-ab88-d4edf9088fe8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/20-10k 05/21-17k 04/22-29k 03/24-47k', 'remarks': 'vosa @ 30k 39k 49k 59k 62k spare key in office', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/79dcc091-ea01-46a9-aecd-5914b4a87991.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4448f50-22ee-5c6c-b6ef-7136aaf936ec with identifier: 117523804
2025-12-02 19:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4448f50-22ee-5c6c-b6ef-7136aaf936ec with scrape type 2
2025-12-02 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4448f50-22ee-5c6c-b6ef-7136aaf936ec with scrape type 2
2025-12-02 19:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f4448f50-22ee-5c6c-b6ef-7136aaf936ec, identifier: 117523804
2025-12-02 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e34f508f-8c72-4b18-a707-17d3f6d0eb5f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fc3e30827-2c5b-4c84-9fa1-ea37060945d0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/c3e30827-2c5b-4c84-9fa1-ea37060945d0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F35948979-e976-4c6a-9307-b51c8434213a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/35948979-e976-4c6a-9307-b51c8434213a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f4448f50-22ee-5c6c-b6ef-7136aaf936ec with identifier: 117523804
2025-12-02 19:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f4448f50-22ee-5c6c-b6ef-7136aaf936ec with identifier: 117523804
2025-12-02 19:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f4448f50-22ee-5c6c-b6ef-7136aaf936ec with identifier: 117523804 to the API
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117523804?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f4448f50-22ee-5c6c-b6ef-7136aaf936ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VT19FMD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117523804',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 62856,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-29',
 'seller_name': 'Local Dealer Group',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T Tekna 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117523804%27 HTTP/1.1" 200 None
2025-12-02 19:03:30 [astonbarclay.gb] INFO: Saving data for 117523804: {'auction_closing_time': 1764842400.0, 'created_time': 1764183794.202185, 'last_price_update_time': 1764702210.390297}
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117523804') HTTP/1.1" 204 0
2025-12-02 19:03:30 [astonbarclay.gb] INFO: Found listing with ID: 117542530
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542530%27 HTTP/1.1" 200 None
2025-12-02 19:03:30 [astonbarclay.gb] INFO: Scrape type for 117542530: 1
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252Ff0ea1203-fa13-4729-bd6c-24039de07c24_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/f0ea1203-fa13-4729-bd6c-24039de07c24_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ca8610>
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F42114b84-8030-460e-8f99-7b60c133cd66_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/42114b84-8030-460e-8f99-7b60c133cd66_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ca8990>
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fa6809671-ebbc-4657-85ef-efaa94845cdb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/a6809671-ebbc-4657-85ef-efaa94845cdb_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07a8d10>
2025-12-02 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F28fa9e83-1a5c-4b83-9537-ac9b5941629d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/28fa9e83-1a5c-4b83-9537-ac9b5941629d_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Ffde35cd9-4564-449f-a9b8-366a069edade_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/fde35cd9-4564-449f-a9b8-366a069edade_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F5f66a6a6-bab6-42a8-9e70-1f6e63d819fa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5f66a6a6-bab6-42a8-9e70-1f6e63d819fa_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf033de50>
2025-12-02 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F2323e321-f80b-4c33-b04b-b389ac7b4374_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/2323e321-f80b-4c33-b04b-b389ac7b4374_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116152721, 'registration': 'RF74FDN', 'account': 'LIQ001', 'make': 'KIA', 'model': 'CEED HATCHBACK', 'derivative': '1.5T GDi ISG 138 GT-Line 5dr', 'mileage': 14826, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-01-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1482, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF74FDN/2025-10-23/image/789a3744-bc32-4309-b6f4-012017d1cb8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/722a20a6-dcaf-4433-8d04-13177588ec96_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/895cc446-382b-4059-8b4b-1dc266cca68f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/a3804916-b663-4fd2-93aa-8fe968b1246b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/1f14d606-d301-48f6-9dd4-67d9c82b57cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/7a6e6bdc-b668-4eb5-a9be-e83082a97591_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/e4bfdb53-920b-4883-a202-779fc4235498_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/5893ffe1-b32e-4e71-8ec2-8cb39939a4b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/b2710471-280b-4d4b-8104-99b1c185356f_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/25 10K', 'remarks': 'SPARE KEY *copy of V5*', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ecc26f81-e7bc-40d8-9365-3a1efab2d1d1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116152721, 'registration': 'RF74FDN', 'account': 'LIQ001', 'make': 'KIA', 'model': 'CEED HATCHBACK', 'derivative': '1.5T GDi ISG 138 GT-Line 5dr', 'mileage': 14826, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-01-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1482, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF74FDN/2025-10-23/image/789a3744-bc32-4309-b6f4-012017d1cb8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/722a20a6-dcaf-4433-8d04-13177588ec96_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/895cc446-382b-4059-8b4b-1dc266cca68f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/a3804916-b663-4fd2-93aa-8fe968b1246b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/1f14d606-d301-48f6-9dd4-67d9c82b57cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/7a6e6bdc-b668-4eb5-a9be-e83082a97591_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/e4bfdb53-920b-4883-a202-779fc4235498_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/5893ffe1-b32e-4e71-8ec2-8cb39939a4b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDN/2025-10-23/image/b2710471-280b-4d4b-8104-99b1c185356f_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/25 10K', 'remarks': 'SPARE KEY *copy of V5*', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ecc26f81-e7bc-40d8-9365-3a1efab2d1d1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb47c7d-139b-5ff3-bf21-c56d922c983e with identifier: 116152721
2025-12-02 19:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb47c7d-139b-5ff3-bf21-c56d922c983e with scrape type 2
2025-12-02 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb47c7d-139b-5ff3-bf21-c56d922c983e with scrape type 2
2025-12-02 19:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: efb47c7d-139b-5ff3-bf21-c56d922c983e, identifier: 116152721
2025-12-02 19:03:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117399936, 'registration': 'YK74RYU', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 8909, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YK74RYU/2025-11-25/image/be9c5306-d757-48a2-b281-0935699417e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/a58b32bb-598e-4423-b625-adf586d64390_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/36ba8bac-c590-44f4-b480-64b3f4b088e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/36fe4c76-9a1a-4ba0-8fff-309ba9ddc11f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/80c5274d-c521-4f5e-8dbe-138d3a55c3c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/5d28bdbd-4180-4c66-85b4-00b30db6a293_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/34d02161-b842-4b0f-9cb9-35bdcd13bf57_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/f18ef94e-a6fc-4bb7-b47d-ce2cd6d7e04a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/79df0043-da97-4486-a939-2c63a27106b3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/25-8k,', 'remarks': 'SPARE KEY, *copy of V5*', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cb69fe05-b088-4c74-9b26-f6de16996d73.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117399936, 'registration': 'YK74RYU', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 8909, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YK74RYU/2025-11-25/image/be9c5306-d757-48a2-b281-0935699417e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/a58b32bb-598e-4423-b625-adf586d64390_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/36ba8bac-c590-44f4-b480-64b3f4b088e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/36fe4c76-9a1a-4ba0-8fff-309ba9ddc11f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/80c5274d-c521-4f5e-8dbe-138d3a55c3c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/5d28bdbd-4180-4c66-85b4-00b30db6a293_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/34d02161-b842-4b0f-9cb9-35bdcd13bf57_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/f18ef94e-a6fc-4bb7-b47d-ce2cd6d7e04a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK74RYU/2025-11-25/image/79df0043-da97-4486-a939-2c63a27106b3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/25-8k,', 'remarks': 'SPARE KEY, *copy of V5*', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cb69fe05-b088-4c74-9b26-f6de16996d73.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2aa859e-517b-58d9-9df3-8e8a43036d4f with identifier: 117399936
2025-12-02 19:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2aa859e-517b-58d9-9df3-8e8a43036d4f with scrape type 2
2025-12-02 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2aa859e-517b-58d9-9df3-8e8a43036d4f with scrape type 2
2025-12-02 19:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c2aa859e-517b-58d9-9df3-8e8a43036d4f, identifier: 117399936
2025-12-02 19:03:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116931547, 'registration': 'RO25DUH', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 19983, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RO25DUH/2025-11-13/image/9ef7e07b-1537-41e5-8561-638fb674370b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/41f20fcd-c1ad-4836-941f-bf70889295ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/584ec2b0-a283-44c7-bdc8-3406c4c035f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/7076ad4b-2ed5-4f07-a2f7-02eb4d75ca4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/2df89cc5-cad5-4aea-88d1-8c1398526806_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/d5cc8513-e663-4195-8295-ac5bef708bc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/05617eb8-3fca-4c78-8101-399b9f659628_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/f95e8026-01c9-4bbd-b819-e6cd856e0115_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/2e0ab0c2-cae9-423e-bc0d-d7e6257a1ed4_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce4e9eea-9384-4455-afa6-da13fba90bb9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116931547, 'registration': 'RO25DUH', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 19983, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RO25DUH/2025-11-13/image/9ef7e07b-1537-41e5-8561-638fb674370b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/41f20fcd-c1ad-4836-941f-bf70889295ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/584ec2b0-a283-44c7-bdc8-3406c4c035f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/7076ad4b-2ed5-4f07-a2f7-02eb4d75ca4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/2df89cc5-cad5-4aea-88d1-8c1398526806_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/d5cc8513-e663-4195-8295-ac5bef708bc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/05617eb8-3fca-4c78-8101-399b9f659628_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/f95e8026-01c9-4bbd-b819-e6cd856e0115_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25DUH/2025-11-13/image/2e0ab0c2-cae9-423e-bc0d-d7e6257a1ed4_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce4e9eea-9384-4455-afa6-da13fba90bb9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1553c78-f1c2-570a-880a-7632c09f1c2a with identifier: 116931547
2025-12-02 19:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1553c78-f1c2-570a-880a-7632c09f1c2a with scrape type 2
2025-12-02 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1553c78-f1c2-570a-880a-7632c09f1c2a with scrape type 2
2025-12-02 19:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a1553c78-f1c2-570a-880a-7632c09f1c2a, identifier: 116931547
2025-12-02 19:03:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117492465, 'registration': 'YA69XOC', 'account': 'CHE004', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 110 GT Line 5dr [6 Speed]', 'mileage': 42328, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 202, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-19', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YA69XOC/2025-11-26/image/3cf06f91-744a-4731-aa92-6144c27ea106_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/d087081b-454c-49a4-9d30-2b021d7e11d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/497a05b5-c7bc-4b1e-bea5-f0b3701d5024_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/b7097384-fbd1-4e6b-ada4-54142ffddec4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/1b95b02e-fde6-4998-af88-16028624147f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/cec324fc-5f22-44e4-8af5-21efa0a4c7a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/ca176159-6d5f-4dd0-8f18-9e6674e2ae52_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/d988e06f-e752-441c-a649-1b0bf3b76d05_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/de7b6160-ef88-491e-9a14-6595cb3e3ebd_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa - 26k, 32k, 33k, 41k', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '6', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ac131060-3904-469f-9c72-9ace1563f1ff.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117492465, 'registration': 'YA69XOC', 'account': 'CHE004', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 110 GT Line 5dr [6 Speed]', 'mileage': 42328, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': 202, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-19', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YA69XOC/2025-11-26/image/3cf06f91-744a-4731-aa92-6144c27ea106_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/d087081b-454c-49a4-9d30-2b021d7e11d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/497a05b5-c7bc-4b1e-bea5-f0b3701d5024_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/b7097384-fbd1-4e6b-ada4-54142ffddec4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/1b95b02e-fde6-4998-af88-16028624147f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/cec324fc-5f22-44e4-8af5-21efa0a4c7a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/ca176159-6d5f-4dd0-8f18-9e6674e2ae52_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/d988e06f-e752-441c-a649-1b0bf3b76d05_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA69XOC/2025-11-26/image/de7b6160-ef88-491e-9a14-6595cb3e3ebd_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa - 26k, 32k, 33k, 41k', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '6', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ac131060-3904-469f-9c72-9ace1563f1ff.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4604a1b-a70c-5edd-b022-e1d373cf9b1a with identifier: 117492465
2025-12-02 19:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4604a1b-a70c-5edd-b022-e1d373cf9b1a with scrape type 2
2025-12-02 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4604a1b-a70c-5edd-b022-e1d373cf9b1a with scrape type 2
2025-12-02 19:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a4604a1b-a70c-5edd-b022-e1d373cf9b1a, identifier: 117492465
2025-12-02 19:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/260d71ec-5b29-4b5e-b035-37900241a482_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DT66HCG/2025-12-02/image/88281e3e-d9b3-4a42-a5b3-e1b700c739f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue)
2025-12-02 19:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/4f68fab2-f04e-4be6-bc9b-da9c96f9c52f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:31 [astonbarclay.gb] INFO: Found listing with ID: 117505111
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505111%27 HTTP/1.1" 200 None
2025-12-02 19:03:31 [astonbarclay.gb] INFO: Scrape type for 117505111: 1
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F51b3ed8c-926f-4f07-93d2-f643ddce9cc8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/51b3ed8c-926f-4f07-93d2-f643ddce9cc8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: efb47c7d-139b-5ff3-bf21-c56d922c983e with identifier: 116152721
2025-12-02 19:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: efb47c7d-139b-5ff3-bf21-c56d922c983e with identifier: 116152721
2025-12-02 19:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: efb47c7d-139b-5ff3-bf21-c56d922c983e with identifier: 116152721 to the API
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116152721?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'efb47c7d-139b-5ff3-bf21-c56d922c983e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RF74FDN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116152721',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'CEED HATCHBACK',
 'odometer': 14826,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-30',
 'seller_name': 'Liquid Fleet',
 'title': 'KIA CEED HATCHBACK 1.5T GDi ISG 138 GT-Line 5dr',
 'transmission': 'manual',
 'trim': '1.5T GDi ISG 138 GT-Line 5dr',
 'vin': None,
 'year': 2025}
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152721%27 HTTP/1.1" 200 None
2025-12-02 19:03:32 [astonbarclay.gb] INFO: Saving data for 116152721: {'auction_closing_time': 1764842400.0, 'created_time': 1761037432.813955, 'last_price_update_time': 1764702212.205786}
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116152721') HTTP/1.1" 204 0
2025-12-02 19:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c2aa859e-517b-58d9-9df3-8e8a43036d4f with identifier: 117399936
2025-12-02 19:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c2aa859e-517b-58d9-9df3-8e8a43036d4f with identifier: 117399936
2025-12-02 19:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c2aa859e-517b-58d9-9df3-8e8a43036d4f with identifier: 117399936 to the API
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117399936?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'c2aa859e-517b-58d9-9df3-8e8a43036d4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YK74RYU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117399936',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 8909,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-30',
 'seller_name': 'Liquid Fleet',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi 207 HEV 3 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6T GDi 207 HEV 3 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399936%27 HTTP/1.1" 200 None
2025-12-02 19:03:32 [astonbarclay.gb] INFO: Saving data for 117399936: {'auction_closing_time': 1764842400.0, 'created_time': 1764097336.227424, 'last_price_update_time': 1764702212.645624}
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117399936') HTTP/1.1" 204 0
2025-12-02 19:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a1553c78-f1c2-570a-880a-7632c09f1c2a with identifier: 116931547
2025-12-02 19:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a1553c78-f1c2-570a-880a-7632c09f1c2a with identifier: 116931547
2025-12-02 19:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a1553c78-f1c2-570a-880a-7632c09f1c2a with identifier: 116931547 to the API
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116931547?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'GREEN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'a1553c78-f1c2-570a-880a-7632c09f1c2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RO25DUH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116931547',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 19983,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-27',
 'seller_name': 'Liquid Fleet',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi 207 HEV 3 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6T GDi 207 HEV 3 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116931547%27 HTTP/1.1" 200 None
2025-12-02 19:03:32 [astonbarclay.gb] INFO: Saving data for 116931547: {'auction_closing_time': 1764842400.0, 'created_time': 1763492605.653361, 'last_price_update_time': 1764702212.952976}
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116931547') HTTP/1.1" 204 0
2025-12-02 19:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a4604a1b-a70c-5edd-b022-e1d373cf9b1a with identifier: 117492465
2025-12-02 19:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a4604a1b-a70c-5edd-b022-e1d373cf9b1a with identifier: 117492465
2025-12-02 19:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a4604a1b-a70c-5edd-b022-e1d373cf9b1a with identifier: 117492465 to the API
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a4604a1b-a70c-5edd-b022-e1d373cf9b1a%27 HTTP/1.1" 200 None
2025-12-02 19:03:33 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a4604a1b-a70c-5edd-b022-e1d373cf9b1a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117492465?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a4604a1b-a70c-5edd-b022-e1d373cf9b1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YA69XOC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117492465',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 42328,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-19',
 'seller_name': 'Local Dealer Group',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech 110 GT Line 5dr [6 Speed]',
 'transmission': 'manual',
 'trim': '1.2 PureTech 110 GT Line 5dr [6 Speed]',
 'vin': None,
 'year': 2019}
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492465%27 HTTP/1.1" 200 None
2025-12-02 19:03:33 [astonbarclay.gb] INFO: Saving data for 117492465: {'auction_closing_time': 1764842400.0, 'created_time': 1764097296.242921, 'last_price_update_time': 1764702213.237079}
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117492465') HTTP/1.1" 204 0
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0900b10>
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Fe34f508f-8c72-4b18-a707-17d3f6d0eb5f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e34f508f-8c72-4b18-a707-17d3f6d0eb5f_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f7c3ff6c-7664-4e92-a411-fea4d8c0cdc6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/14825501-6618-43e2-9f86-16f5c6a71aea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DT66HCG/2025-12-02/image/5e7299c4-9b38-4ce5-81c1-bcbeb579adb1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue)
2025-12-02 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/82547d79-7aaa-40a0-ac61-a6e2ba11b588_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fe057fba8-0088-4a13-9bed-28ee0836b935_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/e057fba8-0088-4a13-9bed-28ee0836b935_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Ff168c1b6-2fa4-4bcb-bccd-e09beea1a947_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f168c1b6-2fa4-4bcb-bccd-e09beea1a947_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 116832401
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116832401%27 HTTP/1.1" 200 None
2025-12-02 19:03:33 [astonbarclay.gb] INFO: Scrape type for 116832401: 1
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F773f1439-4679-4989-8df0-f6695895c7a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/773f1439-4679-4989-8df0-f6695895c7a7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252F38ade57c-88ab-4332-a336-6c61604e9de9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/38ade57c-88ab-4332-a336-6c61604e9de9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Fb3fa3821-7a3b-4f14-99f9-c5715602c1b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/b3fa3821-7a3b-4f14-99f9-c5715602c1b3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0878e90>
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252F260d71ec-5b29-4b5e-b035-37900241a482_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/260d71ec-5b29-4b5e-b035-37900241a482_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06ac450>
2025-12-02 19:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F88281e3e-d9b3-4a42-a5b3-e1b700c739f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/88281e3e-d9b3-4a42-a5b3-e1b700c739f1_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0887a10>
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F4f68fab2-f04e-4be6-bc9b-da9c96f9c52f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/4f68fab2-f04e-4be6-bc9b-da9c96f9c52f_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:34 [astonbarclay.gb] INFO: Found listing with ID: 117509080
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509080%27 HTTP/1.1" 200 None
2025-12-02 19:03:34 [astonbarclay.gb] INFO: Scrape type for 117509080: 1
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F09f48a99-c714-4322-a7eb-bb2d8cdd9963_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/09f48a99-c714-4322-a7eb-bb2d8cdd9963_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/fde35cd9-4564-449f-a9b8-366a069edade_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/c3e30827-2c5b-4c84-9fa1-ea37060945d0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5f66a6a6-bab6-42a8-9e70-1f6e63d819fa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/35948979-e976-4c6a-9307-b51c8434213a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DT66HCG/2025-12-02/image/f0ea1203-fa13-4729-bd6c-24039de07c24_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue)
2025-12-02 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DT66HCG/2025-12-02/image/44ac9e17-e096-4a4e-9e3f-942d244de5c0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue)
2025-12-02 19:03:34 [astonbarclay.gb] INFO: Found listing with ID: 117484817
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117484817%27 HTTP/1.1" 200 None
2025-12-02 19:03:34 [astonbarclay.gb] INFO: Scrape type for 117484817: 1
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F6d670a03-f832-484f-8cc5-3c92855b351a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/6d670a03-f832-484f-8cc5-3c92855b351a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662184?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117458227?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662175?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0641f50>
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Ff7c3ff6c-7664-4e92-a411-fea4d8c0cdc6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f7c3ff6c-7664-4e92-a411-fea4d8c0cdc6_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf033d8d0>
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252F14825501-6618-43e2-9f86-16f5c6a71aea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/14825501-6618-43e2-9f86-16f5c6a71aea_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f185d0>
2025-12-02 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F5e7299c4-9b38-4ce5-81c1-bcbeb579adb1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/5e7299c4-9b38-4ce5-81c1-bcbeb579adb1_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf12012d0>
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F82547d79-7aaa-40a0-ac61-a6e2ba11b588_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/82547d79-7aaa-40a0-ac61-a6e2ba11b588_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:35 [astonbarclay.gb] INFO: Found listing with ID: 117558104
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117558104%27 HTTP/1.1" 200 None
2025-12-02 19:03:35 [astonbarclay.gb] INFO: Scrape type for 117558104: 1
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252Fff0af178-05d4-4ef8-8a70-515eb742a0b8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/ff0af178-05d4-4ef8-8a70-515eb742a0b8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117101420?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117609383?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117571604?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117363031?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117143069?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0619450>
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_12.jpg HTTP/1.1" 201 0
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Ffde35cd9-4564-449f-a9b8-366a069edade_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/fde35cd9-4564-449f-a9b8-366a069edade_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0432cd0>
2025-12-02 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_11.jpg HTTP/1.1" 201 0
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fc3e30827-2c5b-4c84-9fa1-ea37060945d0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/c3e30827-2c5b-4c84-9fa1-ea37060945d0_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1bd3c50>
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_11.jpg HTTP/1.1" 201 0
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F5f66a6a6-bab6-42a8-9e70-1f6e63d819fa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5f66a6a6-bab6-42a8-9e70-1f6e63d819fa_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e7b10>
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F35948979-e976-4c6a-9307-b51c8434213a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/35948979-e976-4c6a-9307-b51c8434213a_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06e4250>
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252Ff0ea1203-fa13-4729-bd6c-24039de07c24_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/f0ea1203-fa13-4729-bd6c-24039de07c24_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0433650>
2025-12-02 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F44ac9e17-e096-4a4e-9e3f-942d244de5c0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/44ac9e17-e096-4a4e-9e3f-942d244de5c0_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662184, 'registration': 'DX17YFC', 'account': 'ARN217', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL HATCHBACK', 'derivative': '2.0 CDTi [170] ecoFLEX SRi Nav 5dr [Start Stop]', 'mileage': 57031, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-04-04', 'fuel': 'Diesel', 'motExpiry': '2025-11-12', 'doors': 5, 'engineSize': 1956, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 31k, 33k, 41k, 45k, 48k, 53k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662184, 'registration': 'DX17YFC', 'account': 'ARN217', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL HATCHBACK', 'derivative': '2.0 CDTi [170] ecoFLEX SRi Nav 5dr [Start Stop]', 'mileage': 57031, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-04-04', 'fuel': 'Diesel', 'motExpiry': '2025-11-12', 'doors': 5, 'engineSize': 1956, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 31k, 33k, 41k, 45k, 48k, 53k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4bed095-0062-5e17-8ad9-48e80c94ba53 with identifier: 117662184
2025-12-02 19:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4bed095-0062-5e17-8ad9-48e80c94ba53 with scrape type 1
2025-12-02 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a4bed095-0062-5e17-8ad9-48e80c94ba53
2025-12-02 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a4bed095-0062-5e17-8ad9-48e80c94ba53
2025-12-02 19:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a4bed095-0062-5e17-8ad9-48e80c94ba53, identifier: 117662184
2025-12-02 19:03:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117458227, 'registration': 'OV71TVC', 'account': 'ZEN002', 'make': 'PEUGEOT', 'model': 'E-2008 ELECTRIC ESTATE', 'derivative': '100kW Allure Premium 50kWh 5dr Auto', 'mileage': 44569, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-25', 'fuel': 'Electric', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71TVC/2025-11-28/image/774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/b930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/d19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/acaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/f48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/22 7K 11/23 17K  09/24 28K 09/25 41K', 'remarks': 'SPARE KEY VOSA STATES 32K 43K Pearlescent Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29e119ce-57f6-4f91-8530-1e4460c2b876.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117458227, 'registration': 'OV71TVC', 'account': 'ZEN002', 'make': 'PEUGEOT', 'model': 'E-2008 ELECTRIC ESTATE', 'derivative': '100kW Allure Premium 50kWh 5dr Auto', 'mileage': 44569, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-25', 'fuel': 'Electric', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71TVC/2025-11-28/image/774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/b930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/d19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/acaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/f48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/22 7K 11/23 17K  09/24 28K 09/25 41K', 'remarks': 'SPARE KEY VOSA STATES 32K 43K Pearlescent Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29e119ce-57f6-4f91-8530-1e4460c2b876.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08cb1562-d169-5941-bed4-70781c82a521 with identifier: 117458227
2025-12-02 19:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08cb1562-d169-5941-bed4-70781c82a521 with scrape type 1
2025-12-02 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 08cb1562-d169-5941-bed4-70781c82a521
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252F774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662175, 'registration': 'WF68WSV', 'account': 'ARN242', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A250 AMG Line 5dr Auto', 'mileage': 74501, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-10-26', 'fuel': 'Petrol', 'motExpiry': '2026-08-12', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 31k, 41k, 47k, 60k, 72k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662175, 'registration': 'WF68WSV', 'account': 'ARN242', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A250 AMG Line 5dr Auto', 'mileage': 74501, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-10-26', 'fuel': 'Petrol', 'motExpiry': '2026-08-12', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 31k, 41k, 47k, 60k, 72k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b97705c-bc6c-51b1-829f-114271b0902a with identifier: 117662175
2025-12-02 19:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b97705c-bc6c-51b1-829f-114271b0902a with scrape type 1
2025-12-02 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 1b97705c-bc6c-51b1-829f-114271b0902a
2025-12-02 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 1b97705c-bc6c-51b1-829f-114271b0902a
2025-12-02 19:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1b97705c-bc6c-51b1-829f-114271b0902a, identifier: 117662175
2025-12-02 19:03:37 [astonbarclay.gb] INFO: Found listing with ID: 117427357
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427357%27 HTTP/1.1" 200 None
2025-12-02 19:03:37 [astonbarclay.gb] INFO: Scrape type for 117427357: 1
2025-12-02 19:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a4bed095-0062-5e17-8ad9-48e80c94ba53 with identifier: 117662184
2025-12-02 19:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a4bed095-0062-5e17-8ad9-48e80c94ba53 with identifier: 117662184
2025-12-02 19:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a4bed095-0062-5e17-8ad9-48e80c94ba53 with identifier: 117662184 to the API
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a4bed095-0062-5e17-8ad9-48e80c94ba53%27 HTTP/1.1" 200 None
2025-12-02 19:03:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a4bed095-0062-5e17-8ad9-48e80c94ba53: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:37 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117662184?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'a4bed095-0062-5e17-8ad9-48e80c94ba53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DX17YFC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662184',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA DIESEL HATCHBACK',
 'odometer': 57031,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-04',
 'seller_name': 'Arnold Clark',
 'title': 'VAUXHALL INSIGNIA DIESEL HATCHBACK 2.0 CDTi [170] ecoFLEX SRi Nav '
          '5dr [Start Stop]',
 'transmission': 'manual',
 'trim': '2.0 CDTi [170] ecoFLEX SRi Nav 5dr [Start Stop]',
 'vin': None,
 'year': 2017}
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662184%27 HTTP/1.1" 200 None
2025-12-02 19:03:37 [astonbarclay.gb] INFO: Saving data for 117662184: {'created_time': 1764702217.792427, 'last_price_update_time': 1764702217.792436, 'auction_closing_time': 1764842400.0}
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662184') HTTP/1.1" 204 0
2025-12-02 19:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1b97705c-bc6c-51b1-829f-114271b0902a with identifier: 117662175
2025-12-02 19:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1b97705c-bc6c-51b1-829f-114271b0902a with identifier: 117662175
2025-12-02 19:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1b97705c-bc6c-51b1-829f-114271b0902a with identifier: 117662175 to the API
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%271b97705c-bc6c-51b1-829f-114271b0902a%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 1b97705c-bc6c-51b1-829f-114271b0902a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:37 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117662175?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1b97705c-bc6c-51b1-829f-114271b0902a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WF68WSV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662175',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 74501,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-26',
 'seller_name': 'Arnold Clark',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A250 AMG Line 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A250 AMG Line 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662175%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Saving data for 117662175: {'created_time': 1764702218.076763, 'last_price_update_time': 1764702218.076774, 'auction_closing_time': 1764842400.0}
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662175') HTTP/1.1" 204 0
2025-12-02 19:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/38ade57c-88ab-4332-a336-6c61604e9de9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/b3fa3821-7a3b-4f14-99f9-c5715602c1b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DT66HCG/2025-12-02/image/773f1439-4679-4989-8df0-f6695895c7a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue)
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DT66HCG/2025-12-02/image/09f48a99-c714-4322-a7eb-bb2d8cdd9963_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue)
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f168c1b6-2fa4-4bcb-bccd-e09beea1a947_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252Fb930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/b930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/e057fba8-0088-4a13-9bed-28ee0836b935_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DT66HCG/2025-12-02/image/51b3ed8c-926f-4f07-93d2-f643ddce9cc8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue)
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Found listing with ID: 117440946
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440946%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Scrape type for 117440946: 1
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117101420, 'registration': 'DY72ASX', 'account': 'ZEN002', 'make': 'NISSAN', 'model': 'LEAF HATCHBACK', 'derivative': '110kW Acenta 40kWh 5dr Auto [6.6kw Charger]', 'mileage': 65803, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DY72ASX/2025-12-01/image/abee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/fbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/aba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/e0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/a28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/23 20k 08/24 37k 07/25 57k', 'remarks': 'SPARE KEY Pearl Black Paint VOSA STATES 65K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1ff8e576-f090-44e0-b753-85b3a7778389.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117101420, 'registration': 'DY72ASX', 'account': 'ZEN002', 'make': 'NISSAN', 'model': 'LEAF HATCHBACK', 'derivative': '110kW Acenta 40kWh 5dr Auto [6.6kw Charger]', 'mileage': 65803, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DY72ASX/2025-12-01/image/abee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/fbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/aba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/e0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/a28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/23 20k 08/24 37k 07/25 57k', 'remarks': 'SPARE KEY Pearl Black Paint VOSA STATES 65K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1ff8e576-f090-44e0-b753-85b3a7778389.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4f48589-fe70-55fd-8be4-3136f685545b with identifier: 117101420
2025-12-02 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4f48589-fe70-55fd-8be4-3136f685545b with scrape type 1
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item d4f48589-fe70-55fd-8be4-3136f685545b
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252Fabee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/abee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117609383, 'registration': 'PN71OEO', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'ID.3 HATCHBACK', 'derivative': '150kW Tour Pro S 77kWh 5dr Auto', 'mileage': 29823, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-01', 'fuel': 'Electric', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PN71OEO/2025-12-01/image/fb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/ece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/d5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa states 20k, 27k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/724d66fb-7a64-4df1-979a-a7ff50b25472.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117609383, 'registration': 'PN71OEO', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'ID.3 HATCHBACK', 'derivative': '150kW Tour Pro S 77kWh 5dr Auto', 'mileage': 29823, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-01', 'fuel': 'Electric', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PN71OEO/2025-12-01/image/fb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/ece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/d5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa states 20k, 27k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/724d66fb-7a64-4df1-979a-a7ff50b25472.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881 with identifier: 117609383
2025-12-02 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881 with scrape type 1
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252Ffb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/fb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117571604, 'registration': 'FG71HUK', 'account': 'ZEN002', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW Premier Edition 80kWh 5dr Auto', 'mileage': 27438, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-23', 'fuel': 'Electric', 'motExpiry': '2026-11-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FG71HUK/2025-12-01/image/812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/f44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/d518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/ce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/23 15K', 'remarks': 'VOSA STATES 20K 27K \t Carbon Black\tTowbar - Fully Electric, spare key', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3d47ed9-d304-4fae-a2c4-e3f8b45ee2ad.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117571604, 'registration': 'FG71HUK', 'account': 'ZEN002', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW Premier Edition 80kWh 5dr Auto', 'mileage': 27438, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-23', 'fuel': 'Electric', 'motExpiry': '2026-11-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FG71HUK/2025-12-01/image/812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/f44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/d518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/ce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/23 15K', 'remarks': 'VOSA STATES 20K 27K \t Carbon Black\tTowbar - Fully Electric, spare key', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3d47ed9-d304-4fae-a2c4-e3f8b45ee2ad.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f078946-171f-5caa-940b-454aafb1ea0e with identifier: 117571604
2025-12-02 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f078946-171f-5caa-940b-454aafb1ea0e with scrape type 1
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8f078946-171f-5caa-940b-454aafb1ea0e
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252F812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117363031, 'registration': 'KR70ATV', 'account': 'LEA009', 'make': 'SEAT', 'model': 'MII ELECTRIC HATCHBACK', 'derivative': '61kW One 36.8kWh 5dr Auto', 'mileage': 17769, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-12-01', 'fuel': 'Electric', 'motExpiry': '2026-09-14', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR70ATV/2025-12-01/image/2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/a25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/afc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/22-7k, 11/24-15k,', 'remarks': 'vosa states 10k, 13k, 16k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/377d16ff-416d-4be8-8e49-0e13e4c4860c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117363031, 'registration': 'KR70ATV', 'account': 'LEA009', 'make': 'SEAT', 'model': 'MII ELECTRIC HATCHBACK', 'derivative': '61kW One 36.8kWh 5dr Auto', 'mileage': 17769, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-12-01', 'fuel': 'Electric', 'motExpiry': '2026-09-14', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR70ATV/2025-12-01/image/2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/a25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/afc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/22-7k, 11/24-15k,', 'remarks': 'vosa states 10k, 13k, 16k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/377d16ff-416d-4be8-8e49-0e13e4c4860c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bfeeef3-c0e9-5f08-ab82-702162b70aba with identifier: 117363031
2025-12-02 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba with scrape type 1
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117143069, 'registration': 'DY72GBF', 'account': 'ZEN002', 'make': 'VAUXHALL', 'model': 'MOKKA ELECTRIC HATCHBACK', 'derivative': '100kW Elite Premium 50kWh 5dr Auto', 'mileage': 24515, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Electric', 'motExpiry': '2026-08-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DY72GBF/2025-11-12/image/d1672909-9ac6-4411-85b6-cd19e0a98c1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/390e8408-44c3-4ee5-8510-ac34a84d1738_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/4c24ddba-a074-4acf-b83e-d106c65a3bff_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/f30cff89-9fdc-4a4a-9422-75bd1c5b4790_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/d7f2f923-051f-40cc-9a6c-d682d50a852c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/371b55bd-fbab-4517-ab0f-255ff5f07a4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/03c06193-2e38-4514-b31a-7ddd394c30e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/0df32ac9-0323-4dfc-9fba-780dbe7c32ae_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/23 6K, 04/24 12K, 10/25-24K', 'remarks': 'Two-coat Premium Paint, SPARE KEY, VOSA STATES 58K 69K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a49f191-6d18-45f1-917e-422bf2ba394a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117143069, 'registration': 'DY72GBF', 'account': 'ZEN002', 'make': 'VAUXHALL', 'model': 'MOKKA ELECTRIC HATCHBACK', 'derivative': '100kW Elite Premium 50kWh 5dr Auto', 'mileage': 24515, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Electric', 'motExpiry': '2026-08-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DY72GBF/2025-11-12/image/d1672909-9ac6-4411-85b6-cd19e0a98c1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/390e8408-44c3-4ee5-8510-ac34a84d1738_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/4c24ddba-a074-4acf-b83e-d106c65a3bff_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/f30cff89-9fdc-4a4a-9422-75bd1c5b4790_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/d7f2f923-051f-40cc-9a6c-d682d50a852c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/371b55bd-fbab-4517-ab0f-255ff5f07a4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/03c06193-2e38-4514-b31a-7ddd394c30e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY72GBF/2025-11-12/image/0df32ac9-0323-4dfc-9fba-780dbe7c32ae_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/23 6K, 04/24 12K, 10/25-24K', 'remarks': 'Two-coat Premium Paint, SPARE KEY, VOSA STATES 58K 69K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a49f191-6d18-45f1-917e-422bf2ba394a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e74bf83-b36f-5123-8549-f0d845fc2458 with identifier: 117143069
2025-12-02 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e74bf83-b36f-5123-8549-f0d845fc2458 with scrape type 2
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e74bf83-b36f-5123-8549-f0d845fc2458 with scrape type 2
2025-12-02 19:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9e74bf83-b36f-5123-8549-f0d845fc2458, identifier: 117143069
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252Fd19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/d19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9e74bf83-b36f-5123-8549-f0d845fc2458 with identifier: 117143069
2025-12-02 19:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9e74bf83-b36f-5123-8549-f0d845fc2458 with identifier: 117143069
2025-12-02 19:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'vauxhall mokka electric hatchback 100kw elite premium 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 24515, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117143069', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw elite premium 50kwh 5dr auto', 'license_plate': 'dy72gbf', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '9e74bf83-b36f-5123-8549-f0d845fc2458', 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'vauxhall mokka electric hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 39452} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '9e74bf83-b36f-5123-8549-f0d845fc2458',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'dy72gbf',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117143069',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka electric hatchback',
     'model': 'mokka electric hatchback',
     'odometer': 24515,
     'odometer_in_km': 39452,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-30',
     'sanitized_make': 'vauxhall',
     'seller_name': 'zenith',
     'title': 'vauxhall mokka electric hatchback 100kw elite premium 50kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '100kw elite premium 50kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 9e74bf83-b36f-5123-8549-f0d845fc2458 spider: astonbarclay.gb
2025-12-02 19:03:38 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 9e74bf83-b36f-5123-8549-f0d845fc2458 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'vauxhall mokka electric hatchback 100kw elite premium 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 24515, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117143069', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw elite premium 50kwh 5dr auto', 'license_plate': 'dy72gbf', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '9e74bf83-b36f-5123-8549-f0d845fc2458', 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'vauxhall mokka electric hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 39452} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '9e74bf83-b36f-5123-8549-f0d845fc2458',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'dy72gbf',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117143069',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka electric hatchback',
     'model': 'mokka electric hatchback',
     'odometer': 24515,
     'odometer_in_km': 39452,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-30',
     'sanitized_make': 'vauxhall',
     'seller_name': 'zenith',
     'title': 'vauxhall mokka electric hatchback 100kw elite premium 50kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '100kw elite premium 50kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '9e74bf83-b36f-5123-8549-f0d845fc2458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DY72GBF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117143069',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VAUXHALL',
 'model': 'MOKKA ELECTRIC HATCHBACK',
 'odometer': 24515,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Zenith',
 'title': 'VAUXHALL MOKKA ELECTRIC HATCHBACK 100kW Elite Premium 50kWh 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '100kW Elite Premium 50kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117143069%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Saving data for 117143069: {'created_time': 1764356700.62965, 'last_price_update_time': 1764702218.599923, 'auction_closing_time': 1764842400.0}
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117143069') HTTP/1.1" 204 0
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Found listing with ID: 117418998
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418998%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Scrape type for 117418998: 2
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252F26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252Fc9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252Ff44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/f44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TVC/2025-11-28/image/774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117458227?view=catalogue)
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/65bc4fc5-1f03-4556-bb7c-a583debfffe7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/ee00062b-ba04-4b88-9458-dca1a3cde696_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DT66HCG/2025-12-02/image/6d670a03-f832-484f-8cc5-3c92855b351a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue)
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DT66HCG/2025-12-02/image/ff0af178-05d4-4ef8-8a70-515eb742a0b8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662061?view=catalogue)
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252F1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/eb7ce05f-923f-428a-acde-7145d9a17118_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Found listing with ID: 117493253
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117493253%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [astonbarclay.gb] INFO: Scrape type for 117493253: 1
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252Ffbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/fbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252Fece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/ece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252Fd518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/d518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07eb690>
2025-12-02 19:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_14.jpg HTTP/1.1" 201 0
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252F38ade57c-88ab-4332-a336-6c61604e9de9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/38ade57c-88ab-4332-a336-6c61604e9de9_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0430c50>
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_13.jpg HTTP/1.1" 201 0
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Fb3fa3821-7a3b-4f14-99f9-c5715602c1b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/b3fa3821-7a3b-4f14-99f9-c5715602c1b3_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf37e1410>
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F773f1439-4679-4989-8df0-f6695895c7a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/773f1439-4679-4989-8df0-f6695895c7a7_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06cc210>
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F09f48a99-c714-4322-a7eb-bb2d8cdd9963_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/09f48a99-c714-4322-a7eb-bb2d8cdd9963_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0669010>
2025-12-02 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_12.jpg HTTP/1.1" 201 0
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Ff168c1b6-2fa4-4bcb-bccd-e09beea1a947_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f168c1b6-2fa4-4bcb-bccd-e09beea1a947_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e82d0>
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_13.jpg HTTP/1.1" 201 0
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fe057fba8-0088-4a13-9bed-28ee0836b935_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/e057fba8-0088-4a13-9bed-28ee0836b935_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07c4b10>
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F51b3ed8c-926f-4f07-93d2-f643ddce9cc8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/51b3ed8c-926f-4f07-93d2-f643ddce9cc8_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252Facaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/acaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:40 [astonbarclay.gb] INFO: Found listing with ID: 117399393
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399393%27 HTTP/1.1" 200 None
2025-12-02 19:03:40 [astonbarclay.gb] INFO: Scrape type for 117399393: 2
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252F0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252F54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252F6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252F286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117509080?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117542530?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117574882?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116832401?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ebb8d0>
2025-12-02 19:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252F774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08cb1562-d169-5941-bed4-70781c82a521
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07b7b10>
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252F65bc4fc5-1f03-4556-bb7c-a583debfffe7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/65bc4fc5-1f03-4556-bb7c-a583debfffe7_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08f8ad0>
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Fee00062b-ba04-4b88-9458-dca1a3cde696_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/ee00062b-ba04-4b88-9458-dca1a3cde696_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06e3590>
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252F6d670a03-f832-484f-8cc5-3c92855b351a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/6d670a03-f832-484f-8cc5-3c92855b351a_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c953d0>
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDT66HCG%252F2025-12-02%252Fimage%252Fff0af178-05d4-4ef8-8a70-515eb742a0b8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DT66HCG/2025-12-02/image/ff0af178-05d4-4ef8-8a70-515eb742a0b8_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 11303b88-fb35-5bef-8d98-38e213a77f32
2025-12-02 19:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11303b88-fb35-5bef-8d98-38e213a77f32, skipping ID generation
2025-12-02 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11303b88-fb35-5bef-8d98-38e213a77f32 with scrape type 1
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 11303b88-fb35-5bef-8d98-38e213a77f32 from tracking dictionaries
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11303b88-fb35-5bef-8d98-38e213a77f32 sending to next pipeline
2025-12-02 19:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 11303b88-fb35-5bef-8d98-38e213a77f32, identifier: 117662061
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf067c3d0>
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Feb7ce05f-923f-428a-acde-7145d9a17118_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/eb7ce05f-923f-428a-acde-7145d9a17118_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609383?view=catalogue)
2025-12-02 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR70ATV/2025-12-01/image/7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117363031?view=catalogue)
2025-12-02 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TVC/2025-11-28/image/d19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117458227?view=catalogue)
2025-12-02 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY72ASX/2025-12-01/image/26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101420?view=catalogue)
2025-12-02 19:03:42 [astonbarclay.gb] INFO: Found listing with ID: 117138563
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117138563%27 HTTP/1.1" 200 None
2025-12-02 19:03:42 [astonbarclay.gb] INFO: Scrape type for 117138563: 2
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252F6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252F5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252F4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252Fa25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/a25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 11303b88-fb35-5bef-8d98-38e213a77f32 with identifier: 117662061
2025-12-02 19:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 11303b88-fb35-5bef-8d98-38e213a77f32 with identifier: 117662061
2025-12-02 19:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 11303b88-fb35-5bef-8d98-38e213a77f32 with identifier: 117662061 to the API
2025-12-02 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DT66HCG/2025-12-02/image/ff0af178-05d4-4ef8-8a70-515eb742a0b8_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '11303b88-fb35-5bef-8d98-38e213a77f32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DT66HCG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662061',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'SUZUKI',
 'model': 'IGNIS HATCHBACK',
 'odometer': 19459,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27389,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/42114b84-8030-460e-8f99-7b60c133cd66_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25768,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/2323e321-f80b-4c33-b04b-b389ac7b4374_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24213,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/5e7299c4-9b38-4ce5-81c1-bcbeb579adb1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24788,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/88281e3e-d9b3-4a42-a5b3-e1b700c739f1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44821,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/44ac9e17-e096-4a4e-9e3f-942d244de5c0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42469,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/f0ea1203-fa13-4729-bd6c-24039de07c24_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66922,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/51b3ed8c-926f-4f07-93d2-f643ddce9cc8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51684,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/773f1439-4679-4989-8df0-f6695895c7a7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62045,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/09f48a99-c714-4322-a7eb-bb2d8cdd9963_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66771,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/6d670a03-f832-484f-8cc5-3c92855b351a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11303b88-fb35-5bef-8d98-38e213a77f32/11303b88-fb35-5bef-8d98-38e213a77f32_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67693,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DT66HCG/2025-12-02/image/ff0af178-05d4-4ef8-8a70-515eb742a0b8_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-29',
 'seller_name': 'Ken Jervis Kia',
 'title': 'SUZUKI IGNIS HATCHBACK 1.2 Dualjet SHVS SZ5 ALLGRIP 5dr',
 'transmission': 'manual',
 'trim': '1.2 Dualjet SHVS SZ5 ALLGRIP 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662061%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Saving data for 117662061: {'created_time': 1764702223.157925, 'last_price_update_time': 1764702223.157963, 'auction_closing_time': 1764842400.0}
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662061') HTTP/1.1" 204 0
2025-12-02 19:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71HUK/2025-12-01/image/f44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117571604?view=catalogue)
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252F8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Found listing with ID: 117243233
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243233%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Scrape type for 117243233: 1
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252Faba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/aba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252F7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252F90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252Fafc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/afc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117484817?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117397431?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117505111?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117558104?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117509080, 'registration': 'MF71ZPO', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES TOURING', 'derivative': '330e xDrive Sport Pro 5dr Step Auto', 'mileage': 43881, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-20', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/586ed5fc-7b63-4291-bb1e-88c199ed2e00_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/73f9b7db-4a11-45c2-bc16-39a7e400233e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/08710b9a-b628-4ae5-854d-f30e54e6fa5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/b26a89c1-daac-4a9e-987f-36b0d7c88f8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/8fe4f446-4a0f-4a18-b7eb-b8fb00880cc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/324d9d14-7e26-451f-91fc-0496aed50a0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/514aa7b7-ed0e-4db8-b39d-43f95c925fe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/6bca9b24-0fd7-4d6d-b11d-ef4f9157e1fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/c4863142-caf0-474c-a195-489bdabba450_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/24 36k 07/25 43k', 'remarks': 'vosa states 36k, 43k, SPARE KEY  \t Mineral Grey', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 37, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8bb0e41c-44fc-41c0-82e5-39bb5f050e19.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117509080, 'registration': 'MF71ZPO', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES TOURING', 'derivative': '330e xDrive Sport Pro 5dr Step Auto', 'mileage': 43881, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-20', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/586ed5fc-7b63-4291-bb1e-88c199ed2e00_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/73f9b7db-4a11-45c2-bc16-39a7e400233e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/08710b9a-b628-4ae5-854d-f30e54e6fa5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/b26a89c1-daac-4a9e-987f-36b0d7c88f8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/8fe4f446-4a0f-4a18-b7eb-b8fb00880cc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/324d9d14-7e26-451f-91fc-0496aed50a0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/514aa7b7-ed0e-4db8-b39d-43f95c925fe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/6bca9b24-0fd7-4d6d-b11d-ef4f9157e1fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/c4863142-caf0-474c-a195-489bdabba450_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/24 36k 07/25 43k', 'remarks': 'vosa states 36k, 43k, SPARE KEY  \t Mineral Grey', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 37, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8bb0e41c-44fc-41c0-82e5-39bb5f050e19.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13 with identifier: 117509080
2025-12-02 19:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13 with scrape type 1
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F586ed5fc-7b63-4291-bb1e-88c199ed2e00_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/586ed5fc-7b63-4291-bb1e-88c199ed2e00_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117542530, 'registration': 'FV71HUK', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS SALOON', 'derivative': 'E300e AMG Line Edition 4dr 9G-Tronic', 'mileage': 44352, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-22', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-21', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/FV71HUK/2025-11-27/image/93ef1912-7944-44aa-90cc-31290c73eb3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/b7b86cad-5d69-4cd2-ace0-3168703f7695_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/8d3a4e53-5ff8-4492-8448-8ec840226164_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/5df49d56-939e-4d97-b10e-19e08c8abc1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/ddb97a8c-b515-4e38-a5f4-0a625d18e018_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/a2736ba4-9275-4b14-bb78-d5f49577b8f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/43baf93c-c5f2-48a0-9b4c-51c21054eee9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/dd21a1bf-fe98-4133-9264-b3d43e348087_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/22-13k, 12/23-24k, 12/24-34k, 11/25-43k,', 'remarks': 'SPARE KEY  VOSA STATES 34K 43K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 35, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aaa4fa56-5ab7-468d-b03f-ae8a911762bd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117542530, 'registration': 'FV71HUK', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS SALOON', 'derivative': 'E300e AMG Line Edition 4dr 9G-Tronic', 'mileage': 44352, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-22', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-21', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/FV71HUK/2025-11-27/image/93ef1912-7944-44aa-90cc-31290c73eb3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/b7b86cad-5d69-4cd2-ace0-3168703f7695_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/8d3a4e53-5ff8-4492-8448-8ec840226164_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/5df49d56-939e-4d97-b10e-19e08c8abc1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/ddb97a8c-b515-4e38-a5f4-0a625d18e018_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/a2736ba4-9275-4b14-bb78-d5f49577b8f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/43baf93c-c5f2-48a0-9b4c-51c21054eee9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/dd21a1bf-fe98-4133-9264-b3d43e348087_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/22-13k, 12/23-24k, 12/24-34k, 11/25-43k,', 'remarks': 'SPARE KEY  VOSA STATES 34K 43K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 35, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aaa4fa56-5ab7-468d-b03f-ae8a911762bd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67451644-95be-507f-a155-ac065161e243 with identifier: 117542530
2025-12-02 19:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67451644-95be-507f-a155-ac065161e243 with scrape type 1
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 67451644-95be-507f-a155-ac065161e243
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252F93ef1912-7944-44aa-90cc-31290c73eb3c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/93ef1912-7944-44aa-90cc-31290c73eb3c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117574882, 'registration': 'FM23AFF', 'account': 'ZEN002', 'make': 'MG MOTOR UK', 'model': 'MG4 HATCHBACK', 'derivative': '150kW Trophy EV Long Range 64kWh 5dr Auto', 'mileage': 20872, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-08-17', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FM23AFF/2025-11-28/image/18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/f041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 04/25 14k', 'remarks': 'Tri Coat Paint, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/64c08bd4-1ec2-4019-a9d8-f5215d89ddb5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117574882, 'registration': 'FM23AFF', 'account': 'ZEN002', 'make': 'MG MOTOR UK', 'model': 'MG4 HATCHBACK', 'derivative': '150kW Trophy EV Long Range 64kWh 5dr Auto', 'mileage': 20872, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-08-17', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FM23AFF/2025-11-28/image/18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/f041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 04/25 14k', 'remarks': 'Tri Coat Paint, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/64c08bd4-1ec2-4019-a9d8-f5215d89ddb5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b820cf-82d8-5a63-ac61-5c4de479678a with identifier: 117574882
2025-12-02 19:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b820cf-82d8-5a63-ac61-5c4de479678a with scrape type 1
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 58b820cf-82d8-5a63-ac61-5c4de479678a
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252F18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116832401, 'registration': 'OV71TZE', 'account': 'ZEN002', 'make': 'PEUGEOT', 'model': 'E-2008 ELECTRIC ESTATE', 'derivative': '100kW Allure 50kWh 5dr Auto', 'mileage': 45173, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-26', 'fuel': 'Electric', 'motExpiry': '2025-11-25', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71TZE/2025-11-26/image/adc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/d0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/f6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 06/22-8k, 06/23-20k, 11/24-34k,', 'remarks': 'vosa states 34k, 44k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c45b4eb2-2c90-4cd0-9b4e-7e1c5c1fbd79.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116832401, 'registration': 'OV71TZE', 'account': 'ZEN002', 'make': 'PEUGEOT', 'model': 'E-2008 ELECTRIC ESTATE', 'derivative': '100kW Allure 50kWh 5dr Auto', 'mileage': 45173, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-26', 'fuel': 'Electric', 'motExpiry': '2025-11-25', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71TZE/2025-11-26/image/adc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/d0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/f6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 06/22-8k, 06/23-20k, 11/24-34k,', 'remarks': 'vosa states 34k, 44k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c45b4eb2-2c90-4cd0-9b4e-7e1c5c1fbd79.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faacb675-a6f2-55f2-944b-f8cf40639834 with identifier: 116832401
2025-12-02 19:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faacb675-a6f2-55f2-944b-f8cf40639834 with scrape type 1
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item faacb675-a6f2-55f2-944b-f8cf40639834
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252Fadc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/adc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252Ff48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/f48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PN71OEO/2025-12-01/image/54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609383?view=catalogue)
2025-12-02 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TVC/2025-11-28/image/acaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117458227?view=catalogue)
2025-12-02 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY72ASX/2025-12-01/image/0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101420?view=catalogue)
2025-12-02 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR70ATV/2025-12-01/image/696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117363031?view=catalogue)
2025-12-02 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR70ATV/2025-12-01/image/9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117363031?view=catalogue)
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Found listing with ID: 117446295
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446295%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Scrape type for 117446295: 0
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Found listing with ID: 117446284
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446284%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Scrape type for 117446284: 0
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Found listing with ID: 117366645
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366645%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [astonbarclay.gb] INFO: Scrape type for 117366645: 2
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252Fe0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/e0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252Fc0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252Fce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/ce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F73f9b7db-4a11-45c2-bc16-39a7e400233e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/73f9b7db-4a11-45c2-bc16-39a7e400233e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252Fb7b86cad-5d69-4cd2-ace0-3168703f7695_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/b7b86cad-5d69-4cd2-ace0-3168703f7695_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252Fb049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252F2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d4d510>
2025-12-02 19:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252Fc9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881
2025-12-02 19:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06cebd0>
2025-12-02 19:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09019d0>
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252Fd19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/d19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08cb1562-d169-5941-bed4-70781c82a521
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04f5cd0>
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252F26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4f48589-fe70-55fd-8be4-3136f685545b
2025-12-02 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71HUK/2025-12-01/image/6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117571604?view=catalogue)
2025-12-02 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71HUK/2025-12-01/image/d518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117571604?view=catalogue)
2025-12-02 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TVC/2025-11-28/image/286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117458227?view=catalogue)
2025-12-02 19:03:44 [astonbarclay.gb] INFO: Found listing with ID: 117406459
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406459%27 HTTP/1.1" 200 None
2025-12-02 19:03:44 [astonbarclay.gb] INFO: Scrape type for 117406459: 1
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252Fa28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/a28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252Fd5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/d5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252F8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F08710b9a-b628-4ae5-854d-f30e54e6fa5c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/08710b9a-b628-4ae5-854d-f30e54e6fa5c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252F8d3a4e53-5ff8-4492-8448-8ec840226164_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/8d3a4e53-5ff8-4492-8448-8ec840226164_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252Ff041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/f041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252F7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0467c50>
2025-12-02 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252Ff44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/f44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f078946-171f-5caa-940b-454aafb1ea0e
2025-12-02 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117484817, 'registration': 'FP73AYV', 'account': 'ZEN002', 'make': 'MG MOTOR UK', 'model': 'MG4 HATCHBACK', 'derivative': '125kW SE EV 51kWh 5dr Auto', 'mileage': 5463, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-11-20', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP73AYV/2025-11-26/image/f7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/e96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/420141bc-53e2-475b-9410-838815f29bec_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/de9f11c1-bd6d-43dc-bd97-26782035f274.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117484817, 'registration': 'FP73AYV', 'account': 'ZEN002', 'make': 'MG MOTOR UK', 'model': 'MG4 HATCHBACK', 'derivative': '125kW SE EV 51kWh 5dr Auto', 'mileage': 5463, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-11-20', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP73AYV/2025-11-26/image/f7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/e96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/420141bc-53e2-475b-9410-838815f29bec_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/de9f11c1-bd6d-43dc-bd97-26782035f274.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1756ad73-1e7b-56ab-b081-c9cbc6b316fe with identifier: 117484817
2025-12-02 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe with scrape type 1
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252Ff7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/f7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117397431, 'registration': 'FV72KPE', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'EQA HATCHBACK', 'derivative': 'EQA 250+ 140kW AMG Line Premium 70.5kWh 5dr Auto', 'mileage': 35879, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-24', 'fuel': 'Electric', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FV72KPE/2025-11-27/image/4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/c65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/a984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/23  13K 03/25 28K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/abd1e7d5-b877-4994-94b7-52f9957c916f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117397431, 'registration': 'FV72KPE', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'EQA HATCHBACK', 'derivative': 'EQA 250+ 140kW AMG Line Premium 70.5kWh 5dr Auto', 'mileage': 35879, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-24', 'fuel': 'Electric', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FV72KPE/2025-11-27/image/4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/c65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/a984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 12/23  13K 03/25 28K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/abd1e7d5-b877-4994-94b7-52f9957c916f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7442e60-4434-5001-9201-0290dd09a7d2 with identifier: 117397431
2025-12-02 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7442e60-4434-5001-9201-0290dd09a7d2 with scrape type 1
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a7442e60-4434-5001-9201-0290dd09a7d2
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117505111, 'registration': 'MJ71NZP', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto', 'mileage': 60171, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-25', 'fuel': 'Electric', 'motExpiry': '2026-10-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/a7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/b95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/8ed08253-6918-4338-be3a-f58726470258_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/fc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-33k, 05/25-52k,', 'remarks': 'vosa states 44k, 57k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7c9a08b5-a3d4-4826-a454-d8b820ad1df5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117505111, 'registration': 'MJ71NZP', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto', 'mileage': 60171, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-25', 'fuel': 'Electric', 'motExpiry': '2026-10-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/a7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/b95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/8ed08253-6918-4338-be3a-f58726470258_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/fc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-33k, 05/25-52k,', 'remarks': 'vosa states 44k, 57k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7c9a08b5-a3d4-4826-a454-d8b820ad1df5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef with identifier: 117505111
2025-12-02 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef with scrape type 1
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252F087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117558104, 'registration': 'NU73KPO', 'account': 'ZEN002', 'make': 'MG MOTOR UK', 'model': 'MG4 HATCHBACK', 'derivative': '125kW SE EV 51kWh 5dr Auto', 'mileage': 22806, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-10-24', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NU73KPO/2025-11-27/image/756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/ca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/f944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 04/25 16K', 'remarks': 'Tri Coat Paint SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/db254450-34b0-4e42-8b94-aabb38a6ec88.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117558104, 'registration': 'NU73KPO', 'account': 'ZEN002', 'make': 'MG MOTOR UK', 'model': 'MG4 HATCHBACK', 'derivative': '125kW SE EV 51kWh 5dr Auto', 'mileage': 22806, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-10-24', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NU73KPO/2025-11-27/image/756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/ca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/f944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 04/25 16K', 'remarks': 'Tri Coat Paint SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/db254450-34b0-4e42-8b94-aabb38a6ec88.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b1a2857-f641-575d-97db-3e5989e97f0d with identifier: 117558104
2025-12-02 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b1a2857-f641-575d-97db-3e5989e97f0d with scrape type 1
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9b1a2857-f641-575d-97db-3e5989e97f0d
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf086e310>
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252F54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf077f050>
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252Facaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/acaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08cb1562-d169-5941-bed4-70781c82a521
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05e7c90>
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252F0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4f48589-fe70-55fd-8be4-3136f685545b
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf207fcd0>
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf37e2a10>
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba
2025-12-02 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TZE/2025-11-26/image/adc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116832401?view=catalogue)
2025-12-02 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/586ed5fc-7b63-4291-bb1e-88c199ed2e00_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509080?view=catalogue)
2025-12-02 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71HUK/2025-11-27/image/93ef1912-7944-44aa-90cc-31290c73eb3c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542530?view=catalogue)
2025-12-02 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PN71OEO/2025-12-01/image/7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609383?view=catalogue)
2025-12-02 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR70ATV/2025-12-01/image/afc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117363031?view=catalogue)
2025-12-02 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FM23AFF/2025-11-28/image/18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574882?view=catalogue)
2025-12-02 19:03:46 [astonbarclay.gb] INFO: Found listing with ID: 117363536
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117363536%27 HTTP/1.1" 200 None
2025-12-02 19:03:46 [astonbarclay.gb] INFO: Scrape type for 117363536: 2
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252F1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252F2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252Fb26a89c1-daac-4a9e-987f-36b0d7c88f8f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/b26a89c1-daac-4a9e-987f-36b0d7c88f8f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252F5df49d56-939e-4d97-b10e-19e08c8abc1e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/5df49d56-939e-4d97-b10e-19e08c8abc1e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252F9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252F98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71HUK/2025-12-01/image/90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117571604?view=catalogue)
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252F347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252Fc65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/c65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252Fa7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/a7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07cfa50>
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252F6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f078946-171f-5caa-940b-454aafb1ea0e
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf072ea10>
2025-12-02 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252Fd518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/d518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f078946-171f-5caa-940b-454aafb1ea0e
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07a5bd0>
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252F286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08cb1562-d169-5941-bed4-70781c82a521
2025-12-02 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY72ASX/2025-12-01/image/aba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101420?view=catalogue)
2025-12-02 19:03:47 [astonbarclay.gb] INFO: Found listing with ID: 117509119
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509119%27 HTTP/1.1" 200 None
2025-12-02 19:03:47 [astonbarclay.gb] INFO: Scrape type for 117509119: 1
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F8fe4f446-4a0f-4a18-b7eb-b8fb00880cc4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/8fe4f446-4a0f-4a18-b7eb-b8fb00880cc4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252Fddb97a8c-b515-4e38-a5f4-0a625d18e018_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/ddb97a8c-b515-4e38-a5f4-0a625d18e018_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252F9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252F98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TVC/2025-11-28/image/f48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117458227?view=catalogue)
2025-12-02 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TVC/2025-11-28/image/8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117458227?view=catalogue)
2025-12-02 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TZE/2025-11-26/image/2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116832401?view=catalogue)
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252Fa85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252Fa984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/a984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252Fb95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/b95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252Fca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/ca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0756350>
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252Fadc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/adc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item faacb675-a6f2-55f2-944b-f8cf40639834
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a8b290>
2025-12-02 19:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F586ed5fc-7b63-4291-bb1e-88c199ed2e00_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/586ed5fc-7b63-4291-bb1e-88c199ed2e00_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0312790>
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252F93ef1912-7944-44aa-90cc-31290c73eb3c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/93ef1912-7944-44aa-90cc-31290c73eb3c_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67451644-95be-507f-a155-ac065161e243
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf097cf90>
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252F7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06cce90>
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252Fafc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/afc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09c2890>
2025-12-02 19:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252F18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58b820cf-82d8-5a63-ac61-5c4de479678a
2025-12-02 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71HUK/2025-11-27/image/8d3a4e53-5ff8-4492-8448-8ec840226164_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542530?view=catalogue)
2025-12-02 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TZE/2025-11-26/image/7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116832401?view=catalogue)
2025-12-02 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FM23AFF/2025-11-28/image/f041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574882?view=catalogue)
2025-12-02 19:03:49 [astonbarclay.gb] INFO: Found listing with ID: 117099177
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099177%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [astonbarclay.gb] INFO: Scrape type for 117099177: 2
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F324d9d14-7e26-451f-91fc-0496aed50a0c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/324d9d14-7e26-451f-91fc-0496aed50a0c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252Fa2736ba4-9275-4b14-bb78-d5f49577b8f8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/a2736ba4-9275-4b14-bb78-d5f49577b8f8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252F1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252Fd0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/d0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf044c510>
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252F90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f078946-171f-5caa-940b-454aafb1ea0e
2025-12-02 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/08710b9a-b628-4ae5-854d-f30e54e6fa5c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509080?view=catalogue)
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252F3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252F2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU73KPO/2025-11-27/image/756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117558104?view=catalogue)
2025-12-02 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116832401?view=catalogue)
2025-12-02 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71HUK/2025-12-01/image/8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117571604?view=catalogue)
2025-12-02 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR70ATV/2025-12-01/image/82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117363031?view=catalogue)
2025-12-02 19:03:49 [astonbarclay.gb] INFO: Found listing with ID: 116930700
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116930700%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [astonbarclay.gb] INFO: Scrape type for 116930700: 2
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F514aa7b7-ed0e-4db8-b39d-43f95c925fe3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/514aa7b7-ed0e-4db8-b39d-43f95c925fe3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252F43baf93c-c5f2-48a0-9b4c-51c21054eee9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/43baf93c-c5f2-48a0-9b4c-51c21054eee9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252Fb8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252Ff6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/f6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117243233?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02f2b90>
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252Faba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/aba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4f48589-fe70-55fd-8be4-3136f685545b
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0768250>
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252Ff48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/f48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08cb1562-d169-5941-bed4-70781c82a521
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf094aed0>
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252F8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08cb1562-d169-5941-bed4-70781c82a521
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0369010>
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252F2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item faacb675-a6f2-55f2-944b-f8cf40639834
2025-12-02 19:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU73KPO/2025-11-27/image/34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117558104?view=catalogue)
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252Fa938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252F099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0338490>
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252F8d3a4e53-5ff8-4492-8448-8ec840226164_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/8d3a4e53-5ff8-4492-8448-8ec840226164_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67451644-95be-507f-a155-ac065161e243
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0512e90>
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252F7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item faacb675-a6f2-55f2-944b-f8cf40639834
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf081e250>
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252Ff041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/f041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58b820cf-82d8-5a63-ac61-5c4de479678a
2025-12-02 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116832401?view=catalogue)
2025-12-02 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/a7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117505111?view=catalogue)
2025-12-02 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV72KPE/2025-11-27/image/c65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117397431?view=catalogue)
2025-12-02 19:03:51 [astonbarclay.gb] INFO: Found listing with ID: 117082695
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117082695%27 HTTP/1.1" 200 None
2025-12-02 19:03:51 [astonbarclay.gb] INFO: Scrape type for 117082695: 2
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F6bca9b24-0fd7-4d6d-b11d-ef4f9157e1fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/6bca9b24-0fd7-4d6d-b11d-ef4f9157e1fb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252Fdd21a1bf-fe98-4133-9264-b3d43e348087_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/dd21a1bf-fe98-4133-9264-b3d43e348087_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252F2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252F751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU73KPO/2025-11-27/image/ca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117558104?view=catalogue)
2025-12-02 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71HUK/2025-11-27/image/ddb97a8c-b515-4e38-a5f4-0a625d18e018_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542530?view=catalogue)
2025-12-02 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574882?view=catalogue)
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252F78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252F8ed08253-6918-4338-be3a-f58726470258_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/8ed08253-6918-4338-be3a-f58726470258_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117418998?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117427357?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117399393?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117473837?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0825ad0>
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F08710b9a-b628-4ae5-854d-f30e54e6fa5c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/08710b9a-b628-4ae5-854d-f30e54e6fa5c_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09964d0>
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b1a2857-f641-575d-97db-3e5989e97f0d
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac8d90>
2025-12-02 19:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252F98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item faacb675-a6f2-55f2-944b-f8cf40639834
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a9a990>
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252F8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f078946-171f-5caa-940b-454aafb1ea0e
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0823210>
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba
2025-12-02 19:03:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117243233, 'registration': 'DL72JSU', 'account': 'ZEN009', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi 48V MHD Premium 5dr 2WD DCT', 'mileage': 53400, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-02-14', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DL72JSU/2025-12-01/image/def0b371-c195-47e9-ab0f-f64bc1fe5ff6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/c9e0f841-d222-4ee5-8d8d-777ce8735f31_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/5550f38a-a9a9-4e1a-9fc7-2ef448f25481_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/e1e0f3f8-ae3b-4a08-b5c2-e22107458d80_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/bc62e553-f6bf-4fd6-9f36-11a1065bd590_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/4f0ea73b-2912-43b8-ac63-d02d25bdd4ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/256630e4-9725-4aec-97cf-180367fc8585_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/b872aa22-a6bc-43f3-ac98-e26e22ff17fc_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/23 9K 01/24 20K 06/24 30K 02/25 42K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/62986305-bd5e-4a57-be35-0b0dd4ee76c5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117243233, 'registration': 'DL72JSU', 'account': 'ZEN009', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi 48V MHD Premium 5dr 2WD DCT', 'mileage': 53400, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-02-14', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DL72JSU/2025-12-01/image/def0b371-c195-47e9-ab0f-f64bc1fe5ff6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/c9e0f841-d222-4ee5-8d8d-777ce8735f31_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/5550f38a-a9a9-4e1a-9fc7-2ef448f25481_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/e1e0f3f8-ae3b-4a08-b5c2-e22107458d80_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/bc62e553-f6bf-4fd6-9f36-11a1065bd590_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/4f0ea73b-2912-43b8-ac63-d02d25bdd4ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/256630e4-9725-4aec-97cf-180367fc8585_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/b872aa22-a6bc-43f3-ac98-e26e22ff17fc_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/23 9K 01/24 20K 06/24 30K 02/25 42K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/62986305-bd5e-4a57-be35-0b0dd4ee76c5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e47513e2-2d3f-5d1c-b24c-2eae086da624 with identifier: 117243233
2025-12-02 19:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e47513e2-2d3f-5d1c-b24c-2eae086da624 with scrape type 1
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e47513e2-2d3f-5d1c-b24c-2eae086da624
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252Fdef0b371-c195-47e9-ab0f-f64bc1fe5ff6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/def0b371-c195-47e9-ab0f-f64bc1fe5ff6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TZE/2025-11-26/image/d0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116832401?view=catalogue)
2025-12-02 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FM23AFF/2025-11-28/image/1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574882?view=catalogue)
2025-12-02 19:03:52 [astonbarclay.gb] INFO: Found listing with ID: 117357513
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117357513%27 HTTP/1.1" 200 None
2025-12-02 19:03:52 [astonbarclay.gb] INFO: Scrape type for 117357513: 1
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252Fc4863142-caf0-474c-a195-489bdabba450_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/c4863142-caf0-474c-a195-489bdabba450_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252Fe96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/e96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252Ffc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/fc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252Ff944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/f944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252Fc9e0f841-d222-4ee5-8d8d-777ce8735f31_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/c9e0f841-d222-4ee5-8d8d-777ce8735f31_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71HUK/2025-11-27/image/a2736ba4-9275-4b14-bb78-d5f49577b8f8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542530?view=catalogue)
2025-12-02 19:03:52 [astonbarclay.gb] INFO: Found listing with ID: 117048263
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117048263%27 HTTP/1.1" 200 None
2025-12-02 19:03:52 [astonbarclay.gb] INFO: Scrape type for 117048263: 2
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0744310>
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b1a2857-f641-575d-97db-3e5989e97f0d
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf091ebd0>
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252F98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item faacb675-a6f2-55f2-944b-f8cf40639834
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d3ccd0>
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252Fa7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/a7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09561d0>
2025-12-02 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252Fc65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/c65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7442e60-4434-5001-9201-0290dd09a7d2
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0972a50>
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252Fca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/ca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b1a2857-f641-575d-97db-3e5989e97f0d
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09b4890>
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252Fddb97a8c-b515-4e38-a5f4-0a625d18e018_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/ddb97a8c-b515-4e38-a5f4-0a625d18e018_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67451644-95be-507f-a155-ac065161e243
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf062b8d0>
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252F9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58b820cf-82d8-5a63-ac61-5c4de479678a
2025-12-02 19:03:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117418998, 'registration': 'FR19KDO', 'account': 'THE109', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Excite 5dr', 'mileage': 43242, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-07-24', 'fuel': 'Petrol', 'motExpiry': '2026-07-24', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FR19KDO/2025-12-02/image/621c1fa1-23df-4ae3-9df4-10c326fcc2ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/07e5cc22-caa1-4c71-96b8-57804a91b231_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/29b94a9c-e8c5-4f79-ad1b-da7645137f08_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/b5bbe34f-8e40-4c14-b473-8e2da489382e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/f5420106-4094-49aa-94b7-fb9d7e871e86_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/5a3771c8-c45e-4076-aa58-a23db350487b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/cfe323b9-2170-4a75-961f-f7520dbe1712_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/057f6d45-8b90-4be3-824c-a3d163df6f9d_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/20-7k, 09/21-11k, OIL & FILTER CHANGE 06/25', 'remarks': 'SPARE KEY VOSA STATES 18K 26K 34K 40K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/921eb6bc-271a-431a-a19f-8abc56630039.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117418998, 'registration': 'FR19KDO', 'account': 'THE109', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Excite 5dr', 'mileage': 43242, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-07-24', 'fuel': 'Petrol', 'motExpiry': '2026-07-24', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FR19KDO/2025-12-02/image/621c1fa1-23df-4ae3-9df4-10c326fcc2ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/07e5cc22-caa1-4c71-96b8-57804a91b231_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/29b94a9c-e8c5-4f79-ad1b-da7645137f08_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/b5bbe34f-8e40-4c14-b473-8e2da489382e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/f5420106-4094-49aa-94b7-fb9d7e871e86_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/5a3771c8-c45e-4076-aa58-a23db350487b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/cfe323b9-2170-4a75-961f-f7520dbe1712_removebg.jpg?w=600', 'https://abimg003.imgix.net/FR19KDO/2025-12-02/image/057f6d45-8b90-4be3-824c-a3d163df6f9d_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/20-7k, 09/21-11k, OIL & FILTER CHANGE 06/25', 'remarks': 'SPARE KEY VOSA STATES 18K 26K 34K 40K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/921eb6bc-271a-431a-a19f-8abc56630039.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaf5ba6f-1057-5020-80b9-30ac569a4f76 with identifier: 117418998
2025-12-02 19:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaf5ba6f-1057-5020-80b9-30ac569a4f76 with scrape type 2
2025-12-02 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaf5ba6f-1057-5020-80b9-30ac569a4f76 with scrape type 2
2025-12-02 19:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aaf5ba6f-1057-5020-80b9-30ac569a4f76, identifier: 117418998
2025-12-02 19:03:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117427357, 'registration': 'KR72RSX', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [136] M Sport 5dr Step Auto [LCP]', 'mileage': 38352, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-02-01', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR72RSX/2025-11-27/image/8ee9ffe5-911e-4348-ad41-ff5caf88a8b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/69208df4-01ca-4eb2-b1d0-6f34e95bbae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/e057a2da-5cfa-4542-8874-4d806f55fb86_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/cfd69e99-a3c9-441b-aee3-826e193ba635_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/eca7df83-6c61-4d74-bd3d-2c436f7656d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/1371fca9-4172-4fef-9b91-91a964d7e0c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/61f7444b-591b-470e-9ed9-31bc8c73b98c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/a4aaf97a-de19-41ca-93ca-749cc89232ab_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24 15K 06/25 32K', 'remarks': 'Elec Adjt Lmbr Suprt-drvr/Frnt Psngr\tSpace-saver Spare Wheel, spare key', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6f752251-9bf4-4acc-8e7b-f6a168174b46.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117427357, 'registration': 'KR72RSX', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [136] M Sport 5dr Step Auto [LCP]', 'mileage': 38352, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-02-01', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR72RSX/2025-11-27/image/8ee9ffe5-911e-4348-ad41-ff5caf88a8b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/69208df4-01ca-4eb2-b1d0-6f34e95bbae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/e057a2da-5cfa-4542-8874-4d806f55fb86_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/cfd69e99-a3c9-441b-aee3-826e193ba635_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/eca7df83-6c61-4d74-bd3d-2c436f7656d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/1371fca9-4172-4fef-9b91-91a964d7e0c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/61f7444b-591b-470e-9ed9-31bc8c73b98c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/a4aaf97a-de19-41ca-93ca-749cc89232ab_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24 15K 06/25 32K', 'remarks': 'Elec Adjt Lmbr Suprt-drvr/Frnt Psngr\tSpace-saver Spare Wheel, spare key', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6f752251-9bf4-4acc-8e7b-f6a168174b46.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93d39008-2bb1-5708-ae8d-01ea6e6064cc with identifier: 117427357
2025-12-02 19:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc with scrape type 1
2025-12-02 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252F8ee9ffe5-911e-4348-ad41-ff5caf88a8b8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/8ee9ffe5-911e-4348-ad41-ff5caf88a8b8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117399393, 'registration': 'YA74HSD', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 12029, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-01-17', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YA74HSD/2025-11-24/image/3fe55b5e-56ed-4e39-9522-e1fc86efa07e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/2c2140fe-6da2-46df-9915-91c12a61b854_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/01848392-c553-4f07-b948-cc917c2cc971_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/9ad2bdcd-04ed-4624-a580-f77043ba8361_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/6a5dd841-c0de-4458-93d9-3645c07c7f32_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/916cbb48-1ea9-4cb4-9fc2-dd8bacf92366_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/b9045a86-d4df-4d55-a6ed-46813085bffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/425744a9-5d26-4f9a-9670-2e21505e18b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/a91fe2e5-5819-4132-aca1-14b44c104754_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/25-7k,', 'remarks': '*Copy of V5*', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c47cbb17-ce52-46c7-aa63-381ca6db49a3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117399393, 'registration': 'YA74HSD', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 12029, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-01-17', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YA74HSD/2025-11-24/image/3fe55b5e-56ed-4e39-9522-e1fc86efa07e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/2c2140fe-6da2-46df-9915-91c12a61b854_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/01848392-c553-4f07-b948-cc917c2cc971_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/9ad2bdcd-04ed-4624-a580-f77043ba8361_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/6a5dd841-c0de-4458-93d9-3645c07c7f32_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/916cbb48-1ea9-4cb4-9fc2-dd8bacf92366_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/b9045a86-d4df-4d55-a6ed-46813085bffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/425744a9-5d26-4f9a-9670-2e21505e18b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA74HSD/2025-11-24/image/a91fe2e5-5819-4132-aca1-14b44c104754_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/25-7k,', 'remarks': '*Copy of V5*', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c47cbb17-ce52-46c7-aa63-381ca6db49a3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e97ec23-8431-5287-a283-74a77f663151 with identifier: 117399393
2025-12-02 19:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e97ec23-8431-5287-a283-74a77f663151 with scrape type 2
2025-12-02 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e97ec23-8431-5287-a283-74a77f663151 with scrape type 2
2025-12-02 19:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9e97ec23-8431-5287-a283-74a77f663151, identifier: 117399393
2025-12-02 19:03:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117473837, 'registration': 'NU71TVX', 'account': 'ZEN002', 'make': 'FIAT', 'model': '500 ELECTRIC HATCHBACK', 'derivative': '87kW Passion 42kWh 3dr Auto', 'mileage': 38671, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-05', 'fuel': 'Electric', 'motExpiry': '2026-05-11', 'doors': 3, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/fdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/edbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/22 9K 09/23 19K 08/24 39K 06/25 51K', 'remarks': 'VOSA STATES 31K, spare key', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4363175-7e3f-4058-bc40-4a59ae823f04.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117473837, 'registration': 'NU71TVX', 'account': 'ZEN002', 'make': 'FIAT', 'model': '500 ELECTRIC HATCHBACK', 'derivative': '87kW Passion 42kWh 3dr Auto', 'mileage': 38671, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-05', 'fuel': 'Electric', 'motExpiry': '2026-05-11', 'doors': 3, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/fdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/edbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/22 9K 09/23 19K 08/24 39K 06/25 51K', 'remarks': 'VOSA STATES 31K, spare key', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4363175-7e3f-4058-bc40-4a59ae823f04.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4480acf2-bd24-5ae4-bc4a-13a999a29e14 with identifier: 117473837
2025-12-02 19:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14 with scrape type 1
2025-12-02 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252Fcb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU73KPO/2025-11-27/image/7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117558104?view=catalogue)
2025-12-02 19:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU73KPO/2025-11-27/image/0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117558104?view=catalogue)
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252F420141bc-53e2-475b-9410-838815f29bec_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/420141bc-53e2-475b-9410-838815f29bec_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252F2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252F5550f38a-a9a9-4e1a-9fc7-2ef448f25481_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/5550f38a-a9a9-4e1a-9fc7-2ef448f25481_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aaf5ba6f-1057-5020-80b9-30ac569a4f76 with identifier: 117418998
2025-12-02 19:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aaf5ba6f-1057-5020-80b9-30ac569a4f76 with identifier: 117418998
2025-12-02 19:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: aaf5ba6f-1057-5020-80b9-30ac569a4f76 with identifier: 117418998 to the API
2025-12-02 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27aaf5ba6f-1057-5020-80b9-30ac569a4f76%27 HTTP/1.1" 200 None
2025-12-02 19:03:56 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id aaf5ba6f-1057-5020-80b9-30ac569a4f76: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:03:55 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117418998?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'YELLOW',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'aaf5ba6f-1057-5020-80b9-30ac569a4f76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FR19KDO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117418998',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MG MOTOR UK',
 'model': 'MG3 HATCHBACK',
 'odometer': 43242,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': 'TCB Group - Prime',
 'title': 'MG MOTOR UK MG3 HATCHBACK 1.5 VTi-TECH Excite 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTi-TECH Excite 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418998%27 HTTP/1.1" 200 None
2025-12-02 19:03:56 [astonbarclay.gb] INFO: Saving data for 117418998: {'auction_closing_time': 1764842400.0, 'created_time': 1764615803.250091, 'last_price_update_time': 1764702236.123537}
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117418998') HTTP/1.1" 204 0
2025-12-02 19:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9e97ec23-8431-5287-a283-74a77f663151 with identifier: 117399393
2025-12-02 19:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9e97ec23-8431-5287-a283-74a77f663151 with identifier: 117399393
2025-12-02 19:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9e97ec23-8431-5287-a283-74a77f663151 with identifier: 117399393 to the API
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117399393?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '9e97ec23-8431-5287-a283-74a77f663151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YA74HSD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117399393',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 12029,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-17',
 'seller_name': 'Liquid Fleet',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi 207 HEV 3 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6T GDi 207 HEV 3 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399393%27 HTTP/1.1" 200 None
2025-12-02 19:03:56 [astonbarclay.gb] INFO: Saving data for 117399393: {'auction_closing_time': 1764842400.0, 'created_time': 1764097347.199916, 'last_price_update_time': 1764702236.526502}
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117399393') HTTP/1.1" 204 0
2025-12-02 19:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/324d9d14-7e26-451f-91fc-0496aed50a0c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509080?view=catalogue)
2025-12-02 19:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117505111?view=catalogue)
2025-12-02 19:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117484817?view=catalogue)
2025-12-02 19:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117505111?view=catalogue)
2025-12-02 19:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV72KPE/2025-11-27/image/384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117397431?view=catalogue)
2025-12-02 19:03:56 [astonbarclay.gb] INFO: Found listing with ID: 116152685
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152685%27 HTTP/1.1" 200 None
2025-12-02 19:03:56 [astonbarclay.gb] INFO: Scrape type for 116152685: 2
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252F69208df4-01ca-4eb2-b1d0-6f34e95bbae6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/69208df4-01ca-4eb2-b1d0-6f34e95bbae6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252Fcca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TZE/2025-11-26/image/f6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116832401?view=catalogue)
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252Fe1e0f3f8-ae3b-4a08-b5c2-e22107458d80_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/e1e0f3f8-ae3b-4a08-b5c2-e22107458d80_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0678a10>
2025-12-02 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252Fd0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/d0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item faacb675-a6f2-55f2-944b-f8cf40639834
2025-12-02 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09cc390>
2025-12-02 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252F1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58b820cf-82d8-5a63-ac61-5c4de479678a
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0679a10>
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252Fa2736ba4-9275-4b14-bb78-d5f49577b8f8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/a2736ba4-9275-4b14-bb78-d5f49577b8f8_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67451644-95be-507f-a155-ac065161e243
2025-12-02 19:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TZE/2025-11-26/image/751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116832401?view=catalogue)
2025-12-02 19:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574882?view=catalogue)
2025-12-02 19:03:57 [astonbarclay.gb] INFO: Found listing with ID: 116945130
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116945130%27 HTTP/1.1" 200 None
2025-12-02 19:03:57 [astonbarclay.gb] INFO: Scrape type for 116945130: 2
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252Fe057a2da-5cfa-4542-8874-4d806f55fb86_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/e057a2da-5cfa-4542-8874-4d806f55fb86_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252F49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252Fbc62e553-f6bf-4fd6-9f36-11a1065bd590_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/bc62e553-f6bf-4fd6-9f36-11a1065bd590_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a82710>
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b1a2857-f641-575d-97db-3e5989e97f0d
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf2007c90>
2025-12-02 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b1a2857-f641-575d-97db-3e5989e97f0d
2025-12-02 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71HUK/2025-11-27/image/dd21a1bf-fe98-4133-9264-b3d43e348087_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542530?view=catalogue)
2025-12-02 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71HUK/2025-11-27/image/43baf93c-c5f2-48a0-9b4c-51c21054eee9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542530?view=catalogue)
2025-12-02 19:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FM23AFF/2025-11-28/image/2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574882?view=catalogue)
2025-12-02 19:03:58 [astonbarclay.gb] INFO: Found listing with ID: 117554866
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554866%27 HTTP/1.1" 200 None
2025-12-02 19:03:58 [astonbarclay.gb] INFO: Scrape type for 117554866: 0
2025-12-02 19:03:58 [astonbarclay.gb] INFO: Found listing with ID: 117554653
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554653%27 HTTP/1.1" 200 None
2025-12-02 19:03:58 [astonbarclay.gb] INFO: Scrape type for 117554653: 0
2025-12-02 19:03:58 [astonbarclay.gb] INFO: Found listing with ID: 117554737
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554737%27 HTTP/1.1" 200 None
2025-12-02 19:03:58 [astonbarclay.gb] INFO: Scrape type for 117554737: 0
2025-12-02 19:03:58 [astonbarclay.gb] INFO: Found listing with ID: 116136757
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116136757%27 HTTP/1.1" 200 None
2025-12-02 19:03:58 [astonbarclay.gb] INFO: Scrape type for 116136757: 2
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252Fcfd69e99-a3c9-441b-aee3-826e193ba635_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/cfd69e99-a3c9-441b-aee3-826e193ba635_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252F62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0635e50>
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F324d9d14-7e26-451f-91fc-0496aed50a0c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/324d9d14-7e26-451f-91fc-0496aed50a0c_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06df890>
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252F2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06ddb50>
2025-12-02 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252Fa938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03f9d90>
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252F099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c8ab90>
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7442e60-4434-5001-9201-0290dd09a7d2
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03faf90>
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252Ff6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/f6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg?w=600 saved to cache
2025-12-02 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item faacb675-a6f2-55f2-944b-f8cf40639834
2025-12-02 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU73KPO/2025-11-27/image/f944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117558104?view=catalogue)
2025-12-02 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/6bca9b24-0fd7-4d6d-b11d-ef4f9157e1fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509080?view=catalogue)
2025-12-02 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL72JSU/2025-12-01/image/c9e0f841-d222-4ee5-8d8d-777ce8735f31_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117243233?view=catalogue)
2025-12-02 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/c4863142-caf0-474c-a195-489bdabba450_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509080?view=catalogue)
2025-12-02 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL72JSU/2025-12-01/image/5550f38a-a9a9-4e1a-9fc7-2ef448f25481_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117243233?view=catalogue)
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252F4f0ea73b-2912-43b8-ac63-d02d25bdd4ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/4f0ea73b-2912-43b8-ac63-d02d25bdd4ad_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:59 [astonbarclay.gb] INFO: Found listing with ID: 117574337
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117574337%27 HTTP/1.1" 200 None
2025-12-02 19:03:59 [astonbarclay.gb] INFO: Scrape type for 117574337: 1
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252Feca7df83-6c61-4d74-bd3d-2c436f7656d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/eca7df83-6c61-4d74-bd3d-2c436f7656d1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252F436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117082695?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06e4710>
2025-12-02 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TZE%252F2025-11-26%252Fimage%252F751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TZE/2025-11-26/image/751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item faacb675-a6f2-55f2-944b-f8cf40639834
2025-12-02 19:04:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: faacb675-a6f2-55f2-944b-f8cf40639834, skipping ID generation
2025-12-02 19:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faacb675-a6f2-55f2-944b-f8cf40639834 with scrape type 1
2025-12-02 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item faacb675-a6f2-55f2-944b-f8cf40639834 from tracking dictionaries
2025-12-02 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item faacb675-a6f2-55f2-944b-f8cf40639834 sending to next pipeline
2025-12-02 19:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: faacb675-a6f2-55f2-944b-f8cf40639834, identifier: 116832401
2025-12-02 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07c5250>
2025-12-02 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252Fb8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58b820cf-82d8-5a63-ac61-5c4de479678a
2025-12-02 19:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU73KPO/2025-11-27/image/205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117558104?view=catalogue)
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252F256630e4-9725-4aec-97cf-180367fc8585_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/256630e4-9725-4aec-97cf-180367fc8585_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: faacb675-a6f2-55f2-944b-f8cf40639834 with identifier: 116832401
2025-12-02 19:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: faacb675-a6f2-55f2-944b-f8cf40639834 with identifier: 116832401
2025-12-02 19:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'peugeot e-2008 electric estate 100kw allure 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-2008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 45173, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116832401', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw allure 50kwh 5dr auto', 'license_plate': 'ov71tze', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'faacb675-a6f2-55f2-944b-f8cf40639834', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/adc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32435}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32077}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28713}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28112}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51175}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/d0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40446}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/f6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 9282}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53136}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'peugeot e-2008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 72698} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'faacb675-a6f2-55f2-944b-f8cf40639834',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ov71tze',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116832401',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'peugeot',
     'make_model': 'peugeot e-2008 electric estate',
     'model': 'e-2008 electric estate',
     'odometer': 45173,
     'odometer_in_km': 72698,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32435,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/adc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32077,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28713,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28112,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51175,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40446,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/d0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 9282,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/f6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53136,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-26',
     'sanitized_make': 'peugeot',
     'seller_name': 'zenith',
     'title': 'peugeot e-2008 electric estate 100kw allure 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw allure 50kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: faacb675-a6f2-55f2-944b-f8cf40639834 spider: astonbarclay.gb
2025-12-02 19:04:00 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: faacb675-a6f2-55f2-944b-f8cf40639834 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'peugeot e-2008 electric estate 100kw allure 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-2008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 45173, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116832401', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw allure 50kwh 5dr auto', 'license_plate': 'ov71tze', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'faacb675-a6f2-55f2-944b-f8cf40639834', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/adc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32435}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32077}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28713}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28112}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51175}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/d0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40446}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/f6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 9282}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53136}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'peugeot e-2008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 72698} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'faacb675-a6f2-55f2-944b-f8cf40639834',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ov71tze',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116832401',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'peugeot',
     'make_model': 'peugeot e-2008 electric estate',
     'model': 'e-2008 electric estate',
     'odometer': 45173,
     'odometer_in_km': 72698,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32435,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/adc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32077,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28713,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28112,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51175,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40446,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/d0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 9282,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/f6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53136,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-26',
     'sanitized_make': 'peugeot',
     'seller_name': 'zenith',
     'title': 'peugeot e-2008 electric estate 100kw allure 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw allure 50kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'faacb675-a6f2-55f2-944b-f8cf40639834',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OV71TZE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116832401',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'PEUGEOT',
 'model': 'E-2008 ELECTRIC ESTATE',
 'odometer': 45173,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32435,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/adc06af2-0492-4eb4-94e5-89e8f8cb9e14_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32077,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/2792b91a-647f-4dca-9824-b9d56718a60a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28713,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/7b801fad-633c-4fec-98e4-50b14e5d99ea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28112,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c253b1-c752-4dc1-bddd-1cae28c7d0da_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51175,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/98c4de62-bed2-4a56-b627-296fd3336bd6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40446,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/d0a07dfd-a6d0-4b04-9158-70953fc72244_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 9282,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/f6164731-5ca8-4cde-873a-b1ccaea537ec_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faacb675-a6f2-55f2-944b-f8cf40639834/faacb675-a6f2-55f2-944b-f8cf40639834_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53136,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TZE/2025-11-26/image/751556bd-da6c-4026-b3f3-dcaaf8ae8f77_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seller_name': 'Zenith',
 'title': 'PEUGEOT E-2008 ELECTRIC ESTATE 100kW Allure 50kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Allure 50kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116832401%27 HTTP/1.1" 200 None
2025-12-02 19:04:00 [astonbarclay.gb] INFO: Saving data for 116832401: {'created_time': 1764702240.897882, 'last_price_update_time': 1764702240.897892, 'auction_closing_time': 1764842400.0}
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116832401') HTTP/1.1" 204 0
2025-12-02 19:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV72KPE/2025-11-27/image/7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117397431?view=catalogue)
2025-12-02 19:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117505111?view=catalogue)
2025-12-02 19:04:00 [astonbarclay.gb] INFO: Found listing with ID: 117448541
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117448541%27 HTTP/1.1" 200 None
2025-12-02 19:04:00 [astonbarclay.gb] INFO: Scrape type for 117448541: 0
2025-12-02 19:04:00 [astonbarclay.gb] INFO: Found listing with ID: 117339782
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117339782%27 HTTP/1.1" 200 None
2025-12-02 19:04:00 [astonbarclay.gb] INFO: Scrape type for 117339782: 0
2025-12-02 19:04:00 [astonbarclay.gb] INFO: Found listing with ID: 117180618
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180618%27 HTTP/1.1" 200 None
2025-12-02 19:04:00 [astonbarclay.gb] INFO: Scrape type for 117180618: 1
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252F1371fca9-4172-4fef-9b91-91a964d7e0c6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/1371fca9-4172-4fef-9b91-91a964d7e0c6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252F009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117473837?view=catalogue)
2025-12-02 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117473837?view=catalogue)
2025-12-02 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU71TVX/2025-11-28/image/49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117473837?view=catalogue)
2025-12-02 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR72RSX/2025-11-27/image/69208df4-01ca-4eb2-b1d0-6f34e95bbae6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117427357?view=catalogue)
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252Fb872aa22-a6bc-43f3-ac98-e26e22ff17fc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/b872aa22-a6bc-43f3-ac98-e26e22ff17fc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf031eb50>
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252Fdd21a1bf-fe98-4133-9264-b3d43e348087_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/dd21a1bf-fe98-4133-9264-b3d43e348087_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67451644-95be-507f-a155-ac065161e243
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08ce490>
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252F43baf93c-c5f2-48a0-9b4c-51c21054eee9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/43baf93c-c5f2-48a0-9b4c-51c21054eee9_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67451644-95be-507f-a155-ac065161e243
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04ed7d0>
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252F2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58b820cf-82d8-5a63-ac61-5c4de479678a
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf067aad0>
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252Ff944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/f944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b1a2857-f641-575d-97db-3e5989e97f0d
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06471d0>
2025-12-02 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F6bca9b24-0fd7-4d6d-b11d-ef4f9157e1fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/6bca9b24-0fd7-4d6d-b11d-ef4f9157e1fb_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf33605d0>
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252Fc9e0f841-d222-4ee5-8d8d-777ce8735f31_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/c9e0f841-d222-4ee5-8d8d-777ce8735f31_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e47513e2-2d3f-5d1c-b24c-2eae086da624
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0483490>
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252Fc4863142-caf0-474c-a195-489bdabba450_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/c4863142-caf0-474c-a195-489bdabba450_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0645f50>
2025-12-02 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252F5550f38a-a9a9-4e1a-9fc7-2ef448f25481_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/5550f38a-a9a9-4e1a-9fc7-2ef448f25481_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e47513e2-2d3f-5d1c-b24c-2eae086da624
2025-12-02 19:04:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117082695, 'registration': 'LM73HXP', 'account': 'LIQ001', 'make': 'AUDI', 'model': 'A1 SPORTBACK', 'derivative': '25 TFSI Technik 5dr', 'mileage': 35570, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-09-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LM73HXP/2025-11-13/image/1d0f9d00-c870-4633-bcbf-4cec5dd9a9b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/ac661842-5e47-4319-9248-2026fe820c08_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/3ad564f4-b6c4-4105-82d5-3af9b1a74b8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/a0b6e702-e7e4-4035-83de-1dcb34597e59_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/0a8041ac-08d5-4ef6-b303-e67bff60080b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/80f7f73b-ac60-4ce1-b05f-91930d8e1c5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/ff6ee0b2-eeb1-43c9-a1f0-1e0e3ffd4976_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/2d9bbe42-a8e4-43b5-9fcd-469705d9e6c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/d4beccef-058b-4c2c-b3f3-3e89eb66cf27_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/d28cabf2-d8e8-4621-88c8-6ee129c27fba_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ebffbf28-912b-4893-982c-12ec6c5330a5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117082695, 'registration': 'LM73HXP', 'account': 'LIQ001', 'make': 'AUDI', 'model': 'A1 SPORTBACK', 'derivative': '25 TFSI Technik 5dr', 'mileage': 35570, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-09-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LM73HXP/2025-11-13/image/1d0f9d00-c870-4633-bcbf-4cec5dd9a9b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/ac661842-5e47-4319-9248-2026fe820c08_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/3ad564f4-b6c4-4105-82d5-3af9b1a74b8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/a0b6e702-e7e4-4035-83de-1dcb34597e59_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/0a8041ac-08d5-4ef6-b303-e67bff60080b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/80f7f73b-ac60-4ce1-b05f-91930d8e1c5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/ff6ee0b2-eeb1-43c9-a1f0-1e0e3ffd4976_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/2d9bbe42-a8e4-43b5-9fcd-469705d9e6c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/d4beccef-058b-4c2c-b3f3-3e89eb66cf27_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM73HXP/2025-11-13/image/d28cabf2-d8e8-4621-88c8-6ee129c27fba_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ebffbf28-912b-4893-982c-12ec6c5330a5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76fcaf63-2c69-5f2f-a228-fc8599b63e9e with identifier: 117082695
2025-12-02 19:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76fcaf63-2c69-5f2f-a228-fc8599b63e9e with scrape type 2
2025-12-02 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76fcaf63-2c69-5f2f-a228-fc8599b63e9e with scrape type 2
2025-12-02 19:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 76fcaf63-2c69-5f2f-a228-fc8599b63e9e, identifier: 117082695
2025-12-02 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP73AYV/2025-11-26/image/420141bc-53e2-475b-9410-838815f29bec_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117484817?view=catalogue)
2025-12-02 19:04:03 [astonbarclay.gb] INFO: Found listing with ID: 117188811
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188811%27 HTTP/1.1" 200 None
2025-12-02 19:04:03 [astonbarclay.gb] INFO: Scrape type for 117188811: 0
2025-12-02 19:04:03 [astonbarclay.gb] INFO: Found listing with ID: 117215585
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215585%27 HTTP/1.1" 200 None
2025-12-02 19:04:03 [astonbarclay.gb] INFO: Scrape type for 117215585: 0
2025-12-02 19:04:03 [astonbarclay.gb] INFO: Found listing with ID: 117215446
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215446%27 HTTP/1.1" 200 None
2025-12-02 19:04:03 [astonbarclay.gb] INFO: Scrape type for 117215446: 2
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252F61f7444b-591b-470e-9ed9-31bc8c73b98c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/61f7444b-591b-470e-9ed9-31bc8c73b98c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252Ffdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/fdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 76fcaf63-2c69-5f2f-a228-fc8599b63e9e with identifier: 117082695
2025-12-02 19:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 76fcaf63-2c69-5f2f-a228-fc8599b63e9e with identifier: 117082695
2025-12-02 19:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 76fcaf63-2c69-5f2f-a228-fc8599b63e9e with identifier: 117082695 to the API
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117082695?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '76fcaf63-2c69-5f2f-a228-fc8599b63e9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LM73HXP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117082695',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'AUDI',
 'model': 'A1 SPORTBACK',
 'odometer': 35570,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-18',
 'seller_name': 'Liquid Fleet',
 'title': 'AUDI A1 SPORTBACK 25 TFSI Technik 5dr',
 'transmission': 'manual',
 'trim': '25 TFSI Technik 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117082695%27 HTTP/1.1" 200 None
2025-12-02 19:04:03 [astonbarclay.gb] INFO: Saving data for 117082695: {'auction_closing_time': 1764842400.0, 'created_time': 1763492972.381025, 'last_price_update_time': 1764702243.571117}
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117082695') HTTP/1.1" 204 0
2025-12-02 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR72RSX/2025-11-27/image/e057a2da-5cfa-4542-8874-4d806f55fb86_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117427357?view=catalogue)
2025-12-02 19:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0714fd0>
2025-12-02 19:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b1a2857-f641-575d-97db-3e5989e97f0d
2025-12-02 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU71TVX/2025-11-28/image/62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117473837?view=catalogue)
2025-12-02 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR72RSX/2025-11-27/image/cfd69e99-a3c9-441b-aee3-826e193ba635_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117427357?view=catalogue)
2025-12-02 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL72JSU/2025-12-01/image/e1e0f3f8-ae3b-4a08-b5c2-e22107458d80_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117243233?view=catalogue)
2025-12-02 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL72JSU/2025-12-01/image/bc62e553-f6bf-4fd6-9f36-11a1065bd590_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117243233?view=catalogue)
2025-12-02 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL72JSU/2025-12-01/image/4f0ea73b-2912-43b8-ac63-d02d25bdd4ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117243233?view=catalogue)
2025-12-02 19:04:03 [astonbarclay.gb] INFO: Found listing with ID: 117547841
2025-12-02 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547841%27 HTTP/1.1" 200 None
2025-12-02 19:04:04 [astonbarclay.gb] INFO: Scrape type for 117547841: 2
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252Fa4aaf97a-de19-41ca-93ca-749cc89232ab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/a4aaf97a-de19-41ca-93ca-749cc89232ab_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252Fedbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/edbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09b9b90>
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7442e60-4434-5001-9201-0290dd09a7d2
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03faa10>
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252F2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0376850>
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252Fcca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07c2410>
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252Fcb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06bbc50>
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252F49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0432cd0>
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252F69208df4-01ca-4eb2-b1d0-6f34e95bbae6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/69208df4-01ca-4eb2-b1d0-6f34e95bbae6_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc
2025-12-02 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU71TVX/2025-11-28/image/436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117473837?view=catalogue)
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02ff950>
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252F420141bc-53e2-475b-9410-838815f29bec_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/420141bc-53e2-475b-9410-838815f29bec_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe
2025-12-02 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL72JSU/2025-12-01/image/256630e4-9725-4aec-97cf-180367fc8585_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117243233?view=catalogue)
2025-12-02 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR72RSX/2025-11-27/image/eca7df83-6c61-4d74-bd3d-2c436f7656d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117427357?view=catalogue)
2025-12-02 19:04:05 [astonbarclay.gb] INFO: Found listing with ID: 117543370
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543370%27 HTTP/1.1" 200 None
2025-12-02 19:04:05 [astonbarclay.gb] INFO: Scrape type for 117543370: 0
2025-12-02 19:04:05 [astonbarclay.gb] INFO: Found listing with ID: 117508313
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508313%27 HTTP/1.1" 200 None
2025-12-02 19:04:05 [astonbarclay.gb] INFO: Scrape type for 117508313: 1
2025-12-02 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR72RSX/2025-11-27/image/8ee9ffe5-911e-4348-ad41-ff5caf88a8b8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117427357?view=catalogue)
2025-12-02 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU71TVX/2025-11-28/image/009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117473837?view=catalogue)
2025-12-02 19:04:05 [scrapy.extensions.logstats] INFO: Crawled 194 pages (at 65 pages/min), scraped 119 items (at 33 items/min)
2025-12-02 19:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0667910>
2025-12-02 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252Fe057a2da-5cfa-4542-8874-4d806f55fb86_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/e057a2da-5cfa-4542-8874-4d806f55fb86_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a91e50>
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252F62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0641750>
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252Fcfd69e99-a3c9-441b-aee3-826e193ba635_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/cfd69e99-a3c9-441b-aee3-826e193ba635_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0665cd0>
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252Fe1e0f3f8-ae3b-4a08-b5c2-e22107458d80_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/e1e0f3f8-ae3b-4a08-b5c2-e22107458d80_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e47513e2-2d3f-5d1c-b24c-2eae086da624
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf2093950>
2025-12-02 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252Fbc62e553-f6bf-4fd6-9f36-11a1065bd590_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/bc62e553-f6bf-4fd6-9f36-11a1065bd590_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e47513e2-2d3f-5d1c-b24c-2eae086da624
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d17150>
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252F4f0ea73b-2912-43b8-ac63-d02d25bdd4ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/4f0ea73b-2912-43b8-ac63-d02d25bdd4ad_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e47513e2-2d3f-5d1c-b24c-2eae086da624
2025-12-02 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU71TVX/2025-11-28/image/fdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117473837?view=catalogue)
2025-12-02 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL72JSU/2025-12-01/image/b872aa22-a6bc-43f3-ac98-e26e22ff17fc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117243233?view=catalogue)
2025-12-02 19:04:07 [astonbarclay.gb] INFO: Found listing with ID: 117400056
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400056%27 HTTP/1.1" 200 None
2025-12-02 19:04:07 [astonbarclay.gb] INFO: Scrape type for 117400056: 2
2025-12-02 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR72RSX/2025-11-27/image/61f7444b-591b-470e-9ed9-31bc8c73b98c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117427357?view=catalogue)
2025-12-02 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR72RSX/2025-11-27/image/1371fca9-4172-4fef-9b91-91a964d7e0c6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117427357?view=catalogue)
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0432a50>
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252F436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14
2025-12-02 19:04:07 [astonbarclay.gb] INFO: Found listing with ID: 117240084
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240084%27 HTTP/1.1" 200 None
2025-12-02 19:04:07 [astonbarclay.gb] INFO: Scrape type for 117240084: 0
2025-12-02 19:04:07 [astonbarclay.gb] INFO: Found listing with ID: 117508301
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508301%27 HTTP/1.1" 200 None
2025-12-02 19:04:07 [astonbarclay.gb] INFO: Scrape type for 117508301: 1
2025-12-02 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116152685?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117574337?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116945130?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117048263?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b5a3d0>
2025-12-02 19:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252F256630e4-9725-4aec-97cf-180367fc8585_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/256630e4-9725-4aec-97cf-180367fc8585_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e47513e2-2d3f-5d1c-b24c-2eae086da624
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06deb50>
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252Feca7df83-6c61-4d74-bd3d-2c436f7656d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/eca7df83-6c61-4d74-bd3d-2c436f7656d1_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09966d0>
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252F8ee9ffe5-911e-4348-ad41-ff5caf88a8b8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/8ee9ffe5-911e-4348-ad41-ff5caf88a8b8_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0642490>
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252F009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14
2025-12-02 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU71TVX/2025-11-28/image/edbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117473837?view=catalogue)
2025-12-02 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV72KPE/2025-11-27/image/1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117397431?view=catalogue)
2025-12-02 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR72RSX/2025-11-27/image/a4aaf97a-de19-41ca-93ca-749cc89232ab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117427357?view=catalogue)
2025-12-02 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/fc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117505111?view=catalogue)
2025-12-02 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP73AYV/2025-11-26/image/e96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117484817?view=catalogue)
2025-12-02 19:04:08 [astonbarclay.gb] INFO: Found listing with ID: 116699739
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699739%27 HTTP/1.1" 200 None
2025-12-02 19:04:08 [astonbarclay.gb] INFO: Scrape type for 116699739: 2
2025-12-02 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116136757?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117215446?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117180618?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08ea210>
2025-12-02 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252Ffdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/fdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08edf90>
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252Fb872aa22-a6bc-43f3-ac98-e26e22ff17fc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/b872aa22-a6bc-43f3-ac98-e26e22ff17fc_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e47513e2-2d3f-5d1c-b24c-2eae086da624
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0654b10>
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252F61f7444b-591b-470e-9ed9-31bc8c73b98c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/61f7444b-591b-470e-9ed9-31bc8c73b98c_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09985d0>
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252F1371fca9-4172-4fef-9b91-91a964d7e0c6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/1371fca9-4172-4fef-9b91-91a964d7e0c6_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc
2025-12-02 19:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116152685, 'registration': 'RF74FDM', 'account': 'LIQ001', 'make': 'KIA', 'model': 'CEED HATCHBACK', 'derivative': '1.5T GDi ISG 138 GT-Line 5dr', 'mileage': 15860, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-01-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1482, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF74FDM/2025-10-21/image/a5f3c5ca-ce14-44e7-9036-add97edd2549_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/3125ca54-3a67-4e25-8c55-655929cc5bf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/02250f67-2e98-4bea-af94-cd8fab5a8867_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/89d86926-5bd0-4804-9d5b-476f8df5b43c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/99c93935-bab6-47d2-a0e5-492391115114_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/f6d8c65a-81a8-4b89-8599-5dea0c67ea3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/7d841a9e-61f1-495d-949c-f5a12afcf71d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/7c2f62f2-0a45-4c8d-9df9-2ffb6a7c000c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/d3678c06-bdf2-444a-a331-3726fa5e1ee0_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/25 10K', 'remarks': 'SPARE KEY *copy of V5*', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/58c18544-0ae6-487c-8fd7-46e514551ed0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116152685, 'registration': 'RF74FDM', 'account': 'LIQ001', 'make': 'KIA', 'model': 'CEED HATCHBACK', 'derivative': '1.5T GDi ISG 138 GT-Line 5dr', 'mileage': 15860, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-01-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1482, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF74FDM/2025-10-21/image/a5f3c5ca-ce14-44e7-9036-add97edd2549_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/3125ca54-3a67-4e25-8c55-655929cc5bf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/02250f67-2e98-4bea-af94-cd8fab5a8867_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/89d86926-5bd0-4804-9d5b-476f8df5b43c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/99c93935-bab6-47d2-a0e5-492391115114_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/f6d8c65a-81a8-4b89-8599-5dea0c67ea3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/7d841a9e-61f1-495d-949c-f5a12afcf71d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/7c2f62f2-0a45-4c8d-9df9-2ffb6a7c000c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74FDM/2025-10-21/image/d3678c06-bdf2-444a-a331-3726fa5e1ee0_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/25 10K', 'remarks': 'SPARE KEY *copy of V5*', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/58c18544-0ae6-487c-8fd7-46e514551ed0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 825b02b4-8d53-52b6-bddd-9a76dce02221 with identifier: 116152685
2025-12-02 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 825b02b4-8d53-52b6-bddd-9a76dce02221 with scrape type 2
2025-12-02 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 825b02b4-8d53-52b6-bddd-9a76dce02221 with scrape type 2
2025-12-02 19:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 825b02b4-8d53-52b6-bddd-9a76dce02221, identifier: 116152685
2025-12-02 19:04:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117574337, 'registration': 'VU71HXK', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE SPECIAL EDITION', 'derivative': '150kW 1ST Edition Pro Performance 77kWh 5dr Auto', 'mileage': 43097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-23', 'fuel': 'Electric', 'motExpiry': '2026-11-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/eba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/b8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/d825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/23 20k 11/25 42k', 'remarks': 'VOSA STATES 31K 42K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a6eb2dd4-29db-4727-84e1-e52f126e9796.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117574337, 'registration': 'VU71HXK', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE SPECIAL EDITION', 'derivative': '150kW 1ST Edition Pro Performance 77kWh 5dr Auto', 'mileage': 43097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-23', 'fuel': 'Electric', 'motExpiry': '2026-11-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/eba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/b8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/d825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/23 20k 11/25 42k', 'remarks': 'VOSA STATES 31K 42K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a6eb2dd4-29db-4727-84e1-e52f126e9796.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c59f23d-7191-522b-a0c6-0f57f2226b11 with identifier: 117574337
2025-12-02 19:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c59f23d-7191-522b-a0c6-0f57f2226b11 with scrape type 1
2025-12-02 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7c59f23d-7191-522b-a0c6-0f57f2226b11
2025-12-02 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252F4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116945130, 'registration': 'RO25WZJ', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 16901, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-28', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/d977c5dd-ba3c-446a-bd23-1086871ce7c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/36a5fe21-5536-437d-927d-e171efe2e16d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/88cd08ea-e783-4570-85a4-c423a1968cdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/39f3fcfd-1cfc-4e3d-8183-f8868f238548_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/49b48b6c-9e2b-4c03-bf66-9c2ff398d6ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/0277e0ee-97e5-41fc-93dd-802e197abb81_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/bc5e5ef4-74e3-4e4f-abad-abbd7a3bbe3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/0b427c43-b341-4553-bf04-09445d1d1ef9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/6701dd59-6866-4787-b6ed-efa2d31970e5_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/25-10k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31500ce1-9677-471e-b972-6e50cf665527.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116945130, 'registration': 'RO25WZJ', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 16901, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-28', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/d977c5dd-ba3c-446a-bd23-1086871ce7c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/36a5fe21-5536-437d-927d-e171efe2e16d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/88cd08ea-e783-4570-85a4-c423a1968cdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/39f3fcfd-1cfc-4e3d-8183-f8868f238548_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/49b48b6c-9e2b-4c03-bf66-9c2ff398d6ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/0277e0ee-97e5-41fc-93dd-802e197abb81_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/bc5e5ef4-74e3-4e4f-abad-abbd7a3bbe3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/0b427c43-b341-4553-bf04-09445d1d1ef9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/6701dd59-6866-4787-b6ed-efa2d31970e5_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/25-10k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31500ce1-9677-471e-b972-6e50cf665527.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e571fcb5-b919-5fbf-b4e3-aedac7e4b710 with identifier: 116945130
2025-12-02 19:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e571fcb5-b919-5fbf-b4e3-aedac7e4b710 with scrape type 2
2025-12-02 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e571fcb5-b919-5fbf-b4e3-aedac7e4b710 with scrape type 2
2025-12-02 19:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e571fcb5-b919-5fbf-b4e3-aedac7e4b710, identifier: 116945130
2025-12-02 19:04:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117048263, 'registration': 'RF74GDU', 'account': 'LIQ001', 'make': 'KIA', 'model': 'CEED HATCHBACK', 'derivative': '1.5T GDi ISG 138 GT-Line 5dr', 'mileage': 20604, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2024-12-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1482, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF74GDU/2025-11-13/image/9cfadf8f-f87b-439e-91bf-f87d4e11b275_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/ec135f3d-e56d-4db2-b8ab-193a05f3a3b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/99dd2981-407b-4e6e-9795-d3fdac034333_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/0a9805f5-3d14-4242-9b25-563d18d65cee_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/f6df0603-039e-4499-a4f8-25147377b320_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/92035334-0141-4f6f-a9f8-386e2379b9e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/b0756160-9280-4a58-8da7-45fd1d17e9b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/98e28bb0-bf88-49bb-80a8-2c749b4f10c5_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 06/25-10k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/58f3b9f1-2223-4241-86f1-b909444ace59.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117048263, 'registration': 'RF74GDU', 'account': 'LIQ001', 'make': 'KIA', 'model': 'CEED HATCHBACK', 'derivative': '1.5T GDi ISG 138 GT-Line 5dr', 'mileage': 20604, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2024-12-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1482, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF74GDU/2025-11-13/image/9cfadf8f-f87b-439e-91bf-f87d4e11b275_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/ec135f3d-e56d-4db2-b8ab-193a05f3a3b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/99dd2981-407b-4e6e-9795-d3fdac034333_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/0a9805f5-3d14-4242-9b25-563d18d65cee_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/f6df0603-039e-4499-a4f8-25147377b320_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/92035334-0141-4f6f-a9f8-386e2379b9e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/b0756160-9280-4a58-8da7-45fd1d17e9b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF74GDU/2025-11-13/image/98e28bb0-bf88-49bb-80a8-2c749b4f10c5_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 06/25-10k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/58f3b9f1-2223-4241-86f1-b909444ace59.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beeb4178-5566-54c0-a178-e3953fdf30d7 with identifier: 117048263
2025-12-02 19:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beeb4178-5566-54c0-a178-e3953fdf30d7 with scrape type 2
2025-12-02 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beeb4178-5566-54c0-a178-e3953fdf30d7 with scrape type 2
2025-12-02 19:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: beeb4178-5566-54c0-a178-e3953fdf30d7, identifier: 117048263
2025-12-02 19:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL72JSU/2025-12-01/image/def0b371-c195-47e9-ab0f-f64bc1fe5ff6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117243233?view=catalogue)
2025-12-02 19:04:10 [astonbarclay.gb] INFO: Found listing with ID: 117451511
2025-12-02 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451511%27 HTTP/1.1" 200 None
2025-12-02 19:04:10 [astonbarclay.gb] INFO: Scrape type for 117451511: 1
2025-12-02 19:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 825b02b4-8d53-52b6-bddd-9a76dce02221 with identifier: 116152685
2025-12-02 19:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 825b02b4-8d53-52b6-bddd-9a76dce02221 with identifier: 116152685
2025-12-02 19:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 825b02b4-8d53-52b6-bddd-9a76dce02221 with identifier: 116152685 to the API
2025-12-02 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116152685?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '825b02b4-8d53-52b6-bddd-9a76dce02221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RF74FDM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116152685',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'CEED HATCHBACK',
 'odometer': 15860,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-30',
 'seller_name': 'Liquid Fleet',
 'title': 'KIA CEED HATCHBACK 1.5T GDi ISG 138 GT-Line 5dr',
 'transmission': 'manual',
 'trim': '1.5T GDi ISG 138 GT-Line 5dr',
 'vin': None,
 'year': 2025}
2025-12-02 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152685%27 HTTP/1.1" 200 None
2025-12-02 19:04:10 [astonbarclay.gb] INFO: Saving data for 116152685: {'auction_closing_time': 1764842400.0, 'created_time': 1761037639.311919, 'last_price_update_time': 1764702250.824559}
2025-12-02 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116152685') HTTP/1.1" 204 0
2025-12-02 19:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e571fcb5-b919-5fbf-b4e3-aedac7e4b710 with identifier: 116945130
2025-12-02 19:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e571fcb5-b919-5fbf-b4e3-aedac7e4b710 with identifier: 116945130
2025-12-02 19:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e571fcb5-b919-5fbf-b4e3-aedac7e4b710 with identifier: 116945130 to the API
2025-12-02 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116945130?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'e571fcb5-b919-5fbf-b4e3-aedac7e4b710',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RO25WZJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116945130',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 16901,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-28',
 'seller_name': 'Liquid Fleet',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi 207 HEV 3 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6T GDi 207 HEV 3 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116945130%27 HTTP/1.1" 200 None
2025-12-02 19:04:11 [astonbarclay.gb] INFO: Saving data for 116945130: {'auction_closing_time': 1764842400.0, 'created_time': 1762887738.024537, 'last_price_update_time': 1764702251.119926}
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116945130') HTTP/1.1" 204 0
2025-12-02 19:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: beeb4178-5566-54c0-a178-e3953fdf30d7 with identifier: 117048263
2025-12-02 19:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: beeb4178-5566-54c0-a178-e3953fdf30d7 with identifier: 117048263
2025-12-02 19:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: beeb4178-5566-54c0-a178-e3953fdf30d7 with identifier: 117048263 to the API
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117048263?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'beeb4178-5566-54c0-a178-e3953fdf30d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RF74GDU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117048263',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'CEED HATCHBACK',
 'odometer': 20604,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-17',
 'seller_name': 'Liquid Fleet',
 'title': 'KIA CEED HATCHBACK 1.5T GDi ISG 138 GT-Line 5dr',
 'transmission': 'manual',
 'trim': '1.5T GDi ISG 138 GT-Line 5dr',
 'vin': None,
 'year': 2024}
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117048263%27 HTTP/1.1" 200 None
2025-12-02 19:04:11 [astonbarclay.gb] INFO: Saving data for 117048263: {'auction_closing_time': 1764842400.0, 'created_time': 1763492602.55122, 'last_price_update_time': 1764702251.415034}
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117048263') HTTP/1.1" 204 0
2025-12-02 19:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU73KPO/2025-11-27/image/232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117558104?view=catalogue)
2025-12-02 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV72KPE/2025-11-27/image/51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117397431?view=catalogue)
2025-12-02 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/8ed08253-6918-4338-be3a-f58726470258_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117505111?view=catalogue)
2025-12-02 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV72KPE/2025-11-27/image/0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117397431?view=catalogue)
2025-12-02 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/514aa7b7-ed0e-4db8-b39d-43f95c925fe3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509080?view=catalogue)
2025-12-02 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP73AYV/2025-11-26/image/78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117484817?view=catalogue)
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252F4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07c4dd0>
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU71TVX%252F2025-11-28%252Fimage%252Fedbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU71TVX/2025-11-28/image/edbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14
2025-12-02 19:04:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4480acf2-bd24-5ae4-bc4a-13a999a29e14, skipping ID generation
2025-12-02 19:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14 with scrape type 1
2025-12-02 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4480acf2-bd24-5ae4-bc4a-13a999a29e14 from tracking dictionaries
2025-12-02 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4480acf2-bd24-5ae4-bc4a-13a999a29e14 sending to next pipeline
2025-12-02 19:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4480acf2-bd24-5ae4-bc4a-13a999a29e14, identifier: 117473837
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09aa8d0>
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7442e60-4434-5001-9201-0290dd09a7d2
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf067b350>
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR72RSX%252F2025-11-27%252Fimage%252Fa4aaf97a-de19-41ca-93ca-749cc89232ab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR72RSX/2025-11-27/image/a4aaf97a-de19-41ca-93ca-749cc89232ab_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc
2025-12-02 19:04:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93d39008-2bb1-5708-ae8d-01ea6e6064cc, skipping ID generation
2025-12-02 19:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc with scrape type 1
2025-12-02 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 93d39008-2bb1-5708-ae8d-01ea6e6064cc from tracking dictionaries
2025-12-02 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93d39008-2bb1-5708-ae8d-01ea6e6064cc sending to next pipeline
2025-12-02 19:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 93d39008-2bb1-5708-ae8d-01ea6e6064cc, identifier: 117427357
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0994e10>
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252Ffc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/fc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf050d350>
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252Fe96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/e96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe
2025-12-02 19:04:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116136757, 'registration': 'NL24PZU', 'account': 'ZEN002', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 241 PHEV GT-Line S 5dr Auto AWD', 'mileage': 14434, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-07-01', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NL24PZU/2025-10-12/image/caec0307-3d1a-4018-936d-8a451c6f31f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/11eec57a-311b-487d-85f8-70c5243956dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/b23fa382-65ba-4c50-aef8-27ad947c4ace_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/c9ee9ed8-5ee9-4f22-9526-70ce09e4eb34_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/3846cfc4-30bf-4935-87ae-bfa0f78c6b93_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/59c10464-3368-4612-a54d-8e51e5c4de46_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/7e3456a9-7758-4c15-9694-1e5a153354a0_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 28, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/46412f6f-dbd2-422b-b320-c0a34c499d90.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116136757, 'registration': 'NL24PZU', 'account': 'ZEN002', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 241 PHEV GT-Line S 5dr Auto AWD', 'mileage': 14434, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-07-01', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NL24PZU/2025-10-12/image/caec0307-3d1a-4018-936d-8a451c6f31f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/11eec57a-311b-487d-85f8-70c5243956dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/b23fa382-65ba-4c50-aef8-27ad947c4ace_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/c9ee9ed8-5ee9-4f22-9526-70ce09e4eb34_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/3846cfc4-30bf-4935-87ae-bfa0f78c6b93_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/59c10464-3368-4612-a54d-8e51e5c4de46_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL24PZU/2025-10-12/image/7e3456a9-7758-4c15-9694-1e5a153354a0_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 28, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/46412f6f-dbd2-422b-b320-c0a34c499d90.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6b79bb2-7a47-5c75-b877-4af51e3fff0d with identifier: 116136757
2025-12-02 19:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6b79bb2-7a47-5c75-b877-4af51e3fff0d with scrape type 2
2025-12-02 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6b79bb2-7a47-5c75-b877-4af51e3fff0d with scrape type 2
2025-12-02 19:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d6b79bb2-7a47-5c75-b877-4af51e3fff0d, identifier: 116136757
2025-12-02 19:04:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117215446, 'registration': 'MH21EZN', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '40 TFSI e Sport 5dr S Tronic [Comfort+Sound]', 'mileage': 106164, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-26', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-25', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MH21EZN/2025-11-14/image/dd883ec9-84dc-4a9c-8cd3-c6a3d1d4fb78_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/38f1da40-2f74-4769-952d-fb783000178c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/434da3f3-0ce0-431c-9396-ecd10665b22e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/91ca64f6-d5ac-4fbe-8af7-1cae457910a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/cd606bf5-0821-42ab-b977-b06bfc31cb5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/aaa385ee-0d24-479d-9733-9a6717990bcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/49974193-12b4-401e-b22a-b75dcdb6f573_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/cc4a1912-c821-4f1d-8e4d-6932cee50953_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/e2ba51c6-d864-43a2-bbe4-beee3ed538d2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22-28K, 08/23-57K, 11/23-66K, 07/24-80K, 07/25-99K,', 'remarks': '**936**VOSA STATES 80K, 99K  SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b7780122-0aea-4155-b3af-0da18ebc4617.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117215446, 'registration': 'MH21EZN', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '40 TFSI e Sport 5dr S Tronic [Comfort+Sound]', 'mileage': 106164, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-26', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-25', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MH21EZN/2025-11-14/image/dd883ec9-84dc-4a9c-8cd3-c6a3d1d4fb78_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/38f1da40-2f74-4769-952d-fb783000178c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/434da3f3-0ce0-431c-9396-ecd10665b22e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/91ca64f6-d5ac-4fbe-8af7-1cae457910a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/cd606bf5-0821-42ab-b977-b06bfc31cb5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/aaa385ee-0d24-479d-9733-9a6717990bcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/49974193-12b4-401e-b22a-b75dcdb6f573_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/cc4a1912-c821-4f1d-8e4d-6932cee50953_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/e2ba51c6-d864-43a2-bbe4-beee3ed538d2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22-28K, 08/23-57K, 11/23-66K, 07/24-80K, 07/25-99K,', 'remarks': '**936**VOSA STATES 80K, 99K  SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b7780122-0aea-4155-b3af-0da18ebc4617.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51f7406-c301-5167-b4b1-48b5bfb87038 with identifier: 117215446
2025-12-02 19:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51f7406-c301-5167-b4b1-48b5bfb87038 with scrape type 2
2025-12-02 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b51f7406-c301-5167-b4b1-48b5bfb87038 with scrape type 2
2025-12-02 19:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b51f7406-c301-5167-b4b1-48b5bfb87038, identifier: 117215446
2025-12-02 19:04:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117180618, 'registration': 'YA72EOP', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN ESTATE', 'derivative': '1.5 TSI 150 R-Line 5dr DSG', 'mileage': 23211, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-02-07', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YA72EOP/2025-11-28/image/11c508f6-ae76-439c-aa46-ef4021156bdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/7ce04a58-e8e8-4770-ac85-8d0b1daf2786_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/f7178be2-cdc7-4043-9000-ecdc2f616825_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/be422197-17a4-44f0-a07b-3eccc55e8fc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/6c1d66d9-d83c-4253-94eb-7ebadbfe3d1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/66eea275-7c11-4925-a5c4-d20e23e67b9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/244626a7-d00c-41f5-b8db-d5f9472fecbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/ab5ec6b3-7013-42f7-8321-2be212575929_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/4f102e8b-5a03-4f37-aadc-cd7fe8baabf8_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/24 - 9K, 05/25 - 19K', 'remarks': '**800** SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/76db4f61-e723-4df2-8d3b-87da3ce1386a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117180618, 'registration': 'YA72EOP', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN ESTATE', 'derivative': '1.5 TSI 150 R-Line 5dr DSG', 'mileage': 23211, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-02-07', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YA72EOP/2025-11-28/image/11c508f6-ae76-439c-aa46-ef4021156bdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/7ce04a58-e8e8-4770-ac85-8d0b1daf2786_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/f7178be2-cdc7-4043-9000-ecdc2f616825_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/be422197-17a4-44f0-a07b-3eccc55e8fc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/6c1d66d9-d83c-4253-94eb-7ebadbfe3d1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/66eea275-7c11-4925-a5c4-d20e23e67b9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/244626a7-d00c-41f5-b8db-d5f9472fecbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/ab5ec6b3-7013-42f7-8321-2be212575929_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/4f102e8b-5a03-4f37-aadc-cd7fe8baabf8_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/24 - 9K, 05/25 - 19K', 'remarks': '**800** SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/76db4f61-e723-4df2-8d3b-87da3ce1386a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b85115f0-b8f6-5465-87ac-c739e7b81ee4 with identifier: 117180618
2025-12-02 19:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b85115f0-b8f6-5465-87ac-c739e7b81ee4 with scrape type 1
2025-12-02 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item b85115f0-b8f6-5465-87ac-c739e7b81ee4
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F11c508f6-ae76-439c-aa46-ef4021156bdb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/11c508f6-ae76-439c-aa46-ef4021156bdb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:13 [astonbarclay.gb] INFO: Found listing with ID: 117411712
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117411712%27 HTTP/1.1" 200 None
2025-12-02 19:04:13 [astonbarclay.gb] INFO: Scrape type for 117411712: 2
2025-12-02 19:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4480acf2-bd24-5ae4-bc4a-13a999a29e14 with identifier: 117473837
2025-12-02 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4480acf2-bd24-5ae4-bc4a-13a999a29e14 with identifier: 117473837
2025-12-02 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'fiat 500 electric hatchback 87kw passion 42kwh 3dr auto', 'price': 0, 'currency': 'gbp', 'make': 'fiat', 'model': '500 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 38671, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-05', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117473837', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '87kw passion 42kwh 3dr auto', 'license_plate': 'nu71tvx', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 3, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '4480acf2-bd24-5ae4-bc4a-13a999a29e14', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 23839}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 24554}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 22740}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 22005}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46070}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41485}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/fdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/edbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52833}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'fiat 500 electric hatchback', 'sanitized_make': 'fiat', 'odometer_in_km': 62234} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '4480acf2-bd24-5ae4-bc4a-13a999a29e14',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'nu71tvx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117473837',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'fiat',
     'make_model': 'fiat 500 electric hatchback',
     'model': '500 electric hatchback',
     'odometer': 38671,
     'odometer_in_km': 62234,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 23839,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24554,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 22740,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 22005,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46070,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41485,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52373,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/fdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52833,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/edbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-05',
     'sanitized_make': 'fiat',
     'seller_name': 'zenith',
     'title': 'fiat 500 electric hatchback 87kw passion 42kwh 3dr auto',
     'transmission': 'automatic',
     'trim': '87kw passion 42kwh 3dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 4480acf2-bd24-5ae4-bc4a-13a999a29e14 spider: astonbarclay.gb
2025-12-02 19:04:13 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4480acf2-bd24-5ae4-bc4a-13a999a29e14 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'fiat 500 electric hatchback 87kw passion 42kwh 3dr auto', 'price': 0, 'currency': 'gbp', 'make': 'fiat', 'model': '500 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 38671, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-05', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117473837', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '87kw passion 42kwh 3dr auto', 'license_plate': 'nu71tvx', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 3, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '4480acf2-bd24-5ae4-bc4a-13a999a29e14', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 23839}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 24554}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 22740}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 22005}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46070}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41485}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/fdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/edbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52833}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'fiat 500 electric hatchback', 'sanitized_make': 'fiat', 'odometer_in_km': 62234} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '4480acf2-bd24-5ae4-bc4a-13a999a29e14',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'nu71tvx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117473837',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'fiat',
     'make_model': 'fiat 500 electric hatchback',
     'model': '500 electric hatchback',
     'odometer': 38671,
     'odometer_in_km': 62234,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 23839,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24554,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 22740,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 22005,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46070,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41485,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52373,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/fdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52833,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/edbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-05',
     'sanitized_make': 'fiat',
     'seller_name': 'zenith',
     'title': 'fiat 500 electric hatchback 87kw passion 42kwh 3dr auto',
     'transmission': 'automatic',
     'trim': '87kw passion 42kwh 3dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '4480acf2-bd24-5ae4-bc4a-13a999a29e14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NU71TVX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117473837',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FIAT',
 'model': '500 ELECTRIC HATCHBACK',
 'odometer': 38671,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23839,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cb870bf9-ab3c-4252-89ac-6afd01146d9f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24554,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/cca527db-73c7-435e-b2f1-29500b80388b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22740,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/49a97992-78fe-4bc2-93f6-308631597f3c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22005,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/62eb27ee-b3c2-42bf-a765-92ce212a18f9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46070,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/436a337a-b5e0-4298-812c-4abc7c4b9bad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41485,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/009b50a3-ba21-4c3f-8136-b8d6e902397c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52373,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/fdd72314-1506-4eba-9e8e-2a109d300987_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4480acf2-bd24-5ae4-bc4a-13a999a29e14/4480acf2-bd24-5ae4-bc4a-13a999a29e14_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52833,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU71TVX/2025-11-28/image/edbb6cc5-bc8e-4047-abbd-7c60fb843a50_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-05',
 'seller_name': 'Zenith',
 'title': 'FIAT 500 ELECTRIC HATCHBACK 87kW Passion 42kWh 3dr Auto',
 'transmission': 'automatic',
 'trim': '87kW Passion 42kWh 3dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117473837%27 HTTP/1.1" 200 None
2025-12-02 19:04:13 [astonbarclay.gb] INFO: Saving data for 117473837: {'created_time': 1764702253.39749, 'last_price_update_time': 1764702253.397502, 'auction_closing_time': 1764842400.0}
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117473837') HTTP/1.1" 204 0
2025-12-02 19:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 93d39008-2bb1-5708-ae8d-01ea6e6064cc with identifier: 117427357
2025-12-02 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 93d39008-2bb1-5708-ae8d-01ea6e6064cc with identifier: 117427357
2025-12-02 19:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 93d39008-2bb1-5708-ae8d-01ea6e6064cc with identifier: 117427357 to the API
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KR72RSX/2025-11-27/image/a4aaf97a-de19-41ca-93ca-749cc89232ab_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '93d39008-2bb1-5708-ae8d-01ea6e6064cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KR72RSX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117427357',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 38352,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31313,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/8ee9ffe5-911e-4348-ad41-ff5caf88a8b8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30767,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/69208df4-01ca-4eb2-b1d0-6f34e95bbae6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29034,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/e057a2da-5cfa-4542-8874-4d806f55fb86_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28729,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/cfd69e99-a3c9-441b-aee3-826e193ba635_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48815,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/eca7df83-6c61-4d74-bd3d-2c436f7656d1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44157,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/1371fca9-4172-4fef-9b91-91a964d7e0c6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39866,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/61f7444b-591b-470e-9ed9-31bc8c73b98c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d39008-2bb1-5708-ae8d-01ea6e6064cc/93d39008-2bb1-5708-ae8d-01ea6e6064cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51385,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR72RSX/2025-11-27/image/a4aaf97a-de19-41ca-93ca-749cc89232ab_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-01',
 'seller_name': 'Zenith',
 'title': 'BMW 1 SERIES HATCHBACK 118i [136] M Sport 5dr Step Auto [LCP]',
 'transmission': 'automatic',
 'trim': '118i [136] M Sport 5dr Step Auto [LCP]',
 'vin': None,
 'year': 2023}
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427357%27 HTTP/1.1" 200 None
2025-12-02 19:04:13 [astonbarclay.gb] INFO: Saving data for 117427357: {'created_time': 1764702253.76685, 'last_price_update_time': 1764702253.76686, 'auction_closing_time': 1764842400.0}
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117427357') HTTP/1.1" 204 0
2025-12-02 19:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d6b79bb2-7a47-5c75-b877-4af51e3fff0d with identifier: 116136757
2025-12-02 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d6b79bb2-7a47-5c75-b877-4af51e3fff0d with identifier: 116136757
2025-12-02 19:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d6b79bb2-7a47-5c75-b877-4af51e3fff0d with identifier: 116136757 to the API
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116136757?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 28,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': 'd6b79bb2-7a47-5c75-b877-4af51e3fff0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NL24PZU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116136757',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 14434,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-01',
 'seller_name': 'Zenith',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi 241 PHEV GT-Line S 5dr Auto AWD',
 'transmission': 'automatic',
 'trim': '1.6T GDi 241 PHEV GT-Line S 5dr Auto AWD',
 'vin': None,
 'year': 2024}
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116136757%27 HTTP/1.1" 200 None
2025-12-02 19:04:14 [astonbarclay.gb] INFO: Saving data for 116136757: {'auction_closing_time': 1764842400.0, 'created_time': 1760469042.381422, 'last_price_update_time': 1764702254.069343}
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116136757') HTTP/1.1" 204 0
2025-12-02 19:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b51f7406-c301-5167-b4b1-48b5bfb87038 with identifier: 117215446
2025-12-02 19:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b51f7406-c301-5167-b4b1-48b5bfb87038 with identifier: 117215446
2025-12-02 19:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170853 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170853
2025-12-02 19:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b51f7406-c301-5167-b4b1-48b5bfb87038 spider: astonbarclay.gb
2025-12-02 19:04:14 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b51f7406-c301-5167-b4b1-48b5bfb87038 due to rule: high_mileage_for_country.json, error: 170853 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170853
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'b51f7406-c301-5167-b4b1-48b5bfb87038',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MH21EZN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117215446',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 106164,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seller_name': 'Zenith',
 'title': 'AUDI A3 SPORTBACK 40 TFSI e Sport 5dr S Tronic [Comfort+Sound]',
 'transmission': 'automatic',
 'trim': '40 TFSI e Sport 5dr S Tronic [Comfort+Sound]',
 'vin': None,
 'year': 2021}
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215446%27 HTTP/1.1" 200 None
2025-12-02 19:04:14 [astonbarclay.gb] INFO: Saving data for 117215446: {'auction_closing_time': 1764755100.0, 'created_time': 1763492885.062671, 'last_price_update_time': 1764702254.408048}
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117215446') HTTP/1.1" 204 0
2025-12-02 19:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/b95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117505111?view=catalogue)
2025-12-02 19:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP73AYV/2025-11-26/image/3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117484817?view=catalogue)
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252Feba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/eba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F7ce04a58-e8e8-4770-ac85-8d0b1daf2786_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/7ce04a58-e8e8-4770-ac85-8d0b1daf2786_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117547841?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:14 [astonbarclay.gb] INFO: Found listing with ID: 116339169
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116339169%27 HTTP/1.1" 200 None
2025-12-02 19:04:14 [astonbarclay.gb] INFO: Scrape type for 116339169: 2
2025-12-02 19:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0884550>
2025-12-02 19:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL72JSU%252F2025-12-01%252Fimage%252Fdef0b371-c195-47e9-ab0f-f64bc1fe5ff6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL72JSU/2025-12-01/image/def0b371-c195-47e9-ab0f-f64bc1fe5ff6_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e47513e2-2d3f-5d1c-b24c-2eae086da624
2025-12-02 19:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e47513e2-2d3f-5d1c-b24c-2eae086da624, skipping ID generation
2025-12-02 19:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e47513e2-2d3f-5d1c-b24c-2eae086da624 with scrape type 1
2025-12-02 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e47513e2-2d3f-5d1c-b24c-2eae086da624 from tracking dictionaries
2025-12-02 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e47513e2-2d3f-5d1c-b24c-2eae086da624 sending to next pipeline
2025-12-02 19:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e47513e2-2d3f-5d1c-b24c-2eae086da624, identifier: 117243233
2025-12-02 19:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0788cd0>
2025-12-02 19:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU73KPO%252F2025-11-27%252Fimage%252F232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU73KPO/2025-11-27/image/232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b1a2857-f641-575d-97db-3e5989e97f0d
2025-12-02 19:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b1a2857-f641-575d-97db-3e5989e97f0d, skipping ID generation
2025-12-02 19:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b1a2857-f641-575d-97db-3e5989e97f0d with scrape type 1
2025-12-02 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9b1a2857-f641-575d-97db-3e5989e97f0d from tracking dictionaries
2025-12-02 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b1a2857-f641-575d-97db-3e5989e97f0d sending to next pipeline
2025-12-02 19:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9b1a2857-f641-575d-97db-3e5989e97f0d, identifier: 117558104
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09c1d90>
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7442e60-4434-5001-9201-0290dd09a7d2
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05cd690>
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252F8ed08253-6918-4338-be3a-f58726470258_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/8ed08253-6918-4338-be3a-f58726470258_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08afdd0>
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7442e60-4434-5001-9201-0290dd09a7d2
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0461390>
2025-12-02 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F514aa7b7-ed0e-4db8-b39d-43f95c925fe3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/514aa7b7-ed0e-4db8-b39d-43f95c925fe3_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13
2025-12-02 19:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d6ec50>
2025-12-02 19:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252F78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe
2025-12-02 19:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574337?view=catalogue)
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252Fb8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/b8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252Ff7178be2-cdc7-4043-9000-ecdc2f616825_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/f7178be2-cdc7-4043-9000-ecdc2f616825_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e47513e2-2d3f-5d1c-b24c-2eae086da624 with identifier: 117243233
2025-12-02 19:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e47513e2-2d3f-5d1c-b24c-2eae086da624 with identifier: 117243233
2025-12-02 19:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e47513e2-2d3f-5d1c-b24c-2eae086da624 with identifier: 117243233 to the API
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DL72JSU/2025-12-01/image/def0b371-c195-47e9-ab0f-f64bc1fe5ff6_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e47513e2-2d3f-5d1c-b24c-2eae086da624',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DL72JSU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117243233',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 53400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27913,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/def0b371-c195-47e9-ab0f-f64bc1fe5ff6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30014,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/c9e0f841-d222-4ee5-8d8d-777ce8735f31_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28519,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/5550f38a-a9a9-4e1a-9fc7-2ef448f25481_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29233,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/e1e0f3f8-ae3b-4a08-b5c2-e22107458d80_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45053,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/bc62e553-f6bf-4fd6-9f36-11a1065bd590_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40627,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/4f0ea73b-2912-43b8-ac63-d02d25bdd4ad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45969,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/256630e4-9725-4aec-97cf-180367fc8585_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e47513e2-2d3f-5d1c-b24c-2eae086da624/e47513e2-2d3f-5d1c-b24c-2eae086da624_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46235,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DL72JSU/2025-12-01/image/b872aa22-a6bc-43f3-ac98-e26e22ff17fc_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-14',
 'seller_name': 'Zenith',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi 48V MHD Premium 5dr 2WD DCT',
 'transmission': 'automatic',
 'trim': '1.6 TGDi 48V MHD Premium 5dr 2WD DCT',
 'vin': None,
 'year': 2023}
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243233%27 HTTP/1.1" 200 None
2025-12-02 19:04:16 [astonbarclay.gb] INFO: Saving data for 117243233: {'created_time': 1764702256.786816, 'last_price_update_time': 1764702256.78683, 'auction_closing_time': 1764842400.0}
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117243233') HTTP/1.1" 204 0
2025-12-02 19:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9b1a2857-f641-575d-97db-3e5989e97f0d with identifier: 117558104
2025-12-02 19:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9b1a2857-f641-575d-97db-3e5989e97f0d with identifier: 117558104
2025-12-02 19:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mg motor uk mg4 hatchback 125kw se ev 51kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'mg4 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 22806, 'odometer_reading_unit': 'mi', 'registration_date': '2023-10-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117558104', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '125kw se ev 51kwh 5dr auto', 'license_plate': 'nu73kpo', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '9b1a2857-f641-575d-97db-3e5989e97f0d', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33055}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33647}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/ca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31378}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32925}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 43897}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55662}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/f944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49806}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55444}], 'current_year_diff': 2, 'age_in_months': 25, 'make_model': 'mg motor uk mg4 hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 36702} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 25,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '9b1a2857-f641-575d-97db-3e5989e97f0d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'nu73kpo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117558104',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk mg4 hatchback',
     'model': 'mg4 hatchback',
     'odometer': 22806,
     'odometer_in_km': 36702,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33055,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33647,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31378,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/ca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32925,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43897,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55662,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49806,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/f944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55444,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-10-24',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'zenith',
     'title': 'mg motor uk mg4 hatchback 125kw se ev 51kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '125kw se ev 51kwh 5dr auto',
     'vin': None,
     'year': 2023}
2025-12-02 19:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 9b1a2857-f641-575d-97db-3e5989e97f0d spider: astonbarclay.gb
2025-12-02 19:04:17 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 9b1a2857-f641-575d-97db-3e5989e97f0d due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mg motor uk mg4 hatchback 125kw se ev 51kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'mg4 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 22806, 'odometer_reading_unit': 'mi', 'registration_date': '2023-10-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117558104', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '125kw se ev 51kwh 5dr auto', 'license_plate': 'nu73kpo', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '9b1a2857-f641-575d-97db-3e5989e97f0d', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33055}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33647}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/ca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31378}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32925}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 43897}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55662}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/f944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49806}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55444}], 'current_year_diff': 2, 'age_in_months': 25, 'make_model': 'mg motor uk mg4 hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 36702} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 25,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '9b1a2857-f641-575d-97db-3e5989e97f0d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'nu73kpo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117558104',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk mg4 hatchback',
     'model': 'mg4 hatchback',
     'odometer': 22806,
     'odometer_in_km': 36702,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33055,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33647,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31378,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/ca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32925,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43897,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55662,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49806,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/f944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55444,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-10-24',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'zenith',
     'title': 'mg motor uk mg4 hatchback 125kw se ev 51kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '125kw se ev 51kwh 5dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '9b1a2857-f641-575d-97db-3e5989e97f0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NU73KPO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117558104',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MG MOTOR UK',
 'model': 'MG4 HATCHBACK',
 'odometer': 22806,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33055,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/756f8a62-bd2f-4265-b3eb-cc4104d9b498_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33647,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/34df2770-c177-4f8a-9d4b-ca35bc4145ed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31378,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/ca8dfe28-b0c4-4db8-a532-eff88ce27599_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32925,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/7f345255-3131-4d92-bd77-df0217e2fdbb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43897,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/0b212cae-ba39-49c8-bcc1-46a808df2818_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55662,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/232b8f45-2913-484b-946d-faf1f8528753_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49806,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/f944ebca-7bb2-4d3f-8df9-c98716a62867_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1a2857-f641-575d-97db-3e5989e97f0d/9b1a2857-f641-575d-97db-3e5989e97f0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55444,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU73KPO/2025-11-27/image/205d8562-fad1-4072-bc2a-f9149cf18f2a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-24',
 'seller_name': 'Zenith',
 'title': 'MG MOTOR UK MG4 HATCHBACK 125kW SE EV 51kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '125kW SE EV 51kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117558104%27 HTTP/1.1" 200 None
2025-12-02 19:04:17 [astonbarclay.gb] INFO: Saving data for 117558104: {'created_time': 1764702257.024655, 'last_price_update_time': 1764702257.024665, 'auction_closing_time': 1764842400.0}
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117558104') HTTP/1.1" 204 0
2025-12-02 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV72KPE/2025-11-27/image/a984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117397431?view=catalogue)
2025-12-02 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/8fe4f446-4a0f-4a18-b7eb-b8fb00880cc4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509080?view=catalogue)
2025-12-02 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP73AYV/2025-11-26/image/347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117484817?view=catalogue)
2025-12-02 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117484817?view=catalogue)
2025-12-02 19:04:17 [astonbarclay.gb] INFO: Found listing with ID: 116831775
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831775%27 HTTP/1.1" 200 None
2025-12-02 19:04:17 [astonbarclay.gb] INFO: Scrape type for 116831775: 0
2025-12-02 19:04:17 [astonbarclay.gb] INFO: Found listing with ID: 117100813
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100813%27 HTTP/1.1" 200 None
2025-12-02 19:04:17 [astonbarclay.gb] INFO: Scrape type for 117100813: 1
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252F0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252Fbe422197-17a4-44f0-a07b-3eccc55e8fc3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/be422197-17a4-44f0-a07b-3eccc55e8fc3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116930700?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117508313?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117357513?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117400056?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08316d0>
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252Fb95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/b95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac2150>
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252F3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe
2025-12-02 19:04:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117547841, 'registration': 'SK22HVM', 'account': 'THE109', 'make': 'TOYOTA', 'model': 'YARIS CROSS ESTATE', 'derivative': '1.5 Hybrid Icon 5dr CVT', 'mileage': 40670, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-04-15', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-04-14', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SK22HVM/2025-12-02/image/9d9886da-943f-4793-ae56-9f72cd140f8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/2f8e1af6-c6c0-4640-8b70-1197991e229a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/273df491-68e9-42d4-9d94-76b38c310285_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/80bf85cc-1109-46c7-838c-d28591a2cbb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/c9b9b729-203e-4c78-a2e0-ea8885176b46_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/833ca4f2-3f9b-4caf-9e2d-9d047a928066_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/73bcc3b3-6465-4154-84b2-01eacac73935_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/fc899fd5-bf3b-4993-9537-e47e5c3e6cd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/9b890839-fb3a-47b2-ab83-03fc5209b463_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 03/24 - 19K, 01/25 - 30K', 'remarks': '**562** VOSA STATES 32K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 100, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/04ad6b26-be03-45ed-8d5f-28f1822a7a0e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117547841, 'registration': 'SK22HVM', 'account': 'THE109', 'make': 'TOYOTA', 'model': 'YARIS CROSS ESTATE', 'derivative': '1.5 Hybrid Icon 5dr CVT', 'mileage': 40670, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-04-15', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-04-14', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SK22HVM/2025-12-02/image/9d9886da-943f-4793-ae56-9f72cd140f8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/2f8e1af6-c6c0-4640-8b70-1197991e229a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/273df491-68e9-42d4-9d94-76b38c310285_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/80bf85cc-1109-46c7-838c-d28591a2cbb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/c9b9b729-203e-4c78-a2e0-ea8885176b46_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/833ca4f2-3f9b-4caf-9e2d-9d047a928066_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/73bcc3b3-6465-4154-84b2-01eacac73935_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/fc899fd5-bf3b-4993-9537-e47e5c3e6cd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK22HVM/2025-12-02/image/9b890839-fb3a-47b2-ab83-03fc5209b463_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 03/24 - 19K, 01/25 - 30K', 'remarks': '**562** VOSA STATES 32K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 100, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/04ad6b26-be03-45ed-8d5f-28f1822a7a0e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a61f1e95-7271-58d2-b5a7-8f6c433dd560 with identifier: 117547841
2025-12-02 19:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a61f1e95-7271-58d2-b5a7-8f6c433dd560 with scrape type 2
2025-12-02 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a61f1e95-7271-58d2-b5a7-8f6c433dd560 with scrape type 2
2025-12-02 19:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a61f1e95-7271-58d2-b5a7-8f6c433dd560, identifier: 117547841
2025-12-02 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA72EOP/2025-11-28/image/11c508f6-ae76-439c-aa46-ef4021156bdb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117180618?view=catalogue)
2025-12-02 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574337?view=catalogue)
2025-12-02 19:04:17 [astonbarclay.gb] INFO: Found listing with ID: 117446881
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446881%27 HTTP/1.1" 200 None
2025-12-02 19:04:17 [astonbarclay.gb] INFO: Scrape type for 117446881: 1
2025-12-02 19:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a61f1e95-7271-58d2-b5a7-8f6c433dd560 with identifier: 117547841
2025-12-02 19:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a61f1e95-7271-58d2-b5a7-8f6c433dd560 with identifier: 117547841
2025-12-02 19:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a61f1e95-7271-58d2-b5a7-8f6c433dd560 with identifier: 117547841 to the API
2025-12-02 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a61f1e95-7271-58d2-b5a7-8f6c433dd560%27 HTTP/1.1" 200 None
2025-12-02 19:04:18 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a61f1e95-7271-58d2-b5a7-8f6c433dd560: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:04:18 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117547841?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'a61f1e95-7271-58d2-b5a7-8f6c433dd560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SK22HVM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117547841',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TOYOTA',
 'model': 'YARIS CROSS ESTATE',
 'odometer': 40670,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-15',
 'seller_name': 'TCB Group - Prime',
 'title': 'TOYOTA YARIS CROSS ESTATE 1.5 Hybrid Icon 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.5 Hybrid Icon 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547841%27 HTTP/1.1" 200 None
2025-12-02 19:04:18 [astonbarclay.gb] INFO: Saving data for 117547841: {'auction_closing_time': 1764927900.0, 'created_time': 1764615692.401869, 'last_price_update_time': 1764702258.141971}
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117547841') HTTP/1.1" 204 0
2025-12-02 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA72EOP/2025-11-28/image/7ce04a58-e8e8-4770-ac85-8d0b1daf2786_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117180618?view=catalogue)
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252F77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F6c1d66d9-d83c-4253-94eb-7ebadbfe3d1c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/6c1d66d9-d83c-4253-94eb-7ebadbfe3d1c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06c8e10>
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252F4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c59f23d-7191-522b-a0c6-0f57f2226b11
2025-12-02 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574882?view=catalogue)
2025-12-02 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VU71HXK/2025-11-28/image/eba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574337?view=catalogue)
2025-12-02 19:04:18 [astonbarclay.gb] INFO: Found listing with ID: 117549728
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549728%27 HTTP/1.1" 200 None
2025-12-02 19:04:18 [astonbarclay.gb] INFO: Scrape type for 117549728: 1
2025-12-02 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117099177?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252Fd825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/d825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F66eea275-7c11-4925-a5c4-d20e23e67b9c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/66eea275-7c11-4925-a5c4-d20e23e67b9c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b3f750>
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252Fa984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/a984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7442e60-4434-5001-9201-0290dd09a7d2
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0668550>
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F8fe4f446-4a0f-4a18-b7eb-b8fb00880cc4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/8fe4f446-4a0f-4a18-b7eb-b8fb00880cc4_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf034ced0>
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252F347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0529850>
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252Fa85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe
2025-12-02 19:04:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116930700, 'registration': 'FG21AUJ', 'account': 'LIQ001', 'make': 'SEAT', 'model': 'LEON HATCHBACK', 'derivative': '1.0 TSI EVO SE Dynamic 5dr', 'mileage': 77444, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-05-28', 'fuel': 'Petrol', 'motExpiry': '2026-05-28', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/7d08b768-9c75-4cc8-84d6-639b6dc20d5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/b86f5596-80ca-42ba-80de-91085e679399_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/063f7127-b59a-4c1b-a7fe-22292e6b075b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/c13ee221-e5a8-4e5b-bf0e-fc9b617bcd30_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/6f76839d-bc86-4120-82f2-def9a3c88e2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/a266d2ba-fb62-48df-b3ad-e9f44b034ddc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/099382a1-ac40-4d1f-93fe-dcf557af9550_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/0ba49251-4efe-45b2-9a4f-56a15f539716_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/a698d1c4-7ccf-4126-b6f6-80768b3b3ea7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 05/22-17K,10/23-51K, 05/24-58K, 11/25-69K', 'remarks': 'SPARE KEY, VOSA STATES 58K 69K', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cb67d143-afd9-4c6a-a7e3-3c9e374b2504.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116930700, 'registration': 'FG21AUJ', 'account': 'LIQ001', 'make': 'SEAT', 'model': 'LEON HATCHBACK', 'derivative': '1.0 TSI EVO SE Dynamic 5dr', 'mileage': 77444, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-05-28', 'fuel': 'Petrol', 'motExpiry': '2026-05-28', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/7d08b768-9c75-4cc8-84d6-639b6dc20d5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/b86f5596-80ca-42ba-80de-91085e679399_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/063f7127-b59a-4c1b-a7fe-22292e6b075b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/c13ee221-e5a8-4e5b-bf0e-fc9b617bcd30_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/6f76839d-bc86-4120-82f2-def9a3c88e2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/a266d2ba-fb62-48df-b3ad-e9f44b034ddc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/099382a1-ac40-4d1f-93fe-dcf557af9550_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/0ba49251-4efe-45b2-9a4f-56a15f539716_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG21AUJ/2025-11-11/image/a698d1c4-7ccf-4126-b6f6-80768b3b3ea7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 05/22-17K,10/23-51K, 05/24-58K, 11/25-69K', 'remarks': 'SPARE KEY, VOSA STATES 58K 69K', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cb67d143-afd9-4c6a-a7e3-3c9e374b2504.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f6f0898-e766-5858-b2b4-e8bb642b72ce with identifier: 116930700
2025-12-02 19:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f6f0898-e766-5858-b2b4-e8bb642b72ce with scrape type 2
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f6f0898-e766-5858-b2b4-e8bb642b72ce with scrape type 2
2025-12-02 19:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5f6f0898-e766-5858-b2b4-e8bb642b72ce, identifier: 116930700
2025-12-02 19:04:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117508313, 'registration': 'MJ71XVZ', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto', 'mileage': 32569, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-12', 'fuel': 'Electric', 'motExpiry': '2026-11-11', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/fca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/bddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/e8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23- 16K, 11/25- 32K,', 'remarks': '**808**VOSA STATES 23K, 31K SPARE KEY   \t Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ca903a79-c9c9-4b94-9537-70f8f4398405.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117508313, 'registration': 'MJ71XVZ', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto', 'mileage': 32569, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-12', 'fuel': 'Electric', 'motExpiry': '2026-11-11', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/fca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/bddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/e8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23- 16K, 11/25- 32K,', 'remarks': '**808**VOSA STATES 23K, 31K SPARE KEY   \t Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ca903a79-c9c9-4b94-9537-70f8f4398405.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc40b220-30ca-5b5b-b901-16ef42be703b with identifier: 117508313
2025-12-02 19:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc40b220-30ca-5b5b-b901-16ef42be703b with scrape type 1
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item fc40b220-30ca-5b5b-b901-16ef42be703b
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252Ffca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/fca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117357513, 'registration': 'DU71ZLX', 'account': 'ZEN009', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi SE Connect 5dr 2WD', 'mileage': 22116, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/d9767184-d6b2-4788-9050-c3ef37623fd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/ee529dcf-275d-4edf-9f45-5fcca842b620_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/af8dc17b-d64b-46f2-8782-263da7e4b1c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/0c88fc6a-f52d-4f92-8ef0-804a657dc50a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/9e30bbeb-f697-4cdd-9291-70d1b7c95dbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/aa92b099-6ac7-4160-a177-7db62da20a61_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/09b7ab18-4e83-40ed-9c0e-df8e75ae3253_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/959a0637-9071-4570-b04a-300579ffe879_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/23 5k 12/23 10k 12/24 16k', 'remarks': 'VOSA STATES 14K 21K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a66bc252-4680-46fd-a87b-86bfbd0514f3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117357513, 'registration': 'DU71ZLX', 'account': 'ZEN009', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi SE Connect 5dr 2WD', 'mileage': 22116, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/d9767184-d6b2-4788-9050-c3ef37623fd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/ee529dcf-275d-4edf-9f45-5fcca842b620_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/af8dc17b-d64b-46f2-8782-263da7e4b1c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/0c88fc6a-f52d-4f92-8ef0-804a657dc50a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/9e30bbeb-f697-4cdd-9291-70d1b7c95dbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/aa92b099-6ac7-4160-a177-7db62da20a61_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/09b7ab18-4e83-40ed-9c0e-df8e75ae3253_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/959a0637-9071-4570-b04a-300579ffe879_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/23 5k 12/23 10k 12/24 16k', 'remarks': 'VOSA STATES 14K 21K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a66bc252-4680-46fd-a87b-86bfbd0514f3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79bfe727-cd81-5a06-9447-4b4709589f47 with identifier: 117357513
2025-12-02 19:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79bfe727-cd81-5a06-9447-4b4709589f47 with scrape type 1
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 79bfe727-cd81-5a06-9447-4b4709589f47
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252Fd9767184-d6b2-4788-9050-c3ef37623fd3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/d9767184-d6b2-4788-9050-c3ef37623fd3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117400056, 'registration': 'DC23JVG', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 21736, 'mileageWarranty': False, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JVG/2025-11-26/image/7ff85033-7524-4d6f-96d5-87f1801629e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/771c9c50-2822-42cc-a8e2-a1d6c7093959_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/1697ec9f-52b5-47fa-ac8c-b74f9f0e9c2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/893266e5-514c-4fd6-8def-290d3d22b8cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/191f9518-faa5-4791-ab7e-0e8b18fce798_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/19a47bfe-efc5-42fa-b3ed-4ab68c9de594_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/31e795b0-da14-4526-a9d8-62bb428a63ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/02256777-1d83-4427-aacc-81021c4b5938_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/82cff651-6854-4b4e-9042-a2a3d5eb8d5d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 09/25- 19K', 'remarks': '**1828**', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0db2a72d-0177-48f0-b23b-0b90f2cae241.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117400056, 'registration': 'DC23JVG', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 21736, 'mileageWarranty': False, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JVG/2025-11-26/image/7ff85033-7524-4d6f-96d5-87f1801629e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/771c9c50-2822-42cc-a8e2-a1d6c7093959_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/1697ec9f-52b5-47fa-ac8c-b74f9f0e9c2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/893266e5-514c-4fd6-8def-290d3d22b8cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/191f9518-faa5-4791-ab7e-0e8b18fce798_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/19a47bfe-efc5-42fa-b3ed-4ab68c9de594_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/31e795b0-da14-4526-a9d8-62bb428a63ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/02256777-1d83-4427-aacc-81021c4b5938_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JVG/2025-11-26/image/82cff651-6854-4b4e-9042-a2a3d5eb8d5d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 09/25- 19K', 'remarks': '**1828**', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0db2a72d-0177-48f0-b23b-0b90f2cae241.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75be8e52-2132-5708-8a77-429c787fa81a with identifier: 117400056
2025-12-02 19:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75be8e52-2132-5708-8a77-429c787fa81a with scrape type 2
2025-12-02 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75be8e52-2132-5708-8a77-429c787fa81a with scrape type 2
2025-12-02 19:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 75be8e52-2132-5708-8a77-429c787fa81a, identifier: 117400056
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0528450>
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F11c508f6-ae76-439c-aa46-ef4021156bdb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/11c508f6-ae76-439c-aa46-ef4021156bdb_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b85115f0-b8f6-5465-87ac-c739e7b81ee4
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf044a650>
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252F4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c59f23d-7191-522b-a0c6-0f57f2226b11
2025-12-02 19:04:20 [astonbarclay.gb] INFO: Found listing with ID: 117372665
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372665%27 HTTP/1.1" 200 None
2025-12-02 19:04:20 [astonbarclay.gb] INFO: Scrape type for 117372665: 1
2025-12-02 19:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5f6f0898-e766-5858-b2b4-e8bb642b72ce with identifier: 116930700
2025-12-02 19:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5f6f0898-e766-5858-b2b4-e8bb642b72ce with identifier: 116930700
2025-12-02 19:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5f6f0898-e766-5858-b2b4-e8bb642b72ce with identifier: 116930700 to the API
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116930700?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5f6f0898-e766-5858-b2b4-e8bb642b72ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FG21AUJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116930700',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SEAT',
 'model': 'LEON HATCHBACK',
 'odometer': 77444,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-28',
 'seller_name': 'Liquid Fleet',
 'title': 'SEAT LEON HATCHBACK 1.0 TSI EVO SE Dynamic 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI EVO SE Dynamic 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116930700%27 HTTP/1.1" 200 None
2025-12-02 19:04:20 [astonbarclay.gb] INFO: Saving data for 116930700: {'auction_closing_time': 1764842400.0, 'created_time': 1763492972.785789, 'last_price_update_time': 1764702260.866171}
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116930700') HTTP/1.1" 204 0
2025-12-02 19:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 75be8e52-2132-5708-8a77-429c787fa81a with identifier: 117400056
2025-12-02 19:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 75be8e52-2132-5708-8a77-429c787fa81a with identifier: 117400056
2025-12-02 19:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 75be8e52-2132-5708-8a77-429c787fa81a with identifier: 117400056 to the API
2025-12-02 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117400056?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '75be8e52-2132-5708-8a77-429c787fa81a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23JVG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117400056',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 21736,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-26',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400056%27 HTTP/1.1" 200 None
2025-12-02 19:04:21 [astonbarclay.gb] INFO: Saving data for 117400056: {'auction_closing_time': 1764927900.0, 'created_time': 1764234084.655102, 'last_price_update_time': 1764702261.250817}
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117400056') HTTP/1.1" 204 0
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0643d10>
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F7ce04a58-e8e8-4770-ac85-8d0b1daf2786_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/7ce04a58-e8e8-4770-ac85-8d0b1daf2786_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b85115f0-b8f6-5465-87ac-c739e7b81ee4
2025-12-02 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71HUK/2025-11-27/image/5df49d56-939e-4d97-b10e-19e08c8abc1e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542530?view=catalogue)
2025-12-02 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VU71HXK/2025-11-28/image/b8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574337?view=catalogue)
2025-12-02 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VU71HXK/2025-11-28/image/0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574337?view=catalogue)
2025-12-02 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA72EOP/2025-11-28/image/be422197-17a4-44f0-a07b-3eccc55e8fc3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117180618?view=catalogue)
2025-12-02 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/b26a89c1-daac-4a9e-987f-36b0d7c88f8f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509080?view=catalogue)
2025-12-02 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA72EOP/2025-11-28/image/f7178be2-cdc7-4043-9000-ecdc2f616825_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117180618?view=catalogue)
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252F11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F244626a7-d00c-41f5-b8db-d5f9472fecbf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/244626a7-d00c-41f5-b8db-d5f9472fecbf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252Fee529dcf-275d-4edf-9f45-5fcca842b620_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/ee529dcf-275d-4edf-9f45-5fcca842b620_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116699739?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PN71OEO/2025-12-01/image/2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609383?view=catalogue)
2025-12-02 19:04:21 [astonbarclay.gb] INFO: Found listing with ID: 116983938
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116983938%27 HTTP/1.1" 200 None
2025-12-02 19:04:21 [astonbarclay.gb] INFO: Scrape type for 116983938: 2
2025-12-02 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117509119?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05e6f10>
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252F9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58b820cf-82d8-5a63-ac61-5c4de479678a
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a9eb50>
2025-12-02 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252Feba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/eba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c59f23d-7191-522b-a0c6-0f57f2226b11
2025-12-02 19:04:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117099177, 'registration': 'KP72FZC', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V2 58kWh 5dr Auto', 'mileage': 10674, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-26', 'fuel': 'Electric', 'motExpiry': '2026-09-25', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KP72FZC/2025-11-12/image/8b9f2051-21dc-4f4f-a4bb-d7e44076baad_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/05eeb53f-7a8e-4c91-9cfb-5119bf1f02e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/f38b11d1-9159-492f-8c8d-182ab9ea2adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/e9b729de-bff1-4491-b4a4-a29b0232fa33_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/c7a1d6f6-9bf4-4734-8ed0-1342274fab30_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/9601cdef-d021-43d1-89c2-ebf583cb9e01_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/6360dd1d-9b3f-4670-af8a-a0d247e0045d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/512aa1a6-83f2-4b92-825f-d3ff5ab0b918_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24-7k,', 'remarks': 'vosa states 9k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f9cd20d7-96c0-4f7b-8625-0e4e5644776e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117099177, 'registration': 'KP72FZC', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V2 58kWh 5dr Auto', 'mileage': 10674, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-26', 'fuel': 'Electric', 'motExpiry': '2026-09-25', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KP72FZC/2025-11-12/image/8b9f2051-21dc-4f4f-a4bb-d7e44076baad_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/05eeb53f-7a8e-4c91-9cfb-5119bf1f02e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/f38b11d1-9159-492f-8c8d-182ab9ea2adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/e9b729de-bff1-4491-b4a4-a29b0232fa33_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/c7a1d6f6-9bf4-4734-8ed0-1342274fab30_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/9601cdef-d021-43d1-89c2-ebf583cb9e01_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/6360dd1d-9b3f-4670-af8a-a0d247e0045d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72FZC/2025-11-12/image/512aa1a6-83f2-4b92-825f-d3ff5ab0b918_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24-7k,', 'remarks': 'vosa states 9k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f9cd20d7-96c0-4f7b-8625-0e4e5644776e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295 with identifier: 117099177
2025-12-02 19:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295 with scrape type 2
2025-12-02 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295 with scrape type 2
2025-12-02 19:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295, identifier: 117099177
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252Fab5ec6b3-7013-42f7-8321-2be212575929_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/ab5ec6b3-7013-42f7-8321-2be212575929_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252Faf8dc17b-d64b-46f2-8782-263da7e4b1c5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/af8dc17b-d64b-46f2-8782-263da7e4b1c5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295 with identifier: 117099177
2025-12-02 19:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295 with identifier: 117099177
2025-12-02 19:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 10674, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099177', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw v2 58kwh 5dr auto', 'license_plate': 'kp72fzc', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295', 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 17178} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'kp72fzc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099177',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 10674,
     'odometer_in_km': 17178,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-26',
     'sanitized_make': 'cupra',
     'seller_name': 'zenith',
     'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v2 58kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295 spider: astonbarclay.gb
2025-12-02 19:04:22 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 10674, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099177', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw v2 58kwh 5dr auto', 'license_plate': 'kp72fzc', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295', 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 17178} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'kp72fzc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099177',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 10674,
     'odometer_in_km': 17178,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-26',
     'sanitized_make': 'cupra',
     'seller_name': 'zenith',
     'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v2 58kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '5cbdc4d2-ce2e-5d92-9426-5bb5f3f21295',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KP72FZC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099177',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'CUPRA',
 'model': 'BORN ELECTRIC HATCHBACK',
 'odometer': 10674,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-26',
 'seller_name': 'Zenith',
 'title': 'CUPRA BORN ELECTRIC HATCHBACK 150kW V2 58kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW V2 58kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099177%27 HTTP/1.1" 200 None
2025-12-02 19:04:22 [astonbarclay.gb] INFO: Saving data for 117099177: {'auction_closing_time': 1764842400.0, 'created_time': 1762974364.199639, 'last_price_update_time': 1764702262.410878}
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117099177') HTTP/1.1" 204 0
2025-12-02 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA72EOP/2025-11-28/image/6c1d66d9-d83c-4253-94eb-7ebadbfe3d1c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117180618?view=catalogue)
2025-12-02 19:04:22 [astonbarclay.gb] INFO: Found listing with ID: 117544110
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544110%27 HTTP/1.1" 200 None
2025-12-02 19:04:22 [astonbarclay.gb] INFO: Scrape type for 117544110: 1
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F4f102e8b-5a03-4f37-aadc-cd7fe8baabf8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/4f102e8b-5a03-4f37-aadc-cd7fe8baabf8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252Fbddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/bddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252F0c88fc6a-f52d-4f92-8ef0-804a657dc50a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/0c88fc6a-f52d-4f92-8ef0-804a657dc50a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117411712?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117451511?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0619ed0>
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252F5df49d56-939e-4d97-b10e-19e08c8abc1e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/5df49d56-939e-4d97-b10e-19e08c8abc1e_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67451644-95be-507f-a155-ac065161e243
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf044a9d0>
2025-12-02 19:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252Fb8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/b8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c59f23d-7191-522b-a0c6-0f57f2226b11
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0369410>
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252F0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c59f23d-7191-522b-a0c6-0f57f2226b11
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08275d0>
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252Fbe422197-17a4-44f0-a07b-3eccc55e8fc3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/be422197-17a4-44f0-a07b-3eccc55e8fc3_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b85115f0-b8f6-5465-87ac-c739e7b81ee4
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf079c090>
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252Fb26a89c1-daac-4a9e-987f-36b0d7c88f8f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/b26a89c1-daac-4a9e-987f-36b0d7c88f8f_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02f2190>
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252Ff7178be2-cdc7-4043-9000-ecdc2f616825_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/f7178be2-cdc7-4043-9000-ecdc2f616825_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b85115f0-b8f6-5465-87ac-c739e7b81ee4
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116699739, 'registration': 'RE22UCM', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 33471, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-04-03', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f7a81ad1-19a7-4c2b-a26d-70c5a93dbf16_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/c351beb1-21fd-462f-a072-1f84c9bfb965_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/6b996730-6c5c-4e01-b5e4-7d94a44369ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/bb9bf7b7-edc4-4a14-92a3-fd55c942eb30_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/d2fb3376-6382-4e1d-a16c-7b36320473e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f1bd2660-aec5-4d87-a38c-cb64244885b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/7e712e7b-3cda-4ebd-b53e-af0d5da572fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f5d42b5b-5135-48da-8fd2-4679f6e94f9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/9998987d-ad40-490f-8834-255948c12c48_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**282**SPARE KEY / Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eba9cff5-6fbc-497d-8b18-a07213bde2a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116699739, 'registration': 'RE22UCM', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 33471, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-04-03', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f7a81ad1-19a7-4c2b-a26d-70c5a93dbf16_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/c351beb1-21fd-462f-a072-1f84c9bfb965_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/6b996730-6c5c-4e01-b5e4-7d94a44369ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/bb9bf7b7-edc4-4a14-92a3-fd55c942eb30_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/d2fb3376-6382-4e1d-a16c-7b36320473e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f1bd2660-aec5-4d87-a38c-cb64244885b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/7e712e7b-3cda-4ebd-b53e-af0d5da572fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f5d42b5b-5135-48da-8fd2-4679f6e94f9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/9998987d-ad40-490f-8834-255948c12c48_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**282**SPARE KEY / Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eba9cff5-6fbc-497d-8b18-a07213bde2a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b0bf54-378a-5e7c-863f-8cd92e109515 with identifier: 116699739
2025-12-02 19:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b0bf54-378a-5e7c-863f-8cd92e109515 with scrape type 2
2025-12-02 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63b0bf54-378a-5e7c-863f-8cd92e109515 with scrape type 2
2025-12-02 19:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 63b0bf54-378a-5e7c-863f-8cd92e109515, identifier: 116699739
2025-12-02 19:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03037d0>
2025-12-02 19:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252F2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117509119, 'registration': 'AO71XVH', 'account': 'ZEN002', 'make': 'BMW', 'model': '2 SERIES GRAN COUPE', 'derivative': '218i [136] Sport 4dr DCT [Live Cockpit Prof]', 'mileage': 62874, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-02', 'fuel': 'Petrol', 'motExpiry': '2026-11-13', 'doors': 4, 'engineSize': 1499, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AO71XVH/2025-11-28/image/727d2cd5-a675-43e9-972f-73c85ca2acf2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/ecc4f524-f6c8-4375-8930-d7278a80031a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d014bdba-9fd6-4ebb-9d99-a9b69eca694f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/b1737738-433b-479d-af4f-0b1d75bdc385_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/a4e54916-5ce3-4342-8872-55cf113eab79_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/428d149c-5436-4dde-92f7-1dc373a5542c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d489d5aa-aa5f-4a2b-8ac9-7aec30582f1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d962289a-3935-4e94-83fd-5caebadf04f6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/22-21k, 02/23-29k, 09/23-43k, 09/25-62k,', 'remarks': 'vosa states 55k, 62k,', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/50463fac-de54-4707-98a5-69d18cfface3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117509119, 'registration': 'AO71XVH', 'account': 'ZEN002', 'make': 'BMW', 'model': '2 SERIES GRAN COUPE', 'derivative': '218i [136] Sport 4dr DCT [Live Cockpit Prof]', 'mileage': 62874, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-02', 'fuel': 'Petrol', 'motExpiry': '2026-11-13', 'doors': 4, 'engineSize': 1499, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AO71XVH/2025-11-28/image/727d2cd5-a675-43e9-972f-73c85ca2acf2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/ecc4f524-f6c8-4375-8930-d7278a80031a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d014bdba-9fd6-4ebb-9d99-a9b69eca694f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/b1737738-433b-479d-af4f-0b1d75bdc385_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/a4e54916-5ce3-4342-8872-55cf113eab79_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/428d149c-5436-4dde-92f7-1dc373a5542c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d489d5aa-aa5f-4a2b-8ac9-7aec30582f1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d962289a-3935-4e94-83fd-5caebadf04f6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/22-21k, 02/23-29k, 09/23-43k, 09/25-62k,', 'remarks': 'vosa states 55k, 62k,', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/50463fac-de54-4707-98a5-69d18cfface3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d59de41-1bac-57aa-a199-c7265717669d with identifier: 117509119
2025-12-02 19:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d59de41-1bac-57aa-a199-c7265717669d with scrape type 1
2025-12-02 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1d59de41-1bac-57aa-a199-c7265717669d
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252F727d2cd5-a675-43e9-972f-73c85ca2acf2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/727d2cd5-a675-43e9-972f-73c85ca2acf2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VU71HXK/2025-11-28/image/77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574337?view=catalogue)
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Found listing with ID: 117101159
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101159%27 HTTP/1.1" 200 None
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Scrape type for 117101159: 0
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Found listing with ID: 117183441
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117183441%27 HTTP/1.1" 200 None
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Scrape type for 117183441: 0
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Found listing with ID: 116879417
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116879417%27 HTTP/1.1" 200 None
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Scrape type for 116879417: 0
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Found listing with ID: 117288452
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288452%27 HTTP/1.1" 200 None
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Scrape type for 117288452: 0
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Found listing with ID: 116637669
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116637669%27 HTTP/1.1" 200 None
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Scrape type for 116637669: 1
2025-12-02 19:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 63b0bf54-378a-5e7c-863f-8cd92e109515 with identifier: 116699739
2025-12-02 19:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 63b0bf54-378a-5e7c-863f-8cd92e109515 with identifier: 116699739
2025-12-02 19:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 63b0bf54-378a-5e7c-863f-8cd92e109515 with identifier: 116699739 to the API
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116699739?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '63b0bf54-378a-5e7c-863f-8cd92e109515',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22UCM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116699739',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 33471,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-19',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699739%27 HTTP/1.1" 200 None
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Saving data for 116699739: {'auction_closing_time': 1764755100.0, 'created_time': 1762284213.54789, 'last_price_update_time': 1764702264.783717}
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116699739') HTTP/1.1" 204 0
2025-12-02 19:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VU71HXK/2025-11-28/image/d825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574337?view=catalogue)
2025-12-02 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/d9767184-d6b2-4788-9050-c3ef37623fd3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117357513?view=catalogue)
2025-12-02 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY72ASX/2025-12-01/image/1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101420?view=catalogue)
2025-12-02 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/fca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508313?view=catalogue)
2025-12-02 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/ee529dcf-275d-4edf-9f45-5fcca842b620_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117357513?view=catalogue)
2025-12-02 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA72EOP/2025-11-28/image/66eea275-7c11-4925-a5c4-d20e23e67b9c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117180618?view=catalogue)
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252F9e30bbeb-f697-4cdd-9291-70d1b7c95dbd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/9e30bbeb-f697-4cdd-9291-70d1b7c95dbd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fecc4f524-f6c8-4375-8930-d7278a80031a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/ecc4f524-f6c8-4375-8930-d7278a80031a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Found listing with ID: 117446714
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446714%27 HTTP/1.1" 200 None
2025-12-02 19:04:24 [astonbarclay.gb] INFO: Scrape type for 117446714: 1
2025-12-02 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117446881?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117100813?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116339169?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05e6ed0>
2025-12-02 19:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F6c1d66d9-d83c-4253-94eb-7ebadbfe3d1c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/6c1d66d9-d83c-4253-94eb-7ebadbfe3d1c_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b85115f0-b8f6-5465-87ac-c739e7b81ee4
2025-12-02 19:04:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117411712, 'registration': 'VN71WCD', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh Sport 5dr Auto [C+S]', 'mileage': 37769, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-10', 'fuel': 'Electric', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24 - 20K', 'remarks': '**743**VOSA STATES 28K, 36K Intr Pckg For Frnt Sprt Sts In Twin Lthr; Metallic Paint SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a908bad-3f1e-4e0d-b3f0-6d90d8863cae.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117411712, 'registration': 'VN71WCD', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh Sport 5dr Auto [C+S]', 'mileage': 37769, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-10', 'fuel': 'Electric', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24 - 20K', 'remarks': '**743**VOSA STATES 28K, 36K Intr Pckg For Frnt Sprt Sts In Twin Lthr; Metallic Paint SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a908bad-3f1e-4e0d-b3f0-6d90d8863cae.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2fb09a9-029b-5eab-ae02-9631ac546b3d with identifier: 117411712
2025-12-02 19:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2fb09a9-029b-5eab-ae02-9631ac546b3d with scrape type 2
2025-12-02 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2fb09a9-029b-5eab-ae02-9631ac546b3d with scrape type 2
2025-12-02 19:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b2fb09a9-029b-5eab-ae02-9631ac546b3d, identifier: 117411712
2025-12-02 19:04:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117451511, 'registration': 'RE72NUJ', 'account': 'DAY005', 'make': 'KIA', 'model': 'NIRO ESTATE', 'derivative': '1.6 GDi Hybrid 2 5dr DCT', 'mileage': 32096, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-10', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-11-19', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print and book 11/25 - 31K', 'remarks': '*1664** VOSA STATES 31K,', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 100, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117451511, 'registration': 'RE72NUJ', 'account': 'DAY005', 'make': 'KIA', 'model': 'NIRO ESTATE', 'derivative': '1.6 GDi Hybrid 2 5dr DCT', 'mileage': 32096, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-10', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-11-19', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print and book 11/25 - 31K', 'remarks': '*1664** VOSA STATES 31K,', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 100, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab15498c-9d0c-5e73-94f6-dbc93a09ea6d with identifier: 117451511
2025-12-02 19:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab15498c-9d0c-5e73-94f6-dbc93a09ea6d with scrape type 1
2025-12-02 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ab15498c-9d0c-5e73-94f6-dbc93a09ea6d
2025-12-02 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ab15498c-9d0c-5e73-94f6-dbc93a09ea6d
2025-12-02 19:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ab15498c-9d0c-5e73-94f6-dbc93a09ea6d, identifier: 117451511
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252Faa92b099-6ac7-4160-a177-7db62da20a61_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/aa92b099-6ac7-4160-a177-7db62da20a61_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fd014bdba-9fd6-4ebb-9d99-a9b69eca694f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d014bdba-9fd6-4ebb-9d99-a9b69eca694f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b2fb09a9-029b-5eab-ae02-9631ac546b3d with identifier: 117411712
2025-12-02 19:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b2fb09a9-029b-5eab-ae02-9631ac546b3d with identifier: 117411712
2025-12-02 19:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh sport 5dr auto [c+s]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 37769, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117411712', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh sport 5dr auto [c+s]', 'license_plate': 'vn71wcd', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b2fb09a9-029b-5eab-ae02-9631ac546b3d', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 60783} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': 'b2fb09a9-029b-5eab-ae02-9631ac546b3d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vn71wcd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117411712',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 37769,
     'odometer_in_km': 60783,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-10',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh sport 5dr auto [c+s]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh sport 5dr auto [c+s]',
     'vin': None,
     'year': 2021}
2025-12-02 19:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: b2fb09a9-029b-5eab-ae02-9631ac546b3d spider: astonbarclay.gb
2025-12-02 19:04:25 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b2fb09a9-029b-5eab-ae02-9631ac546b3d due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh sport 5dr auto [c+s]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 37769, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117411712', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh sport 5dr auto [c+s]', 'license_plate': 'vn71wcd', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b2fb09a9-029b-5eab-ae02-9631ac546b3d', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 60783} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': 'b2fb09a9-029b-5eab-ae02-9631ac546b3d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vn71wcd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117411712',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 37769,
     'odometer_in_km': 60783,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-10',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh sport 5dr auto [c+s]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh sport 5dr auto [c+s]',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'b2fb09a9-029b-5eab-ae02-9631ac546b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VN71WCD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117411712',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q4 E-TRON ESTATE',
 'odometer': 37769,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-10',
 'seller_name': 'Zenith',
 'title': 'AUDI Q4 E-TRON ESTATE 150kW 40 82kWh Sport 5dr Auto [C+S]',
 'transmission': 'automatic',
 'trim': '150kW 40 82kWh Sport 5dr Auto [C+S]',
 'vin': None,
 'year': 2021}
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117411712%27 HTTP/1.1" 200 None
2025-12-02 19:04:25 [astonbarclay.gb] INFO: Saving data for 117411712: {'auction_closing_time': 1764755100.0, 'created_time': 1764270060.927212, 'last_price_update_time': 1764702265.613664}
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117411712') HTTP/1.1" 204 0
2025-12-02 19:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ab15498c-9d0c-5e73-94f6-dbc93a09ea6d with identifier: 117451511
2025-12-02 19:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ab15498c-9d0c-5e73-94f6-dbc93a09ea6d with identifier: 117451511
2025-12-02 19:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ab15498c-9d0c-5e73-94f6-dbc93a09ea6d with identifier: 117451511 to the API
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ab15498c-9d0c-5e73-94f6-dbc93a09ea6d%27 HTTP/1.1" 200 None
2025-12-02 19:04:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ab15498c-9d0c-5e73-94f6-dbc93a09ea6d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:04:25 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117451511?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'ab15498c-9d0c-5e73-94f6-dbc93a09ea6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE72NUJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117451511',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'KIA',
 'model': 'NIRO ESTATE',
 'odometer': 32096,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': 'Days Fleet',
 'title': 'KIA NIRO ESTATE 1.6 GDi Hybrid 2 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.6 GDi Hybrid 2 5dr DCT',
 'vin': None,
 'year': 2022}
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451511%27 HTTP/1.1" 200 None
2025-12-02 19:04:25 [astonbarclay.gb] INFO: Saving data for 117451511: {'created_time': 1764702265.903663, 'last_price_update_time': 1764702265.903674, 'auction_closing_time': 1764927900.0}
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117451511') HTTP/1.1" 204 0
2025-12-02 19:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508313?view=catalogue)
2025-12-02 19:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/af8dc17b-d64b-46f2-8782-263da7e4b1c5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117357513?view=catalogue)
2025-12-02 19:04:25 [astonbarclay.gb] INFO: Found listing with ID: 117103670
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103670%27 HTTP/1.1" 200 None
2025-12-02 19:04:25 [astonbarclay.gb] INFO: Scrape type for 117103670: 1
2025-12-02 19:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0948f10>
2025-12-02 19:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252F77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c59f23d-7191-522b-a0c6-0f57f2226b11
2025-12-02 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71XVH/2025-11-28/image/727d2cd5-a675-43e9-972f-73c85ca2acf2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509119?view=catalogue)
2025-12-02 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/bddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508313?view=catalogue)
2025-12-02 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508313?view=catalogue)
2025-12-02 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/0c88fc6a-f52d-4f92-8ef0-804a657dc50a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117357513?view=catalogue)
2025-12-02 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA72EOP/2025-11-28/image/4f102e8b-5a03-4f37-aadc-cd7fe8baabf8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117180618?view=catalogue)
2025-12-02 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA72EOP/2025-11-28/image/ab5ec6b3-7013-42f7-8321-2be212575929_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117180618?view=catalogue)
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252F09b7ab18-4e83-40ed-9c0e-df8e75ae3253_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/09b7ab18-4e83-40ed-9c0e-df8e75ae3253_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fb1737738-433b-479d-af4f-0b1d75bdc385_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/b1737738-433b-479d-af4f-0b1d75bdc385_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:26 [astonbarclay.gb] INFO: Found listing with ID: 117103769
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103769%27 HTTP/1.1" 200 None
2025-12-02 19:04:26 [astonbarclay.gb] INFO: Scrape type for 117103769: 1
2025-12-02 19:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ee190>
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252Fd825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/d825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c59f23d-7191-522b-a0c6-0f57f2226b11
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0643210>
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252Fd9767184-d6b2-4788-9050-c3ef37623fd3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/d9767184-d6b2-4788-9050-c3ef37623fd3_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79bfe727-cd81-5a06-9447-4b4709589f47
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf075a390>
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252F1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4f48589-fe70-55fd-8be4-3136f685545b
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0640ed0>
2025-12-02 19:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252Ffca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/fca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc40b220-30ca-5b5b-b901-16ef42be703b
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0592e50>
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252Fee529dcf-275d-4edf-9f45-5fcca842b620_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/ee529dcf-275d-4edf-9f45-5fcca842b620_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79bfe727-cd81-5a06-9447-4b4709589f47
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05924d0>
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F66eea275-7c11-4925-a5c4-d20e23e67b9c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/66eea275-7c11-4925-a5c4-d20e23e67b9c_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b85115f0-b8f6-5465-87ac-c739e7b81ee4
2025-12-02 19:04:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117446881, 'registration': 'SJ70WNR', 'account': 'LEA009', 'make': 'TOYOTA', 'model': 'COROLLA HATCHBACK', 'derivative': '1.8 VVT-i Hybrid Icon Tech 5dr CVT', 'mileage': 16347, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-12-16', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/74f410c8-67bf-40ec-bd1c-d91c6975bba8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/cb225f8b-cdc8-4c37-985a-6d8f67ec48ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/e9b3f1e1-65ca-41f5-81ed-53e5efc3ccae_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/4023ae9c-64f3-4ad8-abbc-4e850dd3d6b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/c2de56dc-7d0d-4d26-b8f7-643e8b1f3856_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/6a89d969-8f4f-4a4e-9abc-d8f8eadbdb71_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/a74c7deb-8d40-4843-bbc9-dcb2cb372f94_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/ca40e6e4-06d4-4fbc-a4b9-99927d85b032_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/f34cd200-8a22-41b2-89d6-1e8b6f0c5228_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book NO SERVICE', 'remarks': '**994** VOSA STATES 6K, 11K 16K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 102, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/575c7817-4197-4809-bfc7-6ca7de82904d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117446881, 'registration': 'SJ70WNR', 'account': 'LEA009', 'make': 'TOYOTA', 'model': 'COROLLA HATCHBACK', 'derivative': '1.8 VVT-i Hybrid Icon Tech 5dr CVT', 'mileage': 16347, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-12-16', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/74f410c8-67bf-40ec-bd1c-d91c6975bba8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/cb225f8b-cdc8-4c37-985a-6d8f67ec48ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/e9b3f1e1-65ca-41f5-81ed-53e5efc3ccae_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/4023ae9c-64f3-4ad8-abbc-4e850dd3d6b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/c2de56dc-7d0d-4d26-b8f7-643e8b1f3856_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/6a89d969-8f4f-4a4e-9abc-d8f8eadbdb71_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/a74c7deb-8d40-4843-bbc9-dcb2cb372f94_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/ca40e6e4-06d4-4fbc-a4b9-99927d85b032_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/f34cd200-8a22-41b2-89d6-1e8b6f0c5228_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book NO SERVICE', 'remarks': '**994** VOSA STATES 6K, 11K 16K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 102, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/575c7817-4197-4809-bfc7-6ca7de82904d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71483516-b9d5-594e-82f5-ffef2099fd34 with identifier: 117446881
2025-12-02 19:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71483516-b9d5-594e-82f5-ffef2099fd34 with scrape type 1
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 71483516-b9d5-594e-82f5-ffef2099fd34
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252F74f410c8-67bf-40ec-bd1c-d91c6975bba8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/74f410c8-67bf-40ec-bd1c-d91c6975bba8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117100813, 'registration': 'YE72NYL', 'account': 'ZEN009', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 28466, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-12-06', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YE72NYL/2025-12-02/image/7f2ad809-16aa-4677-8fd3-e0e1a668ba71_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/18bee46c-db9d-433e-83ed-13d54addfa22_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/45997e16-9fc0-4f07-bb79-dfef7a73a1d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/53c43ca1-0bd7-449c-9d50-ad3a4e12b3b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/d14bfdba-1b74-41fc-bfc4-9228eebee364_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/0c055c06-b7a4-4036-8d52-3d6b5014e334_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/9d80adad-17fe-41ff-bfe7-67502f0b5a5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/707d7481-d731-4fb1-a624-ae7493bd9b39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/2df7c900-c65c-4820-a959-3734acfcf56d_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/25 - 18K', 'remarks': '**929** VOSA STATES 27K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/735016a8-8df8-46c0-a0d9-f47faef8d234.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117100813, 'registration': 'YE72NYL', 'account': 'ZEN009', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 28466, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-12-06', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YE72NYL/2025-12-02/image/7f2ad809-16aa-4677-8fd3-e0e1a668ba71_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/18bee46c-db9d-433e-83ed-13d54addfa22_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/45997e16-9fc0-4f07-bb79-dfef7a73a1d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/53c43ca1-0bd7-449c-9d50-ad3a4e12b3b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/d14bfdba-1b74-41fc-bfc4-9228eebee364_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/0c055c06-b7a4-4036-8d52-3d6b5014e334_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/9d80adad-17fe-41ff-bfe7-67502f0b5a5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/707d7481-d731-4fb1-a624-ae7493bd9b39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/2df7c900-c65c-4820-a959-3734acfcf56d_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/25 - 18K', 'remarks': '**929** VOSA STATES 27K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/735016a8-8df8-46c0-a0d9-f47faef8d234.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12a56f48-06e8-57f9-aff2-c4a0c00fa35c with identifier: 117100813
2025-12-02 19:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c with scrape type 1
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F7f2ad809-16aa-4677-8fd3-e0e1a668ba71_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/7f2ad809-16aa-4677-8fd3-e0e1a668ba71_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116339169, 'registration': 'SL72KND', 'account': 'ZEN002', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 Elite Edition 5dr', 'mileage': 18725, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-30', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SL72KND/2025-11-27/image/18853ed8-1ebe-4f7b-ad0a-f123c6f96c4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/0e083a1d-1bbf-4d0f-a059-61491a76a2d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/90a06186-cded-47db-bb5a-c680df834f39_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/7f36f323-00e3-4656-96ee-e82515551354_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/20180e92-51a9-4412-bc58-4c8c1307e2bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/8c8e93d0-5f2f-4532-a03d-46ac717d5be7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/c81b2da5-e880-4fbf-a599-70b3f7abb5f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/4f7328eb-3003-439d-b651-2a7026e0ca45_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/33a47b4f-f80c-4307-b747-082fe63c6ad7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 06/25- 14K,', 'remarks': '**775**VOSA STATES 18K Two Coat Metallic Paint SPARE KEY  Two Coat Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8ec97f9-269c-48bb-954c-5ee132afeeab.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116339169, 'registration': 'SL72KND', 'account': 'ZEN002', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 Elite Edition 5dr', 'mileage': 18725, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-30', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SL72KND/2025-11-27/image/18853ed8-1ebe-4f7b-ad0a-f123c6f96c4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/0e083a1d-1bbf-4d0f-a059-61491a76a2d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/90a06186-cded-47db-bb5a-c680df834f39_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/7f36f323-00e3-4656-96ee-e82515551354_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/20180e92-51a9-4412-bc58-4c8c1307e2bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/8c8e93d0-5f2f-4532-a03d-46ac717d5be7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/c81b2da5-e880-4fbf-a599-70b3f7abb5f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/4f7328eb-3003-439d-b651-2a7026e0ca45_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/33a47b4f-f80c-4307-b747-082fe63c6ad7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 06/25- 14K,', 'remarks': '**775**VOSA STATES 18K Two Coat Metallic Paint SPARE KEY  Two Coat Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8ec97f9-269c-48bb-954c-5ee132afeeab.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with identifier: 116339169
2025-12-02 19:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with scrape type 2
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with scrape type 2
2025-12-02 19:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0, identifier: 116339169
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252F959a0637-9071-4570-b04a-300579ffe879_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/959a0637-9071-4570-b04a-300579ffe879_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fa4e54916-5ce3-4342-8872-55cf113eab79_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/a4e54916-5ce3-4342-8872-55cf113eab79_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with identifier: 116339169
2025-12-02 19:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with identifier: 116339169
2025-12-02 19:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with identifier: 116339169 to the API
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116339169?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SL72KND',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116339169',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK',
 'odometer': 18725,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Zenith',
 'title': 'VAUXHALL CORSA HATCHBACK 1.2 Elite Edition 5dr',
 'transmission': 'manual',
 'trim': '1.2 Elite Edition 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116339169%27 HTTP/1.1" 200 None
2025-12-02 19:04:28 [astonbarclay.gb] INFO: Saving data for 116339169: {'auction_closing_time': 1764755100.0, 'created_time': 1762284113.69363, 'last_price_update_time': 1764702268.381837}
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116339169') HTTP/1.1" 204 0
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf075bb90>
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc40b220-30ca-5b5b-b901-16ef42be703b
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf037e1d0>
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252Faf8dc17b-d64b-46f2-8782-263da7e4b1c5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/af8dc17b-d64b-46f2-8782-263da7e4b1c5_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79bfe727-cd81-5a06-9447-4b4709589f47
2025-12-02 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508313?view=catalogue)
2025-12-02 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71XVH/2025-11-28/image/ecc4f524-f6c8-4375-8930-d7278a80031a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509119?view=catalogue)
2025-12-02 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/9e30bbeb-f697-4cdd-9291-70d1b7c95dbd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117357513?view=catalogue)
2025-12-02 19:04:29 [astonbarclay.gb] INFO: Found listing with ID: 117344624
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117344624%27 HTTP/1.1" 200 None
2025-12-02 19:04:29 [astonbarclay.gb] INFO: Scrape type for 117344624: 1
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Fcb225f8b-cdc8-4c37-985a-6d8f67ec48ba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/cb225f8b-cdc8-4c37-985a-6d8f67ec48ba_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F18bee46c-db9d-433e-83ed-13d54addfa22_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/18bee46c-db9d-433e-83ed-13d54addfa22_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VU71HXK/2025-11-28/image/11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574337?view=catalogue)
2025-12-02 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA72EOP/2025-11-28/image/244626a7-d00c-41f5-b8db-d5f9472fecbf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117180618?view=catalogue)
2025-12-02 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508313?view=catalogue)
2025-12-02 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/aa92b099-6ac7-4160-a177-7db62da20a61_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117357513?view=catalogue)
2025-12-02 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d014bdba-9fd6-4ebb-9d99-a9b69eca694f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509119?view=catalogue)
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252Fe8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/e8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252F428d149c-5436-4dde-92f7-1dc373a5542c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/428d149c-5436-4dde-92f7-1dc373a5542c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117508301?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0749810>
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252F727d2cd5-a675-43e9-972f-73c85ca2acf2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/727d2cd5-a675-43e9-972f-73c85ca2acf2_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d59de41-1bac-57aa-a199-c7265717669d
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02ff390>
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252Fbddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/bddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc40b220-30ca-5b5b-b901-16ef42be703b
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf3362e10>
2025-12-02 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc40b220-30ca-5b5b-b901-16ef42be703b
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0482f90>
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252F0c88fc6a-f52d-4f92-8ef0-804a657dc50a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/0c88fc6a-f52d-4f92-8ef0-804a657dc50a_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79bfe727-cd81-5a06-9447-4b4709589f47
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02fe410>
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F4f102e8b-5a03-4f37-aadc-cd7fe8baabf8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/4f102e8b-5a03-4f37-aadc-cd7fe8baabf8_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b85115f0-b8f6-5465-87ac-c739e7b81ee4
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0430e50>
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252Fab5ec6b3-7013-42f7-8321-2be212575929_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/ab5ec6b3-7013-42f7-8321-2be212575929_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b85115f0-b8f6-5465-87ac-c739e7b81ee4
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117372665, 'registration': 'ML21AKZ', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES TOURING', 'derivative': '330e M Sport 5dr Step Auto [Tech/Pro Pack]', 'mileage': 84143, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-04-21', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-04-20', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e52d4c4a-b195-49e2-a656-f72d7c5aecac_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/483a54e6-6449-4932-85fd-7bc62c9a748e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/85830920-c4bc-4614-b18c-242fc437fc23_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/9193df10-ccec-44b8-a031-ed5e9dbf3b23_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/231166ad-93cc-47ee-a9a2-624d3beb7cae_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/48807c88-3330-4c93-877a-8e18fb20252d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/23696852-78d5-4057-b37f-cf9e6f1cc282_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/3fdcb158-482b-45ca-8f31-7c3126687320_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/d1c24b8e-9418-433a-b818-d5390e2640ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/bb97c163-900c-4bf6-b5dc-bf4c8c77b209_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e98b47d5-21a0-4a09-bf93-3a112718d416_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 08/22 - 23K, 09/23 - 46K, 03/24 - 56K, 12/24 - 70K', 'remarks': '**829**VOSA STATES 56K, 76K SPARE KEY  Black Sapphire', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 35, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cd03af5-9d07-48f8-a8ad-5ce32e49f087.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117372665, 'registration': 'ML21AKZ', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES TOURING', 'derivative': '330e M Sport 5dr Step Auto [Tech/Pro Pack]', 'mileage': 84143, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-04-21', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-04-20', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e52d4c4a-b195-49e2-a656-f72d7c5aecac_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/483a54e6-6449-4932-85fd-7bc62c9a748e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/85830920-c4bc-4614-b18c-242fc437fc23_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/9193df10-ccec-44b8-a031-ed5e9dbf3b23_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/231166ad-93cc-47ee-a9a2-624d3beb7cae_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/48807c88-3330-4c93-877a-8e18fb20252d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/23696852-78d5-4057-b37f-cf9e6f1cc282_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/3fdcb158-482b-45ca-8f31-7c3126687320_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/d1c24b8e-9418-433a-b818-d5390e2640ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/bb97c163-900c-4bf6-b5dc-bf4c8c77b209_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e98b47d5-21a0-4a09-bf93-3a112718d416_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 08/22 - 23K, 09/23 - 46K, 03/24 - 56K, 12/24 - 70K', 'remarks': '**829**VOSA STATES 56K, 76K SPARE KEY  Black Sapphire', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 35, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cd03af5-9d07-48f8-a8ad-5ce32e49f087.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0 with identifier: 117372665
2025-12-02 19:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0 with scrape type 1
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252Fe52d4c4a-b195-49e2-a656-f72d7c5aecac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e52d4c4a-b195-49e2-a656-f72d7c5aecac_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Found listing with ID: 117374089
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374089%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Scrape type for 117374089: 0
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Found listing with ID: 117222053
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117222053%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Scrape type for 117222053: 0
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Found listing with ID: 117311401
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311401%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Scrape type for 117311401: 2
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Fe9b3f1e1-65ca-41f5-81ed-53e5efc3ccae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/e9b3f1e1-65ca-41f5-81ed-53e5efc3ccae_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F45997e16-9fc0-4f07-bb79-dfef7a73a1d0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/45997e16-9fc0-4f07-bb79-dfef7a73a1d0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fd489d5aa-aa5f-4a2b-8ac9-7aec30582f1a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d489d5aa-aa5f-4a2b-8ac9-7aec30582f1a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F483a54e6-6449-4932-85fd-7bc62c9a748e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/483a54e6-6449-4932-85fd-7bc62c9a748e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117549728, 'registration': 'YG20TMU', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e M Sport 4dr Auto', 'mileage': 101111, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-02-04', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YG20TMU/2025-12-01/image/acfd294e-e777-4e17-b83b-14b86b0e4dfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/78ed11f1-b544-4a6b-a7d2-1e522dc189a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/0d965dc9-937b-4923-a319-5b9a29a7c527_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/749aa07f-eb30-42db-ba0c-b9e6e93d18ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/02c233a7-57dd-446e-b63e-a7f8542979e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/2be67f55-8152-4555-8437-545c41f4a418_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/6d7cae0e-2541-4122-a067-12e3f16b8b8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/265d9b34-6dd0-4a6a-900d-a333529a09bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/8b656dc8-3a27-49f6-839a-106a97530aab_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/669870e6-6a05-439e-9791-2cf710919fd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/43a0c356-362f-48a7-9bbf-e210c91bc131_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 07/23 - 53K, 09/24 - 81K', 'remarks': '**753** VOSA STATES 42K, 68K, 89K CHARGING CABLE SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': 'TF', 'co2': 38, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/927e1845-2122-4cfc-b792-369f16882d94.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117549728, 'registration': 'YG20TMU', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e M Sport 4dr Auto', 'mileage': 101111, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-02-04', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YG20TMU/2025-12-01/image/acfd294e-e777-4e17-b83b-14b86b0e4dfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/78ed11f1-b544-4a6b-a7d2-1e522dc189a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/0d965dc9-937b-4923-a319-5b9a29a7c527_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/749aa07f-eb30-42db-ba0c-b9e6e93d18ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/02c233a7-57dd-446e-b63e-a7f8542979e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/2be67f55-8152-4555-8437-545c41f4a418_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/6d7cae0e-2541-4122-a067-12e3f16b8b8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/265d9b34-6dd0-4a6a-900d-a333529a09bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/8b656dc8-3a27-49f6-839a-106a97530aab_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/669870e6-6a05-439e-9791-2cf710919fd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/43a0c356-362f-48a7-9bbf-e210c91bc131_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 07/23 - 53K, 09/24 - 81K', 'remarks': '**753** VOSA STATES 42K, 68K, 89K CHARGING CABLE SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': 'TF', 'co2': 38, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/927e1845-2122-4cfc-b792-369f16882d94.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae5c8ee3-b15a-5859-9a28-809f83112292 with identifier: 117549728
2025-12-02 19:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae5c8ee3-b15a-5859-9a28-809f83112292 with scrape type 1
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252Facfd294e-e777-4e17-b83b-14b86b0e4dfb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/acfd294e-e777-4e17-b83b-14b86b0e4dfb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Found listing with ID: 117539707
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539707%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Scrape type for 117539707: 0
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Found listing with ID: 117180212
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180212%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Scrape type for 117180212: 0
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Found listing with ID: 116318543
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116318543%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [astonbarclay.gb] INFO: Scrape type for 116318543: 2
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252F4023ae9c-64f3-4ad8-abbc-4e850dd3d6b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/4023ae9c-64f3-4ad8-abbc-4e850dd3d6b5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F53c43ca1-0bd7-449c-9d50-ad3a4e12b3b6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/53c43ca1-0bd7-449c-9d50-ad3a4e12b3b6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf071ab90>
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc40b220-30ca-5b5b-b901-16ef42be703b
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0597e10>
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fecc4f524-f6c8-4375-8930-d7278a80031a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/ecc4f524-f6c8-4375-8930-d7278a80031a_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d59de41-1bac-57aa-a199-c7265717669d
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0378fd0>
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252F9e30bbeb-f697-4cdd-9291-70d1b7c95dbd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/9e30bbeb-f697-4cdd-9291-70d1b7c95dbd_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79bfe727-cd81-5a06-9447-4b4709589f47
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf065e650>
2025-12-02 19:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVU71HXK%252F2025-11-28%252Fimage%252F11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VU71HXK/2025-11-28/image/11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c59f23d-7191-522b-a0c6-0f57f2226b11
2025-12-02 19:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c59f23d-7191-522b-a0c6-0f57f2226b11, skipping ID generation
2025-12-02 19:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c59f23d-7191-522b-a0c6-0f57f2226b11 with scrape type 1
2025-12-02 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7c59f23d-7191-522b-a0c6-0f57f2226b11 from tracking dictionaries
2025-12-02 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c59f23d-7191-522b-a0c6-0f57f2226b11 sending to next pipeline
2025-12-02 19:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7c59f23d-7191-522b-a0c6-0f57f2226b11, identifier: 117574337
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0879cd0>
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA72EOP%252F2025-11-28%252Fimage%252F244626a7-d00c-41f5-b8db-d5f9472fecbf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA72EOP/2025-11-28/image/244626a7-d00c-41f5-b8db-d5f9472fecbf_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b85115f0-b8f6-5465-87ac-c739e7b81ee4
2025-12-02 19:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b85115f0-b8f6-5465-87ac-c739e7b81ee4, skipping ID generation
2025-12-02 19:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b85115f0-b8f6-5465-87ac-c739e7b81ee4 with scrape type 1
2025-12-02 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b85115f0-b8f6-5465-87ac-c739e7b81ee4 from tracking dictionaries
2025-12-02 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b85115f0-b8f6-5465-87ac-c739e7b81ee4 sending to next pipeline
2025-12-02 19:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b85115f0-b8f6-5465-87ac-c739e7b81ee4, identifier: 117180618
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0433690>
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc40b220-30ca-5b5b-b901-16ef42be703b
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf059dd90>
2025-12-02 19:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252Faa92b099-6ac7-4160-a177-7db62da20a61_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/aa92b099-6ac7-4160-a177-7db62da20a61_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79bfe727-cd81-5a06-9447-4b4709589f47
2025-12-02 19:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf065e310>
2025-12-02 19:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fd014bdba-9fd6-4ebb-9d99-a9b69eca694f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d014bdba-9fd6-4ebb-9d99-a9b69eca694f_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d59de41-1bac-57aa-a199-c7265717669d
2025-12-02 19:04:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117508301, 'registration': 'DY71UNL', 'account': 'ZEN002', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 PHEV ST-Line X Edition 5dr CVT', 'mileage': 55645, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DY71UNL/2025-11-28/image/488bfaf0-8fc1-47ed-b585-f0b182b2df9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/201ea98e-db24-45de-b34b-143137bb992e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/4c40585e-af97-4827-8fb5-ad649d3d6022_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/65fe797d-571c-401d-8a22-e78b5ddad78f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/10b797fa-8f94-48af-ade0-a4634b33e4be_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/458bed60-eaaa-4a29-8868-66e3ab456acb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/b66f6932-1dda-4ed4-8f71-08fdd27df132_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/c17695d0-fba7-4590-b137-4c0e5d6cef34_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/8c2d1c70-ab10-474f-9c5d-c036b4ab2b33_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**646**VOSA STATES 40K, 55K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6670ee1d-1a95-4de5-a7fe-f8c275e63aed.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117508301, 'registration': 'DY71UNL', 'account': 'ZEN002', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 PHEV ST-Line X Edition 5dr CVT', 'mileage': 55645, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DY71UNL/2025-11-28/image/488bfaf0-8fc1-47ed-b585-f0b182b2df9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/201ea98e-db24-45de-b34b-143137bb992e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/4c40585e-af97-4827-8fb5-ad649d3d6022_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/65fe797d-571c-401d-8a22-e78b5ddad78f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/10b797fa-8f94-48af-ade0-a4634b33e4be_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/458bed60-eaaa-4a29-8868-66e3ab456acb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/b66f6932-1dda-4ed4-8f71-08fdd27df132_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/c17695d0-fba7-4590-b137-4c0e5d6cef34_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/8c2d1c70-ab10-474f-9c5d-c036b4ab2b33_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**646**VOSA STATES 40K, 55K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6670ee1d-1a95-4de5-a7fe-f8c275e63aed.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ebc548a-8426-52af-a925-2e350152f83b with identifier: 117508301
2025-12-02 19:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ebc548a-8426-52af-a925-2e350152f83b with scrape type 1
2025-12-02 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 1ebc548a-8426-52af-a925-2e350152f83b
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F488bfaf0-8fc1-47ed-b585-f0b182b2df9f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/488bfaf0-8fc1-47ed-b585-f0b182b2df9f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/74f410c8-67bf-40ec-bd1c-d91c6975bba8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446881?view=catalogue)
2025-12-02 19:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72NYL/2025-12-02/image/7f2ad809-16aa-4677-8fd3-e0e1a668ba71_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117100813?view=catalogue)
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fd962289a-3935-4e94-83fd-5caebadf04f6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d962289a-3935-4e94-83fd-5caebadf04f6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F85830920-c4bc-4614-b18c-242fc437fc23_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/85830920-c4bc-4614-b18c-242fc437fc23_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F78ed11f1-b544-4a6b-a7d2-1e522dc189a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/78ed11f1-b544-4a6b-a7d2-1e522dc189a4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7c59f23d-7191-522b-a0c6-0f57f2226b11 with identifier: 117574337
2025-12-02 19:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7c59f23d-7191-522b-a0c6-0f57f2226b11 with identifier: 117574337
2025-12-02 19:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate special edition 150kw 1st edition pro performance 77kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate special edition', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 43097, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117574337', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 1st edition pro performance 77kwh 5dr auto', 'license_plate': 'vu71hxk', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '7c59f23d-7191-522b-a0c6-0f57f2226b11', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28618}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29349}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/eba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28170}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/b8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29359}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47531}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51696}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/d825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45618}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56746}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'volkswagen id.4 estate special edition', 'sanitized_make': 'volkswagen', 'odometer_in_km': 69357} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '7c59f23d-7191-522b-a0c6-0f57f2226b11',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'vu71hxk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117574337',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate special edition',
     'model': 'id.4 estate special edition',
     'odometer': 43097,
     'odometer_in_km': 69357,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28618,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29349,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28170,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/eba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29359,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/b8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47531,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51696,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45618,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/d825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56746,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-23',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen id.4 estate special edition 150kw 1st edition '
              'pro performance 77kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 1st edition pro performance 77kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 7c59f23d-7191-522b-a0c6-0f57f2226b11 spider: astonbarclay.gb
2025-12-02 19:04:33 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7c59f23d-7191-522b-a0c6-0f57f2226b11 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate special edition 150kw 1st edition pro performance 77kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate special edition', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 43097, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117574337', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 1st edition pro performance 77kwh 5dr auto', 'license_plate': 'vu71hxk', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '7c59f23d-7191-522b-a0c6-0f57f2226b11', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28618}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29349}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/eba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28170}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/b8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29359}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47531}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51696}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/d825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45618}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56746}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'volkswagen id.4 estate special edition', 'sanitized_make': 'volkswagen', 'odometer_in_km': 69357} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '7c59f23d-7191-522b-a0c6-0f57f2226b11',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'vu71hxk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117574337',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate special edition',
     'model': 'id.4 estate special edition',
     'odometer': 43097,
     'odometer_in_km': 69357,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28618,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29349,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28170,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/eba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29359,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/b8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47531,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51696,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45618,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/d825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56746,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-23',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen id.4 estate special edition 150kw 1st edition '
              'pro performance 77kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 1st edition pro performance 77kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '7c59f23d-7191-522b-a0c6-0f57f2226b11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VU71HXK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117574337',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'ID.4 ESTATE SPECIAL EDITION',
 'odometer': 43097,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28618,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4cce9fc2-19e9-4c82-b9dd-81996b221ea2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29349,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/4e8d5b09-9486-4120-a138-2d67e3a6f669_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28170,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/eba7fd6f-cfe1-46fe-aa3b-23f7842ef474_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29359,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/b8be950a-044c-4e24-bb29-72505e4f69cf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47531,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/0c0be3b0-3459-4694-8b6a-57a94fd66cb6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51696,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/77a0d370-3075-4f82-8da1-78e8c363d3ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45618,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/d825f809-a58d-4d64-ba5e-02cf3cae8830_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c59f23d-7191-522b-a0c6-0f57f2226b11/7c59f23d-7191-522b-a0c6-0f57f2226b11_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56746,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VU71HXK/2025-11-28/image/11ca786d-0f07-4a2a-a5bb-b5aab580c53e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN ID.4 ESTATE SPECIAL EDITION 150kW 1ST Edition Pro '
          'Performance 77kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW 1ST Edition Pro Performance 77kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117574337%27 HTTP/1.1" 200 None
2025-12-02 19:04:33 [astonbarclay.gb] INFO: Saving data for 117574337: {'created_time': 1764702273.809985, 'last_price_update_time': 1764702273.809995, 'auction_closing_time': 1764842400.0}
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117574337') HTTP/1.1" 204 0
2025-12-02 19:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b85115f0-b8f6-5465-87ac-c739e7b81ee4 with identifier: 117180618
2025-12-02 19:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b85115f0-b8f6-5465-87ac-c739e7b81ee4 with identifier: 117180618
2025-12-02 19:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b85115f0-b8f6-5465-87ac-c739e7b81ee4 with identifier: 117180618 to the API
2025-12-02 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YA72EOP/2025-11-28/image/244626a7-d00c-41f5-b8db-d5f9472fecbf_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'b85115f0-b8f6-5465-87ac-c739e7b81ee4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YA72EOP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117180618',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ESTATE',
 'odometer': 23211,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27290,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/11c508f6-ae76-439c-aa46-ef4021156bdb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27071,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/7ce04a58-e8e8-4770-ac85-8d0b1daf2786_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25404,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/f7178be2-cdc7-4043-9000-ecdc2f616825_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25074,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/be422197-17a4-44f0-a07b-3eccc55e8fc3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35261,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/6c1d66d9-d83c-4253-94eb-7ebadbfe3d1c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48822,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/66eea275-7c11-4925-a5c4-d20e23e67b9c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40546,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/244626a7-d00c-41f5-b8db-d5f9472fecbf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33984,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/ab5ec6b3-7013-42f7-8321-2be212575929_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85115f0-b8f6-5465-87ac-c739e7b81ee4/b85115f0-b8f6-5465-87ac-c739e7b81ee4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45269,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YA72EOP/2025-11-28/image/4f102e8b-5a03-4f37-aadc-cd7fe8baabf8_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-07',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN TIGUAN ESTATE 1.5 TSI 150 R-Line 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI 150 R-Line 5dr DSG',
 'vin': None,
 'year': 2023}
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180618%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [astonbarclay.gb] INFO: Saving data for 117180618: {'created_time': 1764702274.189086, 'last_price_update_time': 1764702274.189098, 'auction_closing_time': 1764927900.0}
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117180618') HTTP/1.1" 204 0
2025-12-02 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71XVH/2025-11-28/image/a4e54916-5ce3-4342-8872-55cf113eab79_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509119?view=catalogue)
2025-12-02 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/959a0637-9071-4570-b04a-300579ffe879_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117357513?view=catalogue)
2025-12-02 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508313?view=catalogue)
2025-12-02 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71XVH/2025-11-28/image/b1737738-433b-479d-af4f-0b1d75bdc385_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509119?view=catalogue)
2025-12-02 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/09b7ab18-4e83-40ed-9c0e-df8e75ae3253_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117357513?view=catalogue)
2025-12-02 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508313?view=catalogue)
2025-12-02 19:04:34 [astonbarclay.gb] INFO: Found listing with ID: 117555641
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555641%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [astonbarclay.gb] INFO: Scrape type for 117555641: 0
2025-12-02 19:04:34 [astonbarclay.gb] INFO: Found listing with ID: 116997115
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997115%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [astonbarclay.gb] INFO: Scrape type for 116997115: 1
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Fc2de56dc-7d0d-4d26-b8f7-643e8b1f3856_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/c2de56dc-7d0d-4d26-b8f7-643e8b1f3856_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252Fd14bfdba-1b74-41fc-bfc4-9228eebee364_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/d14bfdba-1b74-41fc-bfc4-9228eebee364_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F201ea98e-db24-45de-b34b-143137bb992e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/201ea98e-db24-45de-b34b-143137bb992e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F9193df10-ccec-44b8-a031-ed5e9dbf3b23_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/9193df10-ccec-44b8-a031-ed5e9dbf3b23_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F0d965dc9-937b-4923-a319-5b9a29a7c527_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/0d965dc9-937b-4923-a319-5b9a29a7c527_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116983938?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117363536?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116637669?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:34 [astonbarclay.gb] INFO: Found listing with ID: 117209835
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209835%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [astonbarclay.gb] INFO: Scrape type for 117209835: 2
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252F6a89d969-8f4f-4a4e-9abc-d8f8eadbdb71_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/6a89d969-8f4f-4a4e-9abc-d8f8eadbdb71_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F0c055c06-b7a4-4036-8d52-3d6b5014e334_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/0c055c06-b7a4-4036-8d52-3d6b5014e334_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F4c40585e-af97-4827-8fb5-ad649d3d6022_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/4c40585e-af97-4827-8fb5-ad649d3d6022_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F231166ad-93cc-47ee-a9a2-624d3beb7cae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/231166ad-93cc-47ee-a9a2-624d3beb7cae_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F749aa07f-eb30-42db-ba0c-b9e6e93d18ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/749aa07f-eb30-42db-ba0c-b9e6e93d18ad_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ebbbd0>
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252F74f410c8-67bf-40ec-bd1c-d91c6975bba8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/74f410c8-67bf-40ec-bd1c-d91c6975bba8_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71483516-b9d5-594e-82f5-ffef2099fd34
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0681550>
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F7f2ad809-16aa-4677-8fd3-e0e1a668ba71_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/7f2ad809-16aa-4677-8fd3-e0e1a668ba71_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf034e9d0>
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fa4e54916-5ce3-4342-8872-55cf113eab79_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/a4e54916-5ce3-4342-8872-55cf113eab79_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d59de41-1bac-57aa-a199-c7265717669d
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1cc93d0>
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252F959a0637-9071-4570-b04a-300579ffe879_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/959a0637-9071-4570-b04a-300579ffe879_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79bfe727-cd81-5a06-9447-4b4709589f47
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0822ed0>
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc40b220-30ca-5b5b-b901-16ef42be703b
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aafe10>
2025-12-02 19:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fb1737738-433b-479d-af4f-0b1d75bdc385_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/b1737738-433b-479d-af4f-0b1d75bdc385_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d59de41-1bac-57aa-a199-c7265717669d
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0822fd0>
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71ZLX%252F2025-11-27%252Fimage%252F09b7ab18-4e83-40ed-9c0e-df8e75ae3253_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/09b7ab18-4e83-40ed-9c0e-df8e75ae3253_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79bfe727-cd81-5a06-9447-4b4709589f47
2025-12-02 19:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79bfe727-cd81-5a06-9447-4b4709589f47, skipping ID generation
2025-12-02 19:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79bfe727-cd81-5a06-9447-4b4709589f47 with scrape type 1
2025-12-02 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 79bfe727-cd81-5a06-9447-4b4709589f47 from tracking dictionaries
2025-12-02 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79bfe727-cd81-5a06-9447-4b4709589f47 sending to next pipeline
2025-12-02 19:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 79bfe727-cd81-5a06-9447-4b4709589f47, identifier: 117357513
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf059e910>
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252F5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc40b220-30ca-5b5b-b901-16ef42be703b
2025-12-02 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TMU/2025-12-01/image/acfd294e-e777-4e17-b83b-14b86b0e4dfb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue)
2025-12-02 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY71UNL/2025-11-28/image/488bfaf0-8fc1-47ed-b585-f0b182b2df9f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508301?view=catalogue)
2025-12-02 19:04:36 [astonbarclay.gb] INFO: Found listing with ID: 117120537
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120537%27 HTTP/1.1" 200 None
2025-12-02 19:04:36 [astonbarclay.gb] INFO: Scrape type for 117120537: 0
2025-12-02 19:04:36 [astonbarclay.gb] INFO: Found listing with ID: 117565754
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117565754%27 HTTP/1.1" 200 None
2025-12-02 19:04:36 [astonbarclay.gb] INFO: Scrape type for 117565754: 1
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Fa74c7deb-8d40-4843-bbc9-dcb2cb372f94_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/a74c7deb-8d40-4843-bbc9-dcb2cb372f94_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F9d80adad-17fe-41ff-bfe7-67502f0b5a5f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/9d80adad-17fe-41ff-bfe7-67502f0b5a5f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F65fe797d-571c-401d-8a22-e78b5ddad78f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/65fe797d-571c-401d-8a22-e78b5ddad78f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 79bfe727-cd81-5a06-9447-4b4709589f47 with identifier: 117357513
2025-12-02 19:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 79bfe727-cd81-5a06-9447-4b4709589f47 with identifier: 117357513
2025-12-02 19:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 79bfe727-cd81-5a06-9447-4b4709589f47 with identifier: 117357513 to the API
2025-12-02 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/09b7ab18-4e83-40ed-9c0e-df8e75ae3253_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '79bfe727-cd81-5a06-9447-4b4709589f47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DU71ZLX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117357513',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 22116,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31955,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/d9767184-d6b2-4788-9050-c3ef37623fd3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31579,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/ee529dcf-275d-4edf-9f45-5fcca842b620_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30834,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/af8dc17b-d64b-46f2-8782-263da7e4b1c5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31179,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/0c88fc6a-f52d-4f92-8ef0-804a657dc50a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47698,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/9e30bbeb-f697-4cdd-9291-70d1b7c95dbd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52636,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/aa92b099-6ac7-4160-a177-7db62da20a61_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44545,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/09b7ab18-4e83-40ed-9c0e-df8e75ae3253_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bfe727-cd81-5a06-9447-4b4709589f47/79bfe727-cd81-5a06-9447-4b4709589f47_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60997,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71ZLX/2025-11-27/image/959a0637-9071-4570-b04a-300579ffe879_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seller_name': 'Zenith',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi SE Connect 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 TGDi SE Connect 5dr 2WD',
 'vin': None,
 'year': 2021}
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117357513%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Saving data for 117357513: {'created_time': 1764702277.15192, 'last_price_update_time': 1764702277.15193, 'auction_closing_time': 1764842400.0}
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117357513') HTTP/1.1" 204 0
2025-12-02 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72NYL/2025-12-02/image/53c43ca1-0bd7-449c-9d50-ad3a4e12b3b6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117100813?view=catalogue)
2025-12-02 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/4023ae9c-64f3-4ad8-abbc-4e850dd3d6b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446881?view=catalogue)
2025-12-02 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/483a54e6-6449-4932-85fd-7bc62c9a748e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue)
2025-12-02 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72NYL/2025-12-02/image/45997e16-9fc0-4f07-bb79-dfef7a73a1d0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117100813?view=catalogue)
2025-12-02 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d489d5aa-aa5f-4a2b-8ac9-7aec30582f1a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509119?view=catalogue)
2025-12-02 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72NYL/2025-12-02/image/18bee46c-db9d-433e-83ed-13d54addfa22_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117100813?view=catalogue)
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F48807c88-3330-4c93-877a-8e18fb20252d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/48807c88-3330-4c93-877a-8e18fb20252d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F02c233a7-57dd-446e-b63e-a7f8542979e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/02c233a7-57dd-446e-b63e-a7f8542979e6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Found listing with ID: 117103708
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103708%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Scrape type for 117103708: 0
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Found listing with ID: 117274004
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274004%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Scrape type for 117274004: 0
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Found listing with ID: 117555034
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555034%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Scrape type for 117555034: 0
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Found listing with ID: 117274456
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274456%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Scrape type for 117274456: 2
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Fca40e6e4-06d4-4fbc-a4b9-99927d85b032_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/ca40e6e4-06d4-4fbc-a4b9-99927d85b032_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F707d7481-d731-4fb1-a624-ae7493bd9b39_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/707d7481-d731-4fb1-a624-ae7493bd9b39_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F10b797fa-8f94-48af-ade0-a4634b33e4be_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/10b797fa-8f94-48af-ade0-a4634b33e4be_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117103769?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117544110?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116983938, 'registration': 'PJ73TWG', 'account': 'VAN061', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Tekna 5dr Auto', 'mileage': 10213, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-21', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/17b92e0f-ac1a-476f-b1e2-2f6ff55341c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/d0f34a86-8fb9-4696-8591-4775e75edf3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/e30de72d-bc25-4760-8a54-cd59311ea467_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/afb02428-ef52-4054-a72d-85b80318b8a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/65994e9a-4f46-4ab4-9d9b-2465ceef9671_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/0879a662-86e5-4baf-b4eb-c308b73d56f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/a1fb1be7-32dc-4eb6-a0fb-a1c7d0e57f5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/1fc0d3b5-706c-4b52-8c9b-72e6eba81d28_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/6a8956ad-d21c-4727-80af-ec8ef1fe7ce3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/24 - 4K, 09/25 - 9K', 'remarks': '**1298**', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cfab9572-9b77-4f97-bad0-7170f67fb01c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116983938, 'registration': 'PJ73TWG', 'account': 'VAN061', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Tekna 5dr Auto', 'mileage': 10213, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-21', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/17b92e0f-ac1a-476f-b1e2-2f6ff55341c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/d0f34a86-8fb9-4696-8591-4775e75edf3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/e30de72d-bc25-4760-8a54-cd59311ea467_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/afb02428-ef52-4054-a72d-85b80318b8a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/65994e9a-4f46-4ab4-9d9b-2465ceef9671_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/0879a662-86e5-4baf-b4eb-c308b73d56f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/a1fb1be7-32dc-4eb6-a0fb-a1c7d0e57f5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/1fc0d3b5-706c-4b52-8c9b-72e6eba81d28_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/6a8956ad-d21c-4727-80af-ec8ef1fe7ce3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/24 - 4K, 09/25 - 9K', 'remarks': '**1298**', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cfab9572-9b77-4f97-bad0-7170f67fb01c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55728a6-465d-5b65-b9bc-367c9025520f with identifier: 116983938
2025-12-02 19:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55728a6-465d-5b65-b9bc-367c9025520f with scrape type 2
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e55728a6-465d-5b65-b9bc-367c9025520f with scrape type 2
2025-12-02 19:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e55728a6-465d-5b65-b9bc-367c9025520f, identifier: 116983938
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117363536, 'registration': 'AP21LWL', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '118d SE 5dr Step Auto', 'mileage': 76144, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-06', 'fuel': 'Diesel', 'motExpiry': '2026-06-01', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AP21LWL/2025-11-25/image/22649453-b483-4062-8d33-d70c1066e2ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/0b69a6c0-770c-4226-b93a-4a7d6ca26665_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/c9f3cd15-2859-41da-9b0d-a786288bdb70_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/1afcbc00-7988-4e8e-ae13-694944b3fc67_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/aa2e3798-b49b-4675-9550-a14b4a6bfc79_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/7c3e77dc-dbfa-4e63-b554-afbe50f15290_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/c7428035-6fe6-4be2-a107-f238717c89a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/4fa2fc9d-ae2f-4ae3-ad29-197f3aa75ea7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 07/22-15K, 07/23-32K, 07/24-50K, 01/25-61K, 06/25-67K, 09/25-72K,', 'remarks': 'VOSA STATES 50K, 67K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e18f774a-bb73-4013-8088-9fc4b09354d2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117363536, 'registration': 'AP21LWL', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '118d SE 5dr Step Auto', 'mileage': 76144, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-06', 'fuel': 'Diesel', 'motExpiry': '2026-06-01', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AP21LWL/2025-11-25/image/22649453-b483-4062-8d33-d70c1066e2ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/0b69a6c0-770c-4226-b93a-4a7d6ca26665_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/c9f3cd15-2859-41da-9b0d-a786288bdb70_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/1afcbc00-7988-4e8e-ae13-694944b3fc67_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/aa2e3798-b49b-4675-9550-a14b4a6bfc79_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/7c3e77dc-dbfa-4e63-b554-afbe50f15290_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/c7428035-6fe6-4be2-a107-f238717c89a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP21LWL/2025-11-25/image/4fa2fc9d-ae2f-4ae3-ad29-197f3aa75ea7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 07/22-15K, 07/23-32K, 07/24-50K, 01/25-61K, 06/25-67K, 09/25-72K,', 'remarks': 'VOSA STATES 50K, 67K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e18f774a-bb73-4013-8088-9fc4b09354d2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbfe3aa4-67d1-52cb-9880-b698cfc21508 with identifier: 117363536
2025-12-02 19:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbfe3aa4-67d1-52cb-9880-b698cfc21508 with scrape type 2
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbfe3aa4-67d1-52cb-9880-b698cfc21508 with scrape type 2
2025-12-02 19:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cbfe3aa4-67d1-52cb-9880-b698cfc21508, identifier: 117363536
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117103670, 'registration': 'YD73NZH', 'account': 'ZEN009', 'make': 'VOLKSWAGEN', 'model': 'TAIGO HATCHBACK', 'derivative': '1.0 TSI 110 R-Line 5dr', 'mileage': 15980, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YD73NZH/2025-12-01/image/6466a23d-33e7-491e-8cdd-bdaf99491800_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/8a6a06ad-21ed-46eb-bc1e-16ad9aa30c3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/4652ff00-3b7e-43b6-8d3d-f6f5337b8788_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/078c62a4-5182-45a3-b149-a3af85ccbcb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/b06919d1-8cce-4ce2-a231-39258fd8fa8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/2e0fd6e0-5dce-4453-9eb5-7c5922324e30_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/7fa464fb-df5b-4ba5-91b2-447ee005dd71_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/f4a1bb6f-b1eb-435f-abbd-d8f1ca79c567_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/ef0f789a-1b6a-4ffe-9718-e095a5f6433e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/029d3e6d-6293-4236-b63c-6ead6efeec90_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/1a83dd39-d4e1-438b-9a86-17e070f09183_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 04/25- 10K, 08/25- 14K,', 'remarks': '**893** SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/59dc1ba9-99aa-4176-92d8-08013889effd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117103670, 'registration': 'YD73NZH', 'account': 'ZEN009', 'make': 'VOLKSWAGEN', 'model': 'TAIGO HATCHBACK', 'derivative': '1.0 TSI 110 R-Line 5dr', 'mileage': 15980, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YD73NZH/2025-12-01/image/6466a23d-33e7-491e-8cdd-bdaf99491800_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/8a6a06ad-21ed-46eb-bc1e-16ad9aa30c3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/4652ff00-3b7e-43b6-8d3d-f6f5337b8788_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/078c62a4-5182-45a3-b149-a3af85ccbcb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/b06919d1-8cce-4ce2-a231-39258fd8fa8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/2e0fd6e0-5dce-4453-9eb5-7c5922324e30_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/7fa464fb-df5b-4ba5-91b2-447ee005dd71_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/f4a1bb6f-b1eb-435f-abbd-d8f1ca79c567_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/ef0f789a-1b6a-4ffe-9718-e095a5f6433e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/029d3e6d-6293-4236-b63c-6ead6efeec90_removebg.jpg?w=600', 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/1a83dd39-d4e1-438b-9a86-17e070f09183_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 04/25- 10K, 08/25- 14K,', 'remarks': '**893** SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/59dc1ba9-99aa-4176-92d8-08013889effd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f38991d5-0e23-5762-a62e-4cca8ac5d874 with identifier: 117103670
2025-12-02 19:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38991d5-0e23-5762-a62e-4cca8ac5d874 with scrape type 1
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F6466a23d-33e7-491e-8cdd-bdaf99491800_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/6466a23d-33e7-491e-8cdd-bdaf99491800_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116637669, 'registration': 'ML72VFN', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto [C+S]', 'mileage': 55842, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-10', 'fuel': 'Electric', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ML72VFN/2025-11-28/image/129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/dc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/d1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/23- 21K, 01/25- 41K', 'remarks': '**967**VOSA STATES 54K  SPARE KEY   Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/52628026-cafe-4384-8bb8-d1352e8a242e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116637669, 'registration': 'ML72VFN', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto [C+S]', 'mileage': 55842, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-10', 'fuel': 'Electric', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ML72VFN/2025-11-28/image/129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/dc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/d1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/23- 21K, 01/25- 41K', 'remarks': '**967**VOSA STATES 54K  SPARE KEY   Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/52628026-cafe-4384-8bb8-d1352e8a242e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea1aae49-cae9-58ac-87f7-666248b36155 with identifier: 116637669
2025-12-02 19:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea1aae49-cae9-58ac-87f7-666248b36155 with scrape type 1
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item ea1aae49-cae9-58ac-87f7-666248b36155
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117446714, 'registration': 'YS70NVP', 'account': 'ZEN002', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Sport ALL4 PHEV 5dr Auto [Comfort]', 'mileage': 36038, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-11-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-11-27', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3ea2e8d7-781c-45e7-b36c-ecbb192cb55b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/487a9a73-2ef3-4f92-975e-592107154aef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e3eed9ea-2c32-4716-9e09-8b7380beedff_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e941e187-f286-4a87-8235-d3a2660fb856_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/a7861f7a-c5d8-49c2-9ca8-01cc5c15e62e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/5b37b9ae-d83b-42dd-a22d-f78f5404a342_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/351cc696-7efc-443a-a2ab-8ff534ca166d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3bd5c16a-f43a-44a7-b82d-df0f7561ab93_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/0a16a5dd-18c7-44c8-80c3-279d6068f6c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/d4a8a223-c5ed-4d22-9d02-73ef1d63523d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/c4656a57-4503-4e5d-ba94-29a21e2693cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/ac310f36-e7d2-4b04-851e-d54c9737002a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 01/23 - 14K, 11/23 - 21K', 'remarks': 'VOSA STATES 21K, 30K, 35K CHARGING CABLE  Automatic Operation Of Tailgate\tComfort Access System\tDarkened Rear Glass Heated Front Windscreen\tNavigation Plus Pack\tRear Centre Armrest', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 41, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117446714, 'registration': 'YS70NVP', 'account': 'ZEN002', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Sport ALL4 PHEV 5dr Auto [Comfort]', 'mileage': 36038, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-11-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-11-27', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3ea2e8d7-781c-45e7-b36c-ecbb192cb55b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/487a9a73-2ef3-4f92-975e-592107154aef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e3eed9ea-2c32-4716-9e09-8b7380beedff_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e941e187-f286-4a87-8235-d3a2660fb856_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/a7861f7a-c5d8-49c2-9ca8-01cc5c15e62e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/5b37b9ae-d83b-42dd-a22d-f78f5404a342_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/351cc696-7efc-443a-a2ab-8ff534ca166d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3bd5c16a-f43a-44a7-b82d-df0f7561ab93_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/0a16a5dd-18c7-44c8-80c3-279d6068f6c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/d4a8a223-c5ed-4d22-9d02-73ef1d63523d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/c4656a57-4503-4e5d-ba94-29a21e2693cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/ac310f36-e7d2-4b04-851e-d54c9737002a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 01/23 - 14K, 11/23 - 21K', 'remarks': 'VOSA STATES 21K, 30K, 35K CHARGING CABLE  Automatic Operation Of Tailgate\tComfort Access System\tDarkened Rear Glass Heated Front Windscreen\tNavigation Plus Pack\tRear Centre Armrest', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 41, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e767275-5689-5147-bbf2-4bb12fc393f9 with identifier: 117446714
2025-12-02 19:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e767275-5689-5147-bbf2-4bb12fc393f9 with scrape type 1
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F3ea2e8d7-781c-45e7-b36c-ecbb192cb55b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3ea2e8d7-781c-45e7-b36c-ecbb192cb55b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F23696852-78d5-4057-b37f-cf9e6f1cc282_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/23696852-78d5-4057-b37f-cf9e6f1cc282_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F2be67f55-8152-4555-8437-545c41f4a418_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/2be67f55-8152-4555-8437-545c41f4a418_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e55728a6-465d-5b65-b9bc-367c9025520f with identifier: 116983938
2025-12-02 19:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e55728a6-465d-5b65-b9bc-367c9025520f with identifier: 116983938
2025-12-02 19:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e55728a6-465d-5b65-b9bc-367c9025520f with identifier: 116983938 to the API
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e55728a6-465d-5b65-b9bc-367c9025520f%27 HTTP/1.1" 200 None
2025-12-02 19:04:38 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e55728a6-465d-5b65-b9bc-367c9025520f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:04:37 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116983938?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'e55728a6-465d-5b65-b9bc-367c9025520f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PJ73TWG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116983938',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 10213,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-21',
 'seller_name': 'Vantage Motor Group',
 'title': 'NISSAN QASHQAI HATCHBACK 1.5 E-Power Tekna 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 E-Power Tekna 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116983938%27 HTTP/1.1" 200 None
2025-12-02 19:04:38 [astonbarclay.gb] INFO: Saving data for 116983938: {'auction_closing_time': 1764755100.0, 'created_time': 1762455738.268894, 'last_price_update_time': 1764702278.036017}
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116983938') HTTP/1.1" 204 0
2025-12-02 19:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cbfe3aa4-67d1-52cb-9880-b698cfc21508 with identifier: 117363536
2025-12-02 19:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cbfe3aa4-67d1-52cb-9880-b698cfc21508 with identifier: 117363536
2025-12-02 19:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cbfe3aa4-67d1-52cb-9880-b698cfc21508 with identifier: 117363536 to the API
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117363536?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'cbfe3aa4-67d1-52cb-9880-b698cfc21508',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AP21LWL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117363536',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 76144,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-06',
 'seller_name': 'Zenith',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 118d SE 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '118d SE 5dr Step Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117363536%27 HTTP/1.1" 200 None
2025-12-02 19:04:38 [astonbarclay.gb] INFO: Saving data for 117363536: {'auction_closing_time': 1764842400.0, 'created_time': 1764097313.655877, 'last_price_update_time': 1764702278.329217}
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117363536') HTTP/1.1" 204 0
2025-12-02 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TMU/2025-12-01/image/0d965dc9-937b-4923-a319-5b9a29a7c527_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue)
2025-12-02 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72NYL/2025-12-02/image/0c055c06-b7a4-4036-8d52-3d6b5014e334_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117100813?view=catalogue)
2025-12-02 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72NYL/2025-12-02/image/d14bfdba-1b74-41fc-bfc4-9228eebee364_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117100813?view=catalogue)
2025-12-02 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/c2de56dc-7d0d-4d26-b8f7-643e8b1f3856_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446881?view=catalogue)
2025-12-02 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY71UNL/2025-11-28/image/4c40585e-af97-4827-8fb5-ad649d3d6022_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508301?view=catalogue)
2025-12-02 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/9193df10-ccec-44b8-a031-ed5e9dbf3b23_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue)
2025-12-02 19:04:38 [astonbarclay.gb] INFO: Found listing with ID: 116884737
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116884737%27 HTTP/1.1" 200 None
2025-12-02 19:04:38 [astonbarclay.gb] INFO: Scrape type for 116884737: 2
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Ff34cd200-8a22-41b2-89d6-1e8b6f0c5228_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/f34cd200-8a22-41b2-89d6-1e8b6f0c5228_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F2df7c900-c65c-4820-a959-3734acfcf56d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/2df7c900-c65c-4820-a959-3734acfcf56d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F458bed60-eaaa-4a29-8868-66e3ab456acb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/458bed60-eaaa-4a29-8868-66e3ab456acb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F8a6a06ad-21ed-46eb-bc1e-16ad9aa30c3b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/8a6a06ad-21ed-46eb-bc1e-16ad9aa30c3b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F487a9a73-2ef3-4f92-975e-592107154aef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/487a9a73-2ef3-4f92-975e-592107154aef_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02edad0>
2025-12-02 19:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252Facfd294e-e777-4e17-b83b-14b86b0e4dfb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/acfd294e-e777-4e17-b83b-14b86b0e4dfb_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066dc10>
2025-12-02 19:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F488bfaf0-8fc1-47ed-b585-f0b182b2df9f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/488bfaf0-8fc1-47ed-b585-f0b182b2df9f_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ebc548a-8426-52af-a925-2e350152f83b
2025-12-02 19:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY71UNL/2025-11-28/image/201ea98e-db24-45de-b34b-143137bb992e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508301?view=catalogue)
2025-12-02 19:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TMU/2025-12-01/image/749aa07f-eb30-42db-ba0c-b9e6e93d18ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue)
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F3fdcb158-482b-45ca-8f31-7c3126687320_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/3fdcb158-482b-45ca-8f31-7c3126687320_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F6d7cae0e-2541-4122-a067-12e3f16b8b8e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/6d7cae0e-2541-4122-a067-12e3f16b8b8e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:39 [astonbarclay.gb] INFO: Found listing with ID: 116832725
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116832725%27 HTTP/1.1" 200 None
2025-12-02 19:04:39 [astonbarclay.gb] INFO: Scrape type for 116832725: 2
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252Fb66f6932-1dda-4ed4-8f71-08fdd27df132_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/b66f6932-1dda-4ed4-8f71-08fdd27df132_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F4652ff00-3b7e-43b6-8d3d-f6f5337b8788_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/4652ff00-3b7e-43b6-8d3d-f6f5337b8788_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fe3eed9ea-2c32-4716-9e09-8b7380beedff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e3eed9ea-2c32-4716-9e09-8b7380beedff_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252Fd1c24b8e-9418-433a-b818-d5390e2640ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/d1c24b8e-9418-433a-b818-d5390e2640ee_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F265d9b34-6dd0-4a6a-900d-a333529a09bf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/265d9b34-6dd0-4a6a-900d-a333529a09bf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090c190>
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F53c43ca1-0bd7-449c-9d50-ad3a4e12b3b6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/53c43ca1-0bd7-449c-9d50-ad3a4e12b3b6_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b4510>
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252F4023ae9c-64f3-4ad8-abbc-4e850dd3d6b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/4023ae9c-64f3-4ad8-abbc-4e850dd3d6b5_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71483516-b9d5-594e-82f5-ffef2099fd34
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09453d0>
2025-12-02 19:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F483a54e6-6449-4932-85fd-7bc62c9a748e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/483a54e6-6449-4932-85fd-7bc62c9a748e_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0321290>
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F45997e16-9fc0-4f07-bb79-dfef7a73a1d0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/45997e16-9fc0-4f07-bb79-dfef7a73a1d0_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03b9210>
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fd489d5aa-aa5f-4a2b-8ac9-7aec30582f1a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d489d5aa-aa5f-4a2b-8ac9-7aec30582f1a_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d59de41-1bac-57aa-a199-c7265717669d
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0946f10>
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F18bee46c-db9d-433e-83ed-13d54addfa22_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/18bee46c-db9d-433e-83ed-13d54addfa22_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c
2025-12-02 19:04:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117103769, 'registration': 'YE70HBP', 'account': 'LEA009', 'make': 'TOYOTA', 'model': 'COROLLA TOURING SPORT', 'derivative': '2.0 VVT-i Hybrid Design 5dr CVT', 'mileage': 42150, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-12-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2025-12-29', 'doors': 5, 'engineSize': 1987, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE70HBP/2025-12-01/image/f7740209-e37c-4723-a393-e43f10960b12_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/407761c4-dd58-4a76-b77b-57398b4e4594_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/a80b26ac-2436-46af-b53d-d45826aa370b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/576e828c-ddcf-487d-88ed-8b637b2ee4a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/4ad99170-df7d-4157-8f20-67a40b25b95a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/40b347db-ca9a-453f-bce7-164d75610ce4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6cfc72d3-1d08-48b3-8205-73df8e8a6f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6c27f15c-d00a-4607-83e4-33f4c51854ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/253b78c4-2040-4e04-bd73-ee703829fe1d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**802**VOSA STATES 25K, 33K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0fecd5a4-8d40-4caf-a21d-60982497884a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117103769, 'registration': 'YE70HBP', 'account': 'LEA009', 'make': 'TOYOTA', 'model': 'COROLLA TOURING SPORT', 'derivative': '2.0 VVT-i Hybrid Design 5dr CVT', 'mileage': 42150, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-12-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2025-12-29', 'doors': 5, 'engineSize': 1987, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE70HBP/2025-12-01/image/f7740209-e37c-4723-a393-e43f10960b12_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/407761c4-dd58-4a76-b77b-57398b4e4594_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/a80b26ac-2436-46af-b53d-d45826aa370b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/576e828c-ddcf-487d-88ed-8b637b2ee4a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/4ad99170-df7d-4157-8f20-67a40b25b95a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/40b347db-ca9a-453f-bce7-164d75610ce4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6cfc72d3-1d08-48b3-8205-73df8e8a6f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6c27f15c-d00a-4607-83e4-33f4c51854ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/253b78c4-2040-4e04-bd73-ee703829fe1d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**802**VOSA STATES 25K, 33K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0fecd5a4-8d40-4caf-a21d-60982497884a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b71d56d-b899-5c31-8a4e-958243c973ff with identifier: 117103769
2025-12-02 19:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b71d56d-b899-5c31-8a4e-958243c973ff with scrape type 1
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 4b71d56d-b899-5c31-8a4e-958243c973ff
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252Ff7740209-e37c-4723-a393-e43f10960b12_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/f7740209-e37c-4723-a393-e43f10960b12_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117544110, 'registration': 'FV71XJE', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 250e AMG Line Premium Plus 4dr Tip Auto', 'mileage': 92591, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-02-14', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-02-13', 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/FV71XJE/2025-12-01/image/7dcb347e-dc58-4f3d-ab48-a373dbfc1145_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/6cfc4400-f3ec-4980-b2e2-9bb7e0150589_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/f0bc9e03-71eb-42ab-8110-816bdfb755f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/4223b44e-905d-415f-bbe3-3e2719f9325a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/e401d086-16d8-40e9-863b-5093ffd754a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/b2b93608-d060-4897-a72e-55ef456a8e6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/1f6993d5-c94b-4cbc-99f2-13f1f7579043_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/bb1619b3-5771-4f4c-ad48-f2c309a07ef5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/a4c514bf-30b0-4166-ad66-cc0cbf76633c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22- 16K, 03/23- 31K, 10/23- 46K', 'remarks': '**911**VOSA STATES 77K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/740a0591-ab4b-4511-a305-2b59bba43359.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117544110, 'registration': 'FV71XJE', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 250e AMG Line Premium Plus 4dr Tip Auto', 'mileage': 92591, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-02-14', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-02-13', 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/FV71XJE/2025-12-01/image/7dcb347e-dc58-4f3d-ab48-a373dbfc1145_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/6cfc4400-f3ec-4980-b2e2-9bb7e0150589_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/f0bc9e03-71eb-42ab-8110-816bdfb755f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/4223b44e-905d-415f-bbe3-3e2719f9325a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/e401d086-16d8-40e9-863b-5093ffd754a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/b2b93608-d060-4897-a72e-55ef456a8e6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/1f6993d5-c94b-4cbc-99f2-13f1f7579043_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/bb1619b3-5771-4f4c-ad48-f2c309a07ef5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/a4c514bf-30b0-4166-ad66-cc0cbf76633c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22- 16K, 03/23- 31K, 10/23- 46K', 'remarks': '**911**VOSA STATES 77K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/740a0591-ab4b-4511-a305-2b59bba43359.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 878cacd3-23a7-58d3-ba66-bbbefc642c43 with identifier: 117544110
2025-12-02 19:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 878cacd3-23a7-58d3-ba66-bbbefc642c43 with scrape type 1
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 878cacd3-23a7-58d3-ba66-bbbefc642c43
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252F7dcb347e-dc58-4f3d-ab48-a373dbfc1145_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/7dcb347e-dc58-4f3d-ab48-a373dbfc1145_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03bfcd0>
2025-12-02 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F0d965dc9-937b-4923-a319-5b9a29a7c527_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/0d965dc9-937b-4923-a319-5b9a29a7c527_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f8a990>
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F0c055c06-b7a4-4036-8d52-3d6b5014e334_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/0c055c06-b7a4-4036-8d52-3d6b5014e334_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03d69d0>
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252Fd14bfdba-1b74-41fc-bfc4-9228eebee364_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/d14bfdba-1b74-41fc-bfc4-9228eebee364_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf01de010>
2025-12-02 19:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Fc2de56dc-7d0d-4d26-b8f7-643e8b1f3856_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/c2de56dc-7d0d-4d26-b8f7-643e8b1f3856_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71483516-b9d5-594e-82f5-ffef2099fd34
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03bb210>
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F4c40585e-af97-4827-8fb5-ad649d3d6022_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/4c40585e-af97-4827-8fb5-ad649d3d6022_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ebc548a-8426-52af-a925-2e350152f83b
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090d250>
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F9193df10-ccec-44b8-a031-ed5e9dbf3b23_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/9193df10-ccec-44b8-a031-ed5e9dbf3b23_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YD73NZH/2025-12-01/image/6466a23d-33e7-491e-8cdd-bdaf99491800_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue)
2025-12-02 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3ea2e8d7-781c-45e7-b36c-ecbb192cb55b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML72VFN/2025-11-28/image/129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116637669?view=catalogue)
2025-12-02 19:04:42 [astonbarclay.gb] INFO: Found listing with ID: 117491214
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491214%27 HTTP/1.1" 200 None
2025-12-02 19:04:42 [astonbarclay.gb] INFO: Scrape type for 117491214: 2
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252Fc17695d0-fba7-4590-b137-4c0e5d6cef34_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/c17695d0-fba7-4590-b137-4c0e5d6cef34_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F078c62a4-5182-45a3-b149-a3af85ccbcb3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/078c62a4-5182-45a3-b149-a3af85ccbcb3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fe941e187-f286-4a87-8235-d3a2660fb856_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e941e187-f286-4a87-8235-d3a2660fb856_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/231166ad-93cc-47ee-a9a2-624d3beb7cae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue)
2025-12-02 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY71UNL/2025-11-28/image/10b797fa-8f94-48af-ade0-a4634b33e4be_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508301?view=catalogue)
2025-12-02 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/6a89d969-8f4f-4a4e-9abc-d8f8eadbdb71_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446881?view=catalogue)
2025-12-02 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TMU/2025-12-01/image/78ed11f1-b544-4a6b-a7d2-1e522dc189a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue)
2025-12-02 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72NYL/2025-12-02/image/707d7481-d731-4fb1-a624-ae7493bd9b39_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117100813?view=catalogue)
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252Fbb97c163-900c-4bf6-b5dc-bf4c8c77b209_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/bb97c163-900c-4bf6-b5dc-bf4c8c77b209_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F8b656dc8-3a27-49f6-839a-106a97530aab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/8b656dc8-3a27-49f6-839a-106a97530aab_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F407761c4-dd58-4a76-b77b-57398b4e4594_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/407761c4-dd58-4a76-b77b-57398b4e4594_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252F6cfc4400-f3ec-4980-b2e2-9bb7e0150589_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/6cfc4400-f3ec-4980-b2e2-9bb7e0150589_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf039b5d0>
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F201ea98e-db24-45de-b34b-143137bb992e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/201ea98e-db24-45de-b34b-143137bb992e_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ebc548a-8426-52af-a925-2e350152f83b
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0490f50>
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F749aa07f-eb30-42db-ba0c-b9e6e93d18ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/749aa07f-eb30-42db-ba0c-b9e6e93d18ad_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:04:43 [astonbarclay.gb] INFO: Found listing with ID: 117427071
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427071%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [astonbarclay.gb] INFO: Scrape type for 117427071: 0
2025-12-02 19:04:43 [astonbarclay.gb] INFO: Found listing with ID: 117029988
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117029988%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [astonbarclay.gb] INFO: Scrape type for 117029988: 1
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F8c2d1c70-ab10-474f-9c5d-c036b4ab2b33_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/8c2d1c70-ab10-474f-9c5d-c036b4ab2b33_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252Fb06919d1-8cce-4ce2-a231-39258fd8fa8d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/b06919d1-8cce-4ce2-a231-39258fd8fa8d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fa7861f7a-c5d8-49c2-9ca8-01cc5c15e62e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/a7861f7a-c5d8-49c2-9ca8-01cc5c15e62e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116318543?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TMU/2025-12-01/image/02c233a7-57dd-446e-b63e-a7f8542979e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue)
2025-12-02 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TMU/2025-12-01/image/2be67f55-8152-4555-8437-545c41f4a418_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue)
2025-12-02 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/ca40e6e4-06d4-4fbc-a4b9-99927d85b032_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446881?view=catalogue)
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252Fe98b47d5-21a0-4a09-bf93-3a112718d416_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e98b47d5-21a0-4a09-bf93-3a112718d416_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F669870e6-6a05-439e-9791-2cf710919fd4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/669870e6-6a05-439e-9791-2cf710919fd4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252Fa80b26ac-2436-46af-b53d-d45826aa370b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/a80b26ac-2436-46af-b53d-d45826aa370b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252Ff0bc9e03-71eb-42ab-8110-816bdfb755f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/f0bc9e03-71eb-42ab-8110-816bdfb755f2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:43 [astonbarclay.gb] INFO: Found listing with ID: 117597727
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597727%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [astonbarclay.gb] INFO: Scrape type for 117597727: 1
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F2e0fd6e0-5dce-4453-9eb5-7c5922324e30_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/2e0fd6e0-5dce-4453-9eb5-7c5922324e30_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252Fdc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/dc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F5b37b9ae-d83b-42dd-a22d-f78f5404a342_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/5b37b9ae-d83b-42dd-a22d-f78f5404a342_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0815b50>
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F6466a23d-33e7-491e-8cdd-bdaf99491800_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/6466a23d-33e7-491e-8cdd-bdaf99491800_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf037c790>
2025-12-02 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F3ea2e8d7-781c-45e7-b36c-ecbb192cb55b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3ea2e8d7-781c-45e7-b36c-ecbb192cb55b_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf037ded0>
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea1aae49-cae9-58ac-87f7-666248b36155
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0744790>
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F231166ad-93cc-47ee-a9a2-624d3beb7cae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/231166ad-93cc-47ee-a9a2-624d3beb7cae_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf2093cd0>
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F10b797fa-8f94-48af-ade0-a4634b33e4be_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/10b797fa-8f94-48af-ade0-a4634b33e4be_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ebc548a-8426-52af-a925-2e350152f83b
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0771410>
2025-12-02 19:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252F6a89d969-8f4f-4a4e-9abc-d8f8eadbdb71_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/6a89d969-8f4f-4a4e-9abc-d8f8eadbdb71_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71483516-b9d5-594e-82f5-ffef2099fd34
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf080ba10>
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F78ed11f1-b544-4a6b-a7d2-1e522dc189a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/78ed11f1-b544-4a6b-a7d2-1e522dc189a4_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0815e90>
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F707d7481-d731-4fb1-a624-ae7493bd9b39_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/707d7481-d731-4fb1-a624-ae7493bd9b39_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c
2025-12-02 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71XJE/2025-12-01/image/7dcb347e-dc58-4f3d-ab48-a373dbfc1145_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544110?view=catalogue)
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F43a0c356-362f-48a7-9bbf-e210c91bc131_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/43a0c356-362f-48a7-9bbf-e210c91bc131_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F576e828c-ddcf-487d-88ed-8b637b2ee4a1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/576e828c-ddcf-487d-88ed-8b637b2ee4a1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252F4223b44e-905d-415f-bbe3-3e2719f9325a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/4223b44e-905d-415f-bbe3-3e2719f9325a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e3eed9ea-2c32-4716-9e09-8b7380beedff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML72VFN/2025-11-28/image/49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116637669?view=catalogue)
2025-12-02 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YD73NZH/2025-12-01/image/4652ff00-3b7e-43b6-8d3d-f6f5337b8788_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue)
2025-12-02 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/23696852-78d5-4057-b37f-cf9e6f1cc282_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue)
2025-12-02 19:04:45 [astonbarclay.gb] INFO: Found listing with ID: 117410407
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117410407%27 HTTP/1.1" 200 None
2025-12-02 19:04:45 [astonbarclay.gb] INFO: Scrape type for 117410407: 1
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F7fa464fb-df5b-4ba5-91b2-447ee005dd71_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/7fa464fb-df5b-4ba5-91b2-447ee005dd71_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F351cc696-7efc-443a-a2ab-8ff534ca166d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/351cc696-7efc-443a-a2ab-8ff534ca166d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE70HBP/2025-12-01/image/f7740209-e37c-4723-a393-e43f10960b12_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103769?view=catalogue)
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F4ad99170-df7d-4157-8f20-67a40b25b95a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/4ad99170-df7d-4157-8f20-67a40b25b95a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252Fe401d086-16d8-40e9-863b-5093ffd754a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/e401d086-16d8-40e9-863b-5093ffd754a9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117274456?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116318543, 'registration': 'BK71XRH', 'account': 'KIN032', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE HATCHBACK', 'derivative': '1.5 P300e S 5dr Auto', 'mileage': 24800, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK71XRH/2025-10-16/image/6e345a6a-f8fe-4232-8769-2268a539bf1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/9b972302-9fdc-4233-b8c2-f5c28d9ba1d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/5d91d165-89ab-43d4-acd8-2df0fb5b69c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/cdabd089-317a-46ae-9551-4c870a4084f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/5f74e780-b23c-4eb3-93f6-462118d94870_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/72e4118c-710e-4be3-975b-16c6b249a7d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/3f887210-fffb-4cc4-b955-c7e2352fee36_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/8d61ee93-a7af-48e2-8e4c-8d9989ddf650_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/296037b3-0bbe-4483-b5fb-2801b530bfa2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**314** VOSA STATES 18K, 23K, SPARE KEY  CHARGING  CABLE / 18" 5 split spoke gloss sparkle silver alloy wheels - Style 5075 / Grained leather - Ebony, Ebony/Ebony color way', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/078d963a-ff45-48f2-aab7-3235c2991db4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116318543, 'registration': 'BK71XRH', 'account': 'KIN032', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE HATCHBACK', 'derivative': '1.5 P300e S 5dr Auto', 'mileage': 24800, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK71XRH/2025-10-16/image/6e345a6a-f8fe-4232-8769-2268a539bf1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/9b972302-9fdc-4233-b8c2-f5c28d9ba1d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/5d91d165-89ab-43d4-acd8-2df0fb5b69c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/cdabd089-317a-46ae-9551-4c870a4084f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/5f74e780-b23c-4eb3-93f6-462118d94870_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/72e4118c-710e-4be3-975b-16c6b249a7d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/3f887210-fffb-4cc4-b955-c7e2352fee36_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/8d61ee93-a7af-48e2-8e4c-8d9989ddf650_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/296037b3-0bbe-4483-b5fb-2801b530bfa2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**314** VOSA STATES 18K, 23K, SPARE KEY  CHARGING  CABLE / 18" 5 split spoke gloss sparkle silver alloy wheels - Style 5075 / Grained leather - Ebony, Ebony/Ebony color way', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/078d963a-ff45-48f2-aab7-3235c2991db4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60972877-f070-5940-a80e-d52ff5e981bb with identifier: 116318543
2025-12-02 19:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60972877-f070-5940-a80e-d52ff5e981bb with scrape type 2
2025-12-02 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60972877-f070-5940-a80e-d52ff5e981bb with scrape type 2
2025-12-02 19:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 60972877-f070-5940-a80e-d52ff5e981bb, identifier: 116318543
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf2006410>
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F02c233a7-57dd-446e-b63e-a7f8542979e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/02c233a7-57dd-446e-b63e-a7f8542979e6_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf079f410>
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F2be67f55-8152-4555-8437-545c41f4a418_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/2be67f55-8152-4555-8437-545c41f4a418_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0691690>
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Fca40e6e4-06d4-4fbc-a4b9-99927d85b032_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/ca40e6e4-06d4-4fbc-a4b9-99927d85b032_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71483516-b9d5-594e-82f5-ffef2099fd34
2025-12-02 19:04:46 [astonbarclay.gb] INFO: Found listing with ID: 117394554
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394554%27 HTTP/1.1" 200 None
2025-12-02 19:04:46 [astonbarclay.gb] INFO: Scrape type for 117394554: 2
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252Ff4a1bb6f-b1eb-435f-abbd-d8f1ca79c567_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/f4a1bb6f-b1eb-435f-abbd-d8f1ca79c567_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F3bd5c16a-f43a-44a7-b82d-df0f7561ab93_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3bd5c16a-f43a-44a7-b82d-df0f7561ab93_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 60972877-f070-5940-a80e-d52ff5e981bb with identifier: 116318543
2025-12-02 19:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 60972877-f070-5940-a80e-d52ff5e981bb with identifier: 116318543
2025-12-02 19:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 60972877-f070-5940-a80e-d52ff5e981bb with identifier: 116318543 to the API
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116318543?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '60972877-f070-5940-a80e-d52ff5e981bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BK71XRH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116318543',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE HATCHBACK',
 'odometer': 24800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-01',
 'seller_name': 'Kinto',
 'title': 'LAND ROVER RANGE ROVER EVOQUE HATCHBACK 1.5 P300e S 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 P300e S 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116318543%27 HTTP/1.1" 200 None
2025-12-02 19:04:47 [astonbarclay.gb] INFO: Saving data for 116318543: {'auction_closing_time': 1764755100.0, 'created_time': 1761160108.046799, 'last_price_update_time': 1764702287.209515}
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116318543') HTTP/1.1" 204 0
2025-12-02 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TMU/2025-12-01/image/265d9b34-6dd0-4a6a-900d-a333529a09bf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue)
2025-12-02 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/d1c24b8e-9418-433a-b818-d5390e2640ee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue)
2025-12-02 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY71UNL/2025-11-28/image/b66f6932-1dda-4ed4-8f71-08fdd27df132_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508301?view=catalogue)
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F40b347db-ca9a-453f-bce7-164d75610ce4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/40b347db-ca9a-453f-bce7-164d75610ce4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252Fb2b93608-d060-4897-a72e-55ef456a8e6f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/b2b93608-d060-4897-a72e-55ef456a8e6f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf050d0d0>
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252F7dcb347e-dc58-4f3d-ab48-a373dbfc1145_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/7dcb347e-dc58-4f3d-ab48-a373dbfc1145_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 878cacd3-23a7-58d3-ba66-bbbefc642c43
2025-12-02 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YD73NZH/2025-12-01/image/b06919d1-8cce-4ce2-a231-39258fd8fa8d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue)
2025-12-02 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71XJE/2025-12-01/image/f0bc9e03-71eb-42ab-8110-816bdfb755f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544110?view=catalogue)
2025-12-02 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/a7861f7a-c5d8-49c2-9ca8-01cc5c15e62e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY71UNL/2025-11-28/image/8c2d1c70-ab10-474f-9c5d-c036b4ab2b33_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508301?view=catalogue)
2025-12-02 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116637669?view=catalogue)
2025-12-02 19:04:47 [astonbarclay.gb] INFO: Found listing with ID: 117590494
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590494%27 HTTP/1.1" 200 None
2025-12-02 19:04:47 [astonbarclay.gb] INFO: Scrape type for 117590494: 1
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252Fef0f789a-1b6a-4ffe-9718-e095a5f6433e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/ef0f789a-1b6a-4ffe-9718-e095a5f6433e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252Fd1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/d1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F0a16a5dd-18c7-44c8-80c3-279d6068f6c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/0a16a5dd-18c7-44c8-80c3-279d6068f6c3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116997115?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf034a550>
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fe3eed9ea-2c32-4716-9e09-8b7380beedff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e3eed9ea-2c32-4716-9e09-8b7380beedff_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0340d50>
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea1aae49-cae9-58ac-87f7-666248b36155
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090a990>
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F4652ff00-3b7e-43b6-8d3d-f6f5337b8788_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/4652ff00-3b7e-43b6-8d3d-f6f5337b8788_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b83490>
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F23696852-78d5-4057-b37f-cf9e6f1cc282_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/23696852-78d5-4057-b37f-cf9e6f1cc282_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07f0110>
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252Ff7740209-e37c-4723-a393-e43f10960b12_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/f7740209-e37c-4723-a393-e43f10960b12_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b71d56d-b899-5c31-8a4e-958243c973ff
2025-12-02 19:04:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117274456, 'registration': 'YH71XFK', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'UP ELECTRIC HATCHBACK', 'derivative': '60kW E-Up 32kWh 5dr Auto', 'mileage': 22957, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-10', 'fuel': 'Electric', 'motExpiry': '2025-11-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24 - 19K', 'remarks': '**1653** VOSA STATES 19K CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5979140d-8acf-4999-a363-159218c395ae.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117274456, 'registration': 'YH71XFK', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'UP ELECTRIC HATCHBACK', 'derivative': '60kW E-Up 32kWh 5dr Auto', 'mileage': 22957, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-10', 'fuel': 'Electric', 'motExpiry': '2025-11-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24 - 19K', 'remarks': '**1653** VOSA STATES 19K CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5979140d-8acf-4999-a363-159218c395ae.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e89d2341-6d61-5d14-92f3-065fa0676120 with identifier: 117274456
2025-12-02 19:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e89d2341-6d61-5d14-92f3-065fa0676120 with scrape type 2
2025-12-02 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e89d2341-6d61-5d14-92f3-065fa0676120 with scrape type 2
2025-12-02 19:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e89d2341-6d61-5d14-92f3-065fa0676120, identifier: 117274456
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F6cfc72d3-1d08-48b3-8205-73df8e8a6f92_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6cfc72d3-1d08-48b3-8205-73df8e8a6f92_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252F1f6993d5-c94b-4cbc-99f2-13f1f7579043_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/1f6993d5-c94b-4cbc-99f2-13f1f7579043_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e89d2341-6d61-5d14-92f3-065fa0676120 with identifier: 117274456
2025-12-02 19:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e89d2341-6d61-5d14-92f3-065fa0676120 with identifier: 117274456
2025-12-02 19:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'up electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 22957, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274456', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '60kw e-up 32kwh 5dr auto', 'license_plate': 'yh71xfk', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'e89d2341-6d61-5d14-92f3-065fa0676120', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'volkswagen up electric hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 36945} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': 'e89d2341-6d61-5d14-92f3-065fa0676120',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yh71xfk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274456',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'volkswagen',
     'make_model': 'volkswagen up electric hatchback',
     'model': 'up electric hatchback',
     'odometer': 22957,
     'odometer_in_km': 36945,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-10',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '60kw e-up 32kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: e89d2341-6d61-5d14-92f3-065fa0676120 spider: astonbarclay.gb
2025-12-02 19:04:49 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e89d2341-6d61-5d14-92f3-065fa0676120 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'up electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 22957, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274456', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '60kw e-up 32kwh 5dr auto', 'license_plate': 'yh71xfk', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'e89d2341-6d61-5d14-92f3-065fa0676120', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'volkswagen up electric hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 36945} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': 'e89d2341-6d61-5d14-92f3-065fa0676120',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yh71xfk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274456',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'volkswagen',
     'make_model': 'volkswagen up electric hatchback',
     'model': 'up electric hatchback',
     'odometer': 22957,
     'odometer_in_km': 36945,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-10',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '60kw e-up 32kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'e89d2341-6d61-5d14-92f3-065fa0676120',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YH71XFK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274456',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'UP ELECTRIC HATCHBACK',
 'odometer': 22957,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN UP ELECTRIC HATCHBACK 60kW E-Up 32kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '60kW E-Up 32kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274456%27 HTTP/1.1" 200 None
2025-12-02 19:04:49 [astonbarclay.gb] INFO: Saving data for 117274456: {'auction_closing_time': 1764755100.0, 'created_time': 1764270087.048048, 'last_price_update_time': 1764702289.352104}
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117274456') HTTP/1.1" 204 0
2025-12-02 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE70HBP/2025-12-01/image/576e828c-ddcf-487d-88ed-8b637b2ee4a1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103769?view=catalogue)
2025-12-02 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71XJE/2025-12-01/image/4223b44e-905d-415f-bbe3-3e2719f9325a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544110?view=catalogue)
2025-12-02 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TMU/2025-12-01/image/43a0c356-362f-48a7-9bbf-e210c91bc131_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue)
2025-12-02 19:04:49 [astonbarclay.gb] INFO: Found listing with ID: 117549752
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549752%27 HTTP/1.1" 200 None
2025-12-02 19:04:49 [astonbarclay.gb] INFO: Scrape type for 117549752: 1
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F029d3e6d-6293-4236-b63c-6ead6efeec90_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/029d3e6d-6293-4236-b63c-6ead6efeec90_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fd4a8a223-c5ed-4d22-9d02-73ef1d63523d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/d4a8a223-c5ed-4d22-9d02-73ef1d63523d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d17450>
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F265d9b34-6dd0-4a6a-900d-a333529a09bf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/265d9b34-6dd0-4a6a-900d-a333529a09bf_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0511010>
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252Fd1c24b8e-9418-433a-b818-d5390e2640ee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/d1c24b8e-9418-433a-b818-d5390e2640ee_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf091fc10>
2025-12-02 19:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252Fb66f6932-1dda-4ed4-8f71-08fdd27df132_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/b66f6932-1dda-4ed4-8f71-08fdd27df132_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ebc548a-8426-52af-a925-2e350152f83b
2025-12-02 19:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE70HBP/2025-12-01/image/4ad99170-df7d-4157-8f20-67a40b25b95a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103769?view=catalogue)
2025-12-02 19:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/351cc696-7efc-443a-a2ab-8ff534ca166d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/5b37b9ae-d83b-42dd-a22d-f78f5404a342_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML72VFN/2025-11-28/image/dc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116637669?view=catalogue)
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F6c27f15c-d00a-4607-83e4-33f4c51854ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6c27f15c-d00a-4607-83e4-33f4c51854ad_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252Fbb1619b3-5771-4f4c-ad48-f2c309a07ef5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/bb1619b3-5771-4f4c-ad48-f2c309a07ef5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71XJE/2025-12-01/image/e401d086-16d8-40e9-863b-5093ffd754a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544110?view=catalogue)
2025-12-02 19:04:50 [astonbarclay.gb] INFO: Found listing with ID: 117508326
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508326%27 HTTP/1.1" 200 None
2025-12-02 19:04:50 [astonbarclay.gb] INFO: Scrape type for 117508326: 1
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F1a83dd39-d4e1-438b-9a86-17e070f09183_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/1a83dd39-d4e1-438b-9a86-17e070f09183_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fc4656a57-4503-4e5d-ba94-29a21e2693cb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/c4656a57-4503-4e5d-ba94-29a21e2693cb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F253b78c4-2040-4e04-bd73-ee703829fe1d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/253b78c4-2040-4e04-bd73-ee703829fe1d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252Fa4c514bf-30b0-4166-ad66-cc0cbf76633c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/a4c514bf-30b0-4166-ad66-cc0cbf76633c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02df0d0>
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252Fb06919d1-8cce-4ce2-a231-39258fd8fa8d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/b06919d1-8cce-4ce2-a231-39258fd8fa8d_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0312150>
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252Ff0bc9e03-71eb-42ab-8110-816bdfb755f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/f0bc9e03-71eb-42ab-8110-816bdfb755f2_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 878cacd3-23a7-58d3-ba66-bbbefc642c43
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0460390>
2025-12-02 19:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fa7861f7a-c5d8-49c2-9ca8-01cc5c15e62e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/a7861f7a-c5d8-49c2-9ca8-01cc5c15e62e_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07a5350>
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F8c2d1c70-ab10-474f-9c5d-c036b4ab2b33_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/8c2d1c70-ab10-474f-9c5d-c036b4ab2b33_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ebc548a-8426-52af-a925-2e350152f83b
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf039b990>
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea1aae49-cae9-58ac-87f7-666248b36155
2025-12-02 19:04:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117209835, 'registration': 'BF73UZU', 'account': 'ZEN002', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto', 'mileage': 28164, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-12-18', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BF73UZU/2025-11-27/image/6d735ff2-09a3-418d-9c99-684f577dcfbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/97ccb22e-c5f5-4f93-994a-95fd5f29d3e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/eb237f33-faa0-4dde-ac84-534336c70591_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/3eee19f3-f8f6-4d66-9fe6-5b47e785bd67_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/d3c83ff7-f36c-4b56-b460-46c6c44efdef_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/5c06c5c1-594d-49e0-a205-82ab2e1bbec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/cfe4c55a-939f-4597-8402-c76df63dccde_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/ea0dd6ab-5f36-4d07-a733-c826ec5a606a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/e5277d38-e14d-4a4f-8736-5b7217894a9e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25 - 16K', 'remarks': '**876** Pearl Paint SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f9f0e6bf-b569-425d-88de-644db595a4b0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117209835, 'registration': 'BF73UZU', 'account': 'ZEN002', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto', 'mileage': 28164, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-12-18', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BF73UZU/2025-11-27/image/6d735ff2-09a3-418d-9c99-684f577dcfbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/97ccb22e-c5f5-4f93-994a-95fd5f29d3e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/eb237f33-faa0-4dde-ac84-534336c70591_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/3eee19f3-f8f6-4d66-9fe6-5b47e785bd67_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/d3c83ff7-f36c-4b56-b460-46c6c44efdef_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/5c06c5c1-594d-49e0-a205-82ab2e1bbec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/cfe4c55a-939f-4597-8402-c76df63dccde_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/ea0dd6ab-5f36-4d07-a733-c826ec5a606a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/e5277d38-e14d-4a4f-8736-5b7217894a9e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25 - 16K', 'remarks': '**876** Pearl Paint SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f9f0e6bf-b569-425d-88de-644db595a4b0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with identifier: 117209835
2025-12-02 19:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with scrape type 2
2025-12-02 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with scrape type 2
2025-12-02 19:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf, identifier: 117209835
2025-12-02 19:04:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116997115, 'registration': 'YE71NFX', 'account': 'ZEN009', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE SPECIAL EDITION', 'derivative': '1.0 TSI 110 Active 5dr DSG', 'mileage': 32837, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol', 'motExpiry': '2025-11-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE71NFX/2025-12-02/image/bca7a0a4-1779-4598-a29d-721155232997_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/dce62bcc-247d-41d8-a4a4-bded429bb689_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/16b75115-5f00-4202-99c3-1b2b4f11addb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4e37d971-4d04-4481-b1b7-5191a3f080d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/d82ae84a-96e6-49e9-b67f-178cd118ba69_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/78ac71d9-662b-4492-aec6-874b99493aac_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/2dd0734d-84c1-4040-80e6-d0b023d064f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4841806e-1560-4f08-9331-0b95d98c0ec2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/5e41864e-0da3-40fe-88cb-430a4d510481_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23 - 16K', 'remarks': '**922**VOSA STATES 25K, 32K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/48c1d6db-8e8f-4bb6-85e6-87de8d263ced.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116997115, 'registration': 'YE71NFX', 'account': 'ZEN009', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE SPECIAL EDITION', 'derivative': '1.0 TSI 110 Active 5dr DSG', 'mileage': 32837, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol', 'motExpiry': '2025-11-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE71NFX/2025-12-02/image/bca7a0a4-1779-4598-a29d-721155232997_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/dce62bcc-247d-41d8-a4a4-bded429bb689_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/16b75115-5f00-4202-99c3-1b2b4f11addb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4e37d971-4d04-4481-b1b7-5191a3f080d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/d82ae84a-96e6-49e9-b67f-178cd118ba69_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/78ac71d9-662b-4492-aec6-874b99493aac_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/2dd0734d-84c1-4040-80e6-d0b023d064f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4841806e-1560-4f08-9331-0b95d98c0ec2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/5e41864e-0da3-40fe-88cb-430a4d510481_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23 - 16K', 'remarks': '**922**VOSA STATES 25K, 32K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/48c1d6db-8e8f-4bb6-85e6-87de8d263ced.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0419ba6-0eec-506d-939b-06b572dc0b26 with identifier: 116997115
2025-12-02 19:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0419ba6-0eec-506d-939b-06b572dc0b26 with scrape type 1
2025-12-02 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item d0419ba6-0eec-506d-939b-06b572dc0b26
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252Fbca7a0a4-1779-4598-a29d-721155232997_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/bca7a0a4-1779-4598-a29d-721155232997_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf2112bd0>
2025-12-02 19:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F576e828c-ddcf-487d-88ed-8b637b2ee4a1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/576e828c-ddcf-487d-88ed-8b637b2ee4a1_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b71d56d-b899-5c31-8a4e-958243c973ff
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0782b10>
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252F4223b44e-905d-415f-bbe3-3e2719f9325a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/4223b44e-905d-415f-bbe3-3e2719f9325a_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 878cacd3-23a7-58d3-ba66-bbbefc642c43
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ff090>
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F43a0c356-362f-48a7-9bbf-e210c91bc131_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/43a0c356-362f-48a7-9bbf-e210c91bc131_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:04:52 [astonbarclay.gb] INFO: Found listing with ID: 117042418
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117042418%27 HTTP/1.1" 200 None
2025-12-02 19:04:52 [astonbarclay.gb] INFO: Scrape type for 117042418: 0
2025-12-02 19:04:52 [astonbarclay.gb] INFO: Found listing with ID: 116859206
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859206%27 HTTP/1.1" 200 None
2025-12-02 19:04:52 [astonbarclay.gb] INFO: Scrape type for 116859206: 1
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fac310f36-e7d2-4b04-851e-d54c9737002a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/ac310f36-e7d2-4b04-851e-d54c9737002a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with identifier: 117209835
2025-12-02 19:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with identifier: 117209835
2025-12-02 19:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with identifier: 117209835 to the API
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BF73UZU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117209835',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 28164,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-18',
 'seller_name': 'Zenith',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto',
 'transmission': 'automatic',
 'trim': '1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto',
 'vin': None,
 'year': 2023}
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209835%27 HTTP/1.1" 200 None
2025-12-02 19:04:52 [astonbarclay.gb] INFO: Saving data for 117209835: {'auction_closing_time': 1764755100.0, 'created_time': 1764270076.567663, 'last_price_update_time': 1764702292.907664}
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117209835') HTTP/1.1" 204 0
2025-12-02 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116637669?view=catalogue)
2025-12-02 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/0a16a5dd-18c7-44c8-80c3-279d6068f6c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YD73NZH/2025-12-01/image/7fa464fb-df5b-4ba5-91b2-447ee005dd71_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue)
2025-12-02 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YD73NZH/2025-12-01/image/f4a1bb6f-b1eb-435f-abbd-d8f1ca79c567_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue)
2025-12-02 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML72VFN/2025-11-28/image/4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116637669?view=catalogue)
2025-12-02 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3bd5c16a-f43a-44a7-b82d-df0f7561ab93_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML72VFN/2025-11-28/image/d1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116637669?view=catalogue)
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252Fdce62bcc-247d-41d8-a4a4-bded429bb689_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/dce62bcc-247d-41d8-a4a4-bded429bb689_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf3388e10>
2025-12-02 19:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F4ad99170-df7d-4157-8f20-67a40b25b95a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/4ad99170-df7d-4157-8f20-67a40b25b95a_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b71d56d-b899-5c31-8a4e-958243c973ff
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf037f210>
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F351cc696-7efc-443a-a2ab-8ff534ca166d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/351cc696-7efc-443a-a2ab-8ff534ca166d_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0360a50>
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F5b37b9ae-d83b-42dd-a22d-f78f5404a342_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/5b37b9ae-d83b-42dd-a22d-f78f5404a342_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf050b510>
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252Fdc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/dc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea1aae49-cae9-58ac-87f7-666248b36155
2025-12-02 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YD73NZH/2025-12-01/image/ef0f789a-1b6a-4ffe-9718-e095a5f6433e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue)
2025-12-02 19:04:53 [astonbarclay.gb] INFO: Found listing with ID: 117219826
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117219826%27 HTTP/1.1" 200 None
2025-12-02 19:04:53 [astonbarclay.gb] INFO: Scrape type for 117219826: 0
2025-12-02 19:04:53 [astonbarclay.gb] INFO: Found listing with ID: 116827121
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116827121%27 HTTP/1.1" 200 None
2025-12-02 19:04:53 [astonbarclay.gb] INFO: Scrape type for 116827121: 0
2025-12-02 19:04:53 [astonbarclay.gb] INFO: Found listing with ID: 117581526
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581526%27 HTTP/1.1" 200 None
2025-12-02 19:04:54 [astonbarclay.gb] INFO: Scrape type for 117581526: 1
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf044ab90>
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252Fe401d086-16d8-40e9-863b-5093ffd754a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/e401d086-16d8-40e9-863b-5093ffd754a9_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 878cacd3-23a7-58d3-ba66-bbbefc642c43
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F16b75115-5f00-4202-99c3-1b2b4f11addb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/16b75115-5f00-4202-99c3-1b2b4f11addb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6cfc72d3-1d08-48b3-8205-73df8e8a6f92_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103769?view=catalogue)
2025-12-02 19:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE70HBP/2025-12-01/image/40b347db-ca9a-453f-bce7-164d75610ce4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103769?view=catalogue)
2025-12-02 19:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71XJE/2025-12-01/image/bb1619b3-5771-4f4c-ad48-f2c309a07ef5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544110?view=catalogue)
2025-12-02 19:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71XJE/2025-12-01/image/b2b93608-d060-4897-a72e-55ef456a8e6f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544110?view=catalogue)
2025-12-02 19:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71XJE/2025-12-01/image/1f6993d5-c94b-4cbc-99f2-13f1f7579043_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544110?view=catalogue)
2025-12-02 19:04:54 [astonbarclay.gb] INFO: Found listing with ID: 116833978
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116833978%27 HTTP/1.1" 200 None
2025-12-02 19:04:54 [astonbarclay.gb] INFO: Scrape type for 116833978: 1
2025-12-02 19:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf033b9d0>
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea1aae49-cae9-58ac-87f7-666248b36155
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0425810>
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F0a16a5dd-18c7-44c8-80c3-279d6068f6c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/0a16a5dd-18c7-44c8-80c3-279d6068f6c3_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf34e6990>
2025-12-02 19:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F7fa464fb-df5b-4ba5-91b2-447ee005dd71_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/7fa464fb-df5b-4ba5-91b2-447ee005dd71_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0425810>
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252Ff4a1bb6f-b1eb-435f-abbd-d8f1ca79c567_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/f4a1bb6f-b1eb-435f-abbd-d8f1ca79c567_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0426210>
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea1aae49-cae9-58ac-87f7-666248b36155
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a818d0>
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F3bd5c16a-f43a-44a7-b82d-df0f7561ab93_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3bd5c16a-f43a-44a7-b82d-df0f7561ab93_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0425dd0>
2025-12-02 19:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252Fd1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/d1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea1aae49-cae9-58ac-87f7-666248b36155
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F4e37d971-4d04-4481-b1b7-5191a3f080d3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4e37d971-4d04-4481-b1b7-5191a3f080d3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf044e990>
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252Fef0f789a-1b6a-4ffe-9718-e095a5f6433e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/ef0f789a-1b6a-4ffe-9718-e095a5f6433e_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE70HBP/2025-12-01/image/253b78c4-2040-4e04-bd73-ee703829fe1d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103769?view=catalogue)
2025-12-02 19:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71NFX/2025-12-02/image/bca7a0a4-1779-4598-a29d-721155232997_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997115?view=catalogue)
2025-12-02 19:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71XJE/2025-12-01/image/a4c514bf-30b0-4166-ad66-cc0cbf76633c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544110?view=catalogue)
2025-12-02 19:04:56 [astonbarclay.gb] INFO: Found listing with ID: 117561425
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117561425%27 HTTP/1.1" 200 None
2025-12-02 19:04:56 [astonbarclay.gb] INFO: Scrape type for 117561425: 1
2025-12-02 19:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6c27f15c-d00a-4607-83e4-33f4c51854ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103769?view=catalogue)
2025-12-02 19:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YD73NZH/2025-12-01/image/1a83dd39-d4e1-438b-9a86-17e070f09183_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue)
2025-12-02 19:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/c4656a57-4503-4e5d-ba94-29a21e2693cb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252Fd82ae84a-96e6-49e9-b67f-178cd118ba69_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/d82ae84a-96e6-49e9-b67f-178cd118ba69_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117394554?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07b64d0>
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F6cfc72d3-1d08-48b3-8205-73df8e8a6f92_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6cfc72d3-1d08-48b3-8205-73df8e8a6f92_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b71d56d-b899-5c31-8a4e-958243c973ff
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b5bd0>
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F40b347db-ca9a-453f-bce7-164d75610ce4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/40b347db-ca9a-453f-bce7-164d75610ce4_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b71d56d-b899-5c31-8a4e-958243c973ff
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04f8650>
2025-12-02 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252Fbb1619b3-5771-4f4c-ad48-f2c309a07ef5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/bb1619b3-5771-4f4c-ad48-f2c309a07ef5_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 878cacd3-23a7-58d3-ba66-bbbefc642c43
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07b7010>
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252Fb2b93608-d060-4897-a72e-55ef456a8e6f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/b2b93608-d060-4897-a72e-55ef456a8e6f_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 878cacd3-23a7-58d3-ba66-bbbefc642c43
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf035c2d0>
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252F1f6993d5-c94b-4cbc-99f2-13f1f7579043_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/1f6993d5-c94b-4cbc-99f2-13f1f7579043_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 878cacd3-23a7-58d3-ba66-bbbefc642c43
2025-12-02 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/ac310f36-e7d2-4b04-851e-d54c9737002a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:04:57 [astonbarclay.gb] INFO: Found listing with ID: 116914684
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116914684%27 HTTP/1.1" 200 None
2025-12-02 19:04:57 [astonbarclay.gb] INFO: Scrape type for 116914684: 2
2025-12-02 19:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71NFX/2025-12-02/image/dce62bcc-247d-41d8-a4a4-bded429bb689_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997115?view=catalogue)
2025-12-02 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/d4a8a223-c5ed-4d22-9d02-73ef1d63523d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YD73NZH/2025-12-01/image/029d3e6d-6293-4236-b63c-6ead6efeec90_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue)
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F78ac71d9-662b-4492-aec6-874b99493aac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/78ac71d9-662b-4492-aec6-874b99493aac_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:57 [astonbarclay.gb] INFO: Found listing with ID: 117420890
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420890%27 HTTP/1.1" 200 None
2025-12-02 19:04:57 [astonbarclay.gb] INFO: Scrape type for 117420890: 1
2025-12-02 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117508326?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf121f210>
2025-12-02 19:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F253b78c4-2040-4e04-bd73-ee703829fe1d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/253b78c4-2040-4e04-bd73-ee703829fe1d_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b71d56d-b899-5c31-8a4e-958243c973ff
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e1090>
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252Fbca7a0a4-1779-4598-a29d-721155232997_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/bca7a0a4-1779-4598-a29d-721155232997_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0419ba6-0eec-506d-939b-06b572dc0b26
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0499cd0>
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252Fa4c514bf-30b0-4166-ad66-cc0cbf76633c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/a4c514bf-30b0-4166-ad66-cc0cbf76633c_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 878cacd3-23a7-58d3-ba66-bbbefc642c43
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e1bd0>
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F6c27f15c-d00a-4607-83e4-33f4c51854ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6c27f15c-d00a-4607-83e4-33f4c51854ad_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b71d56d-b899-5c31-8a4e-958243c973ff
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05848d0>
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F1a83dd39-d4e1-438b-9a86-17e070f09183_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/1a83dd39-d4e1-438b-9a86-17e070f09183_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0831ed0>
2025-12-02 19:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fc4656a57-4503-4e5d-ba94-29a21e2693cb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/c4656a57-4503-4e5d-ba94-29a21e2693cb_removebg.jpg?w=600 saved to cache
2025-12-02 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:04:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117394554, 'registration': 'LG20XFN', 'account': 'MAN027', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 96316, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-12', 'fuel': 'Electric', 'motExpiry': '2026-03-19', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LG20XFN/2025-11-21/image/1dfda4ab-68ba-415f-b03a-fd2573fdd940_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/766f36f7-c2bf-44dc-90e1-0b2c08085846_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/d104ef3d-465e-4bd3-a798-f23d8bd21fe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/6a2caa00-6ddc-43b1-8b0e-a4eb274c5f63_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/2ea3a3d7-b4e4-433b-b0a2-7cb6d2bb580d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/7ea03406-c9d7-4798-a6c2-f877bea3cd58_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/6ab0b906-e06a-4262-9e16-13f8e779556b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/63c6ff75-5743-4adc-908f-ffdbf1bb780f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/a30b5f01-0f93-4bdf-b851-4cd071a93804_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1761** VOSA STATES 68K, 87K, 93K CHARGING CABLE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bbf8ee46-310e-458f-a17d-cce6ebb78d93.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117394554, 'registration': 'LG20XFN', 'account': 'MAN027', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 96316, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-12', 'fuel': 'Electric', 'motExpiry': '2026-03-19', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LG20XFN/2025-11-21/image/1dfda4ab-68ba-415f-b03a-fd2573fdd940_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/766f36f7-c2bf-44dc-90e1-0b2c08085846_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/d104ef3d-465e-4bd3-a798-f23d8bd21fe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/6a2caa00-6ddc-43b1-8b0e-a4eb274c5f63_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/2ea3a3d7-b4e4-433b-b0a2-7cb6d2bb580d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/7ea03406-c9d7-4798-a6c2-f877bea3cd58_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/6ab0b906-e06a-4262-9e16-13f8e779556b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/63c6ff75-5743-4adc-908f-ffdbf1bb780f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG20XFN/2025-11-21/image/a30b5f01-0f93-4bdf-b851-4cd071a93804_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1761** VOSA STATES 68K, 87K, 93K CHARGING CABLE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bbf8ee46-310e-458f-a17d-cce6ebb78d93.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55c27ae3-28db-5aa0-bac6-4102aa00f719 with identifier: 117394554
2025-12-02 19:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55c27ae3-28db-5aa0-bac6-4102aa00f719 with scrape type 2
2025-12-02 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55c27ae3-28db-5aa0-bac6-4102aa00f719 with scrape type 2
2025-12-02 19:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 55c27ae3-28db-5aa0-bac6-4102aa00f719, identifier: 117394554
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F2dd0734d-84c1-4040-80e6-d0b023d064f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/2dd0734d-84c1-4040-80e6-d0b023d064f9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 55c27ae3-28db-5aa0-bac6-4102aa00f719 with identifier: 117394554
2025-12-02 19:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 55c27ae3-28db-5aa0-bac6-4102aa00f719 with identifier: 117394554
2025-12-02 19:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155005 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155005
2025-12-02 19:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 55c27ae3-28db-5aa0-bac6-4102aa00f719 spider: astonbarclay.gb
2025-12-02 19:04:59 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 55c27ae3-28db-5aa0-bac6-4102aa00f719 due to rule: high_mileage_for_country.json, error: 155005 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155005
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '55c27ae3-28db-5aa0-bac6-4102aa00f719',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LG20XFN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117394554',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 96316,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-12',
 'seller_name': 'Mann Island Finance',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394554%27 HTTP/1.1" 200 None
2025-12-02 19:04:59 [astonbarclay.gb] INFO: Saving data for 117394554: {'auction_closing_time': 1764927900.0, 'created_time': 1764234085.381701, 'last_price_update_time': 1764702299.835136}
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117394554') HTTP/1.1" 204 0
2025-12-02 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE70HBP/2025-12-01/image/a80b26ac-2436-46af-b53d-d45826aa370b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103769?view=catalogue)
2025-12-02 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4e37d971-4d04-4481-b1b7-5191a3f080d3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997115?view=catalogue)
2025-12-02 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71NFX/2025-12-02/image/16b75115-5f00-4202-99c3-1b2b4f11addb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997115?view=catalogue)
2025-12-02 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YD73NZH/2025-12-01/image/2e0fd6e0-5dce-4453-9eb5-7c5922324e30_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue)
2025-12-02 19:04:59 [astonbarclay.gb] INFO: Found listing with ID: 117420349
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420349%27 HTTP/1.1" 200 None
2025-12-02 19:04:59 [astonbarclay.gb] INFO: Scrape type for 117420349: 1
2025-12-02 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e98b47d5-21a0-4a09-bf93-3a112718d416_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue)
2025-12-02 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71NFX/2025-12-02/image/d82ae84a-96e6-49e9-b67f-178cd118ba69_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997115?view=catalogue)
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F4841806e-1560-4f08-9331-0b95d98c0ec2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4841806e-1560-4f08-9331-0b95d98c0ec2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116859206?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117410407?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117590494?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:00 [astonbarclay.gb] INFO: Found listing with ID: 117180057
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180057%27 HTTP/1.1" 200 None
2025-12-02 19:05:00 [astonbarclay.gb] INFO: Scrape type for 117180057: 0
2025-12-02 19:05:00 [astonbarclay.gb] INFO: Found listing with ID: 117019833
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117019833%27 HTTP/1.1" 200 None
2025-12-02 19:05:00 [astonbarclay.gb] INFO: Scrape type for 117019833: 0
2025-12-02 19:05:00 [astonbarclay.gb] INFO: Found listing with ID: 117579914
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579914%27 HTTP/1.1" 200 None
2025-12-02 19:05:00 [astonbarclay.gb] INFO: Scrape type for 117579914: 1
2025-12-02 19:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09b7890>
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_11.jpg HTTP/1.1" 201 0
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fac310f36-e7d2-4b04-851e-d54c9737002a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/ac310f36-e7d2-4b04-851e-d54c9737002a_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf035f110>
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252Fdce62bcc-247d-41d8-a4a4-bded429bb689_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/dce62bcc-247d-41d8-a4a4-bded429bb689_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0419ba6-0eec-506d-939b-06b572dc0b26
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b7d90>
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fd4a8a223-c5ed-4d22-9d02-73ef1d63523d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/d4a8a223-c5ed-4d22-9d02-73ef1d63523d_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf20e0410>
2025-12-02 19:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F029d3e6d-6293-4236-b63c-6ead6efeec90_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/029d3e6d-6293-4236-b63c-6ead6efeec90_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:05:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117508326, 'registration': 'YF71HVO', 'account': 'ZEN009', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE SPECIAL EDITION', 'derivative': '1.0 TSI 110 Active 5dr DSG', 'mileage': 15164, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF71HVO/2025-12-02/image/d6324c42-5365-4338-82e1-5bb3a22788e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/877d51bf-37ae-4779-887b-61362789eee9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/8ee385b5-cf6e-4c21-94ec-8f19c1a9b4e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/cfcd1567-3674-4f57-a6f9-4aaab87f4e39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/43ec6dc9-12ea-4dcd-9edf-d0d8d0770214_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/15e417da-1c54-4986-acba-d7628ef7a179_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/90d87e9d-8236-4a73-a528-944ec02675a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/c3911f7f-2693-468b-a529-406832ab98ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/a7561868-2bf4-43e0-be00-aec50e17e106_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/23- 7K,', 'remarks': '**785**VOSA STATES 11K, 14K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/908328e8-1021-47ab-bd41-af0a3e5b6b2a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117508326, 'registration': 'YF71HVO', 'account': 'ZEN009', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE SPECIAL EDITION', 'derivative': '1.0 TSI 110 Active 5dr DSG', 'mileage': 15164, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF71HVO/2025-12-02/image/d6324c42-5365-4338-82e1-5bb3a22788e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/877d51bf-37ae-4779-887b-61362789eee9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/8ee385b5-cf6e-4c21-94ec-8f19c1a9b4e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/cfcd1567-3674-4f57-a6f9-4aaab87f4e39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/43ec6dc9-12ea-4dcd-9edf-d0d8d0770214_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/15e417da-1c54-4986-acba-d7628ef7a179_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/90d87e9d-8236-4a73-a528-944ec02675a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/c3911f7f-2693-468b-a529-406832ab98ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/a7561868-2bf4-43e0-be00-aec50e17e106_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/23- 7K,', 'remarks': '**785**VOSA STATES 11K, 14K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/908328e8-1021-47ab-bd41-af0a3e5b6b2a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afc55445-065d-5656-a413-94c60897ffb6 with identifier: 117508326
2025-12-02 19:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc55445-065d-5656-a413-94c60897ffb6 with scrape type 1
2025-12-02 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item afc55445-065d-5656-a413-94c60897ffb6
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252Fd6324c42-5365-4338-82e1-5bb3a22788e0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/d6324c42-5365-4338-82e1-5bb3a22788e0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TMU/2025-12-01/image/669870e6-6a05-439e-9791-2cf710919fd4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue)
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F5e41864e-0da3-40fe-88cb-430a4d510481_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/5e41864e-0da3-40fe-88cb-430a4d510481_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71NFX/2025-12-02/image/78ac71d9-662b-4492-aec6-874b99493aac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997115?view=catalogue)
2025-12-02 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71XJE/2025-12-01/image/6cfc4400-f3ec-4980-b2e2-9bb7e0150589_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544110?view=catalogue)
2025-12-02 19:05:01 [astonbarclay.gb] INFO: Found listing with ID: 116699888
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699888%27 HTTP/1.1" 200 None
2025-12-02 19:05:01 [astonbarclay.gb] INFO: Scrape type for 116699888: 2
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252F877d51bf-37ae-4779-887b-61362789eee9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/877d51bf-37ae-4779-887b-61362789eee9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116833978?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c6cb90>
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252Fa80b26ac-2436-46af-b53d-d45826aa370b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/a80b26ac-2436-46af-b53d-d45826aa370b_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b71d56d-b899-5c31-8a4e-958243c973ff
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c9450>
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F4e37d971-4d04-4481-b1b7-5191a3f080d3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4e37d971-4d04-4481-b1b7-5191a3f080d3_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0419ba6-0eec-506d-939b-06b572dc0b26
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08d0610>
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F16b75115-5f00-4202-99c3-1b2b4f11addb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/16b75115-5f00-4202-99c3-1b2b4f11addb_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0419ba6-0eec-506d-939b-06b572dc0b26
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08cbe10>
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F2e0fd6e0-5dce-4453-9eb5-7c5922324e30_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/2e0fd6e0-5dce-4453-9eb5-7c5922324e30_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c8150>
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252Fe98b47d5-21a0-4a09-bf93-3a112718d416_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e98b47d5-21a0-4a09-bf93-3a112718d416_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0817fd0>
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252Fd82ae84a-96e6-49e9-b67f-178cd118ba69_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/d82ae84a-96e6-49e9-b67f-178cd118ba69_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0419ba6-0eec-506d-939b-06b572dc0b26
2025-12-02 19:05:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116859206, 'registration': 'VO70YEC', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS DIESEL ESTATE', 'derivative': '1.6 TDI SE 5dr DSG', 'mileage': 142303, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-11-23', 'fuel': 'Diesel', 'motExpiry': '2025-12-14', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VO70YEC/2025-11-27/image/a0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/f17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/cb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/ec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/db31c692-139c-4873-ade5-932ac328f731_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**870**VOSA STATES 81K, 110K, 142K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/68dcafba-18f1-4a88-bce0-39c67ee065cd.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116859206, 'registration': 'VO70YEC', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS DIESEL ESTATE', 'derivative': '1.6 TDI SE 5dr DSG', 'mileage': 142303, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-11-23', 'fuel': 'Diesel', 'motExpiry': '2025-12-14', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VO70YEC/2025-11-27/image/a0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/f17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/cb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/ec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/db31c692-139c-4873-ade5-932ac328f731_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**870**VOSA STATES 81K, 110K, 142K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/68dcafba-18f1-4a88-bce0-39c67ee065cd.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c05dfe48-04df-50d0-bcd0-70853b464265 with identifier: 116859206
2025-12-02 19:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c05dfe48-04df-50d0-bcd0-70853b464265 with scrape type 1
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item c05dfe48-04df-50d0-bcd0-70853b464265
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252Fa0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/a0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117410407, 'registration': 'NJ71VMZ', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 84820, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-21', 'fuel': 'Electric', 'motExpiry': '2026-08-01', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/493c1363-c3fe-434f-9a58-941fbc735988_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/d95fc9a2-ea9e-466c-a755-37d4fe231ca1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/023c1415-32b1-4687-b756-d22179792078_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/30031c29-b09e-4ddb-ad62-6c1039b58d68_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/a49c3110-2c2b-4997-917f-8b093624393c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/423a81b8-c4f0-40c3-8316-5becabc400bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/57ab575b-2b38-4e96-95d3-1ccf8a93df15_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/dc90d459-73a8-4afe-bd2c-bfc65f5081a9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 59K, 76K, \t Solid Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ea3d0f77-9afa-49aa-8eb7-fe326bf46be7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117410407, 'registration': 'NJ71VMZ', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 84820, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-21', 'fuel': 'Electric', 'motExpiry': '2026-08-01', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/493c1363-c3fe-434f-9a58-941fbc735988_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/d95fc9a2-ea9e-466c-a755-37d4fe231ca1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/023c1415-32b1-4687-b756-d22179792078_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/30031c29-b09e-4ddb-ad62-6c1039b58d68_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/a49c3110-2c2b-4997-917f-8b093624393c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/423a81b8-c4f0-40c3-8316-5becabc400bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/57ab575b-2b38-4e96-95d3-1ccf8a93df15_removebg.jpg?w=600', 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/dc90d459-73a8-4afe-bd2c-bfc65f5081a9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 59K, 76K, \t Solid Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ea3d0f77-9afa-49aa-8eb7-fe326bf46be7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7 with identifier: 117410407
2025-12-02 19:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7 with scrape type 1
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252F493c1363-c3fe-434f-9a58-941fbc735988_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/493c1363-c3fe-434f-9a58-941fbc735988_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117590494, 'registration': 'LD71FXV', 'account': 'ZEN002', 'make': 'FORD', 'model': 'MUSTANG MACH-E ESTATE', 'derivative': '198kW Standard Range 68kWh RWD 5dr Auto', 'mileage': 41206, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-30', 'fuel': 'Electric', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LD71FXV/2025-11-28/image/3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/e08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/a3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/cc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/d14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/25 - 40K', 'remarks': '**1498**VOSA STATES 28K, 37K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3e4000f-debb-4169-8240-654f8fb5bff8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117590494, 'registration': 'LD71FXV', 'account': 'ZEN002', 'make': 'FORD', 'model': 'MUSTANG MACH-E ESTATE', 'derivative': '198kW Standard Range 68kWh RWD 5dr Auto', 'mileage': 41206, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-30', 'fuel': 'Electric', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LD71FXV/2025-11-28/image/3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/e08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/a3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/cc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/d14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/25 - 40K', 'remarks': '**1498**VOSA STATES 28K, 37K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3e4000f-debb-4169-8240-654f8fb5bff8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be9d4895-6ef7-5e03-84b2-90915f3aff98 with identifier: 117590494
2025-12-02 19:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be9d4895-6ef7-5e03-84b2-90915f3aff98 with scrape type 1
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be9d4895-6ef7-5e03-84b2-90915f3aff98
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE70HBP/2025-12-01/image/407761c4-dd58-4a76-b77b-57398b4e4594_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103769?view=catalogue)
2025-12-02 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117417496
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117417496%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117417496: 1
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252F8ee385b5-cf6e-4c21-94ec-8f19c1a9b4e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/8ee385b5-cf6e-4c21-94ec-8f19c1a9b4e7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TMU/2025-12-01/image/8b656dc8-3a27-49f6-839a-106a97530aab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue)
2025-12-02 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71NFX/2025-12-02/image/2dd0734d-84c1-4040-80e6-d0b023d064f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997115?view=catalogue)
2025-12-02 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/bb97c163-900c-4bf6-b5dc-bf4c8c77b209_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue)
2025-12-02 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4841806e-1560-4f08-9331-0b95d98c0ec2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997115?view=catalogue)
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252F69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252Fd95fc9a2-ea9e-466c-a755-37d4fe231ca1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/d95fc9a2-ea9e-466c-a755-37d4fe231ca1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252Fe08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/e08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF71HVO/2025-12-02/image/d6324c42-5365-4338-82e1-5bb3a22788e0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508326?view=catalogue)
2025-12-02 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117447701
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447701%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117447701: 1
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252Fcfcd1567-3674-4f57-a6f9-4aaab87f4e39_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/cfcd1567-3674-4f57-a6f9-4aaab87f4e39_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117597727?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252Ff17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/f17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252F023c1415-32b1-4687-b756-d22179792078_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/023c1415-32b1-4687-b756-d22179792078_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03188d0>
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F669870e6-6a05-439e-9791-2cf710919fd4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/669870e6-6a05-439e-9791-2cf710919fd4_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0490a10>
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F78ac71d9-662b-4492-aec6-874b99493aac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/78ac71d9-662b-4492-aec6-874b99493aac_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0419ba6-0eec-506d-939b-06b572dc0b26
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f32490>
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71XJE%252F2025-12-01%252Fimage%252F6cfc4400-f3ec-4980-b2e2-9bb7e0150589_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71XJE/2025-12-01/image/6cfc4400-f3ec-4980-b2e2-9bb7e0150589_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 878cacd3-23a7-58d3-ba66-bbbefc642c43
2025-12-02 19:05:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 878cacd3-23a7-58d3-ba66-bbbefc642c43, skipping ID generation
2025-12-02 19:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 878cacd3-23a7-58d3-ba66-bbbefc642c43 with scrape type 1
2025-12-02 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 878cacd3-23a7-58d3-ba66-bbbefc642c43 from tracking dictionaries
2025-12-02 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 878cacd3-23a7-58d3-ba66-bbbefc642c43 sending to next pipeline
2025-12-02 19:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 878cacd3-23a7-58d3-ba66-bbbefc642c43, identifier: 117544110
2025-12-02 19:05:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116833978, 'registration': 'KN73YJB', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'LEON ESTATE', 'derivative': '1.4 eHybrid VZ2 5dr DSG', 'mileage': 9002, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-10-20', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116833978, 'registration': 'KN73YJB', 'account': 'ZEN002', 'make': 'CUPRA', 'model': 'LEON ESTATE', 'derivative': '1.4 eHybrid VZ2 5dr DSG', 'mileage': 9002, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-10-20', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50dd6d79-9904-52ac-8d37-0199692dab2a with identifier: 116833978
2025-12-02 19:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50dd6d79-9904-52ac-8d37-0199692dab2a with scrape type 1
2025-12-02 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 50dd6d79-9904-52ac-8d37-0199692dab2a
2025-12-02 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 50dd6d79-9904-52ac-8d37-0199692dab2a
2025-12-02 19:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 50dd6d79-9904-52ac-8d37-0199692dab2a, identifier: 116833978
2025-12-02 19:05:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117549752, 'registration': 'YG20TKY', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e M Sport 4dr Auto', 'mileage': 118021, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-03-08', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YG20TKY/2025-12-01/image/9a73c87c-bed8-4576-a41f-f1d4d491a281_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/ac6492bf-9d6e-4cb4-8ae3-c33322e893b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/1cfc8608-ac3e-4fdc-ac2a-7954a0c7bddb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/34d7c4f7-4e78-46f4-bc89-2030849c0bfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/b77f7ba9-a36f-43e2-8d1e-738fc7bcb25d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/dc147456-f8dc-490c-9329-707be9b5b2e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/02843cc7-2ce0-416f-984e-e11be69626e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/455e72ec-2eeb-4ba4-9fe0-64a895efcbdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/811fe0f8-964f-4a89-ac5b-c2a1061d17a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/f9c3e0a6-c33a-4f0c-bf9b-8278e3f283e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/db4a8c0c-b52e-427e-a284-09be0daca296_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/96678bcc-df19-44fe-8aeb-4242196ef4ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/03dce60b-8f9f-4eff-8776-1fd5a7414cce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/8e4c409c-bce9-4e07-b52a-0b3d6fa98543_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 08/21 - 20K, 03/23 - 72K, 09/23 - 84K, 06/24 - 99K, 04/25 - 111K', 'remarks': '**878**CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': 'TF', 'co2': 38, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2ce93231-044b-4694-bbae-20f2853f55a6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117549752, 'registration': 'YG20TKY', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e M Sport 4dr Auto', 'mileage': 118021, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-03-08', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YG20TKY/2025-12-01/image/9a73c87c-bed8-4576-a41f-f1d4d491a281_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/ac6492bf-9d6e-4cb4-8ae3-c33322e893b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/1cfc8608-ac3e-4fdc-ac2a-7954a0c7bddb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/34d7c4f7-4e78-46f4-bc89-2030849c0bfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/b77f7ba9-a36f-43e2-8d1e-738fc7bcb25d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/dc147456-f8dc-490c-9329-707be9b5b2e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/02843cc7-2ce0-416f-984e-e11be69626e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/455e72ec-2eeb-4ba4-9fe0-64a895efcbdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/811fe0f8-964f-4a89-ac5b-c2a1061d17a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/f9c3e0a6-c33a-4f0c-bf9b-8278e3f283e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/db4a8c0c-b52e-427e-a284-09be0daca296_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/96678bcc-df19-44fe-8aeb-4242196ef4ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/03dce60b-8f9f-4eff-8776-1fd5a7414cce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/8e4c409c-bce9-4e07-b52a-0b3d6fa98543_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 08/21 - 20K, 03/23 - 72K, 09/23 - 84K, 06/24 - 99K, 04/25 - 111K', 'remarks': '**878**CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': 'TF', 'co2': 38, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2ce93231-044b-4694-bbae-20f2853f55a6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1314f952-262f-57cb-ab7a-86b3d7339e20 with identifier: 117549752
2025-12-02 19:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1314f952-262f-57cb-ab7a-86b3d7339e20 with scrape type 1
2025-12-02 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F9a73c87c-bed8-4576-a41f-f1d4d491a281_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/9a73c87c-bed8-4576-a41f-f1d4d491a281_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:04 [astonbarclay.gb] INFO: Found listing with ID: 117549690
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549690%27 HTTP/1.1" 200 None
2025-12-02 19:05:04 [astonbarclay.gb] INFO: Scrape type for 117549690: 1
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252F43ec6dc9-12ea-4dcd-9edf-d0d8d0770214_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/43ec6dc9-12ea-4dcd-9edf-d0d8d0770214_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 878cacd3-23a7-58d3-ba66-bbbefc642c43 with identifier: 117544110
2025-12-02 19:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 878cacd3-23a7-58d3-ba66-bbbefc642c43 with identifier: 117544110
2025-12-02 19:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 878cacd3-23a7-58d3-ba66-bbbefc642c43 with identifier: 117544110 to the API
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FV71XJE/2025-12-01/image/6cfc4400-f3ec-4980-b2e2-9bb7e0150589_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '878cacd3-23a7-58d3-ba66-bbbefc642c43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FV71XJE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117544110',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA COUPE',
 'odometer': 92591,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 19519,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/7dcb347e-dc58-4f3d-ab48-a373dbfc1145_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21164,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/6cfc4400-f3ec-4980-b2e2-9bb7e0150589_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23806,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/f0bc9e03-71eb-42ab-8110-816bdfb755f2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21906,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/4223b44e-905d-415f-bbe3-3e2719f9325a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38400,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/e401d086-16d8-40e9-863b-5093ffd754a9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52175,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/b2b93608-d060-4897-a72e-55ef456a8e6f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28479,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/1f6993d5-c94b-4cbc-99f2-13f1f7579043_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41047,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/bb1619b3-5771-4f4c-ad48-f2c309a07ef5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_878cacd3-23a7-58d3-ba66-bbbefc642c43/878cacd3-23a7-58d3-ba66-bbbefc642c43_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40348,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/FV71XJE/2025-12-01/image/a4c514bf-30b0-4166-ad66-cc0cbf76633c_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seller_name': 'Zenith',
 'title': 'MERCEDES-BENZ CLA COUPE CLA 250e AMG Line Premium Plus 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 250e AMG Line Premium Plus 4dr Tip Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544110%27 HTTP/1.1" 200 None
2025-12-02 19:05:04 [astonbarclay.gb] INFO: Saving data for 117544110: {'created_time': 1764702304.734499, 'last_price_update_time': 1764702304.734508, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117544110') HTTP/1.1" 204 0
2025-12-02 19:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 50dd6d79-9904-52ac-8d37-0199692dab2a with identifier: 116833978
2025-12-02 19:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 50dd6d79-9904-52ac-8d37-0199692dab2a with identifier: 116833978
2025-12-02 19:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 50dd6d79-9904-52ac-8d37-0199692dab2a with identifier: 116833978 to the API
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2750dd6d79-9904-52ac-8d37-0199692dab2a%27 HTTP/1.1" 200 None
2025-12-02 19:05:05 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 50dd6d79-9904-52ac-8d37-0199692dab2a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:05:04 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116833978?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '50dd6d79-9904-52ac-8d37-0199692dab2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KN73YJB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116833978',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'CUPRA',
 'model': 'LEON ESTATE',
 'odometer': 9002,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-20',
 'seller_name': 'Zenith',
 'title': 'CUPRA LEON ESTATE 1.4 eHybrid VZ2 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 eHybrid VZ2 5dr DSG',
 'vin': None,
 'year': 2023}
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116833978%27 HTTP/1.1" 200 None
2025-12-02 19:05:05 [astonbarclay.gb] INFO: Saving data for 116833978: {'created_time': 1764702305.087489, 'last_price_update_time': 1764702305.087499, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116833978') HTTP/1.1" 204 0
2025-12-02 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/493c1363-c3fe-434f-9a58-941fbc735988_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117410407?view=catalogue)
2025-12-02 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO70YEC/2025-11-27/image/a0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116859206?view=catalogue)
2025-12-02 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71FXV/2025-11-28/image/3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590494?view=catalogue)
2025-12-02 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF71HVO/2025-12-02/image/877d51bf-37ae-4779-887b-61362789eee9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508326?view=catalogue)
2025-12-02 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71NFX/2025-12-02/image/5e41864e-0da3-40fe-88cb-430a4d510481_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997115?view=catalogue)
2025-12-02 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e941e187-f286-4a87-8235-d3a2660fb856_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252F69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252F30031c29-b09e-4ddb-ad62-6c1039b58d68_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/30031c29-b09e-4ddb-ad62-6c1039b58d68_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252Fac6492bf-9d6e-4cb4-8ae3-c33322e893b6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/ac6492bf-9d6e-4cb4-8ae3-c33322e893b6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF71HVO/2025-12-02/image/8ee385b5-cf6e-4c21-94ec-8f19c1a9b4e7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508326?view=catalogue)
2025-12-02 19:05:05 [astonbarclay.gb] INFO: Found listing with ID: 117524612
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117524612%27 HTTP/1.1" 200 None
2025-12-02 19:05:05 [astonbarclay.gb] INFO: Scrape type for 117524612: 1
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252F15e417da-1c54-4986-acba-d7628ef7a179_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/15e417da-1c54-4986-acba-d7628ef7a179_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117029988?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117420890?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116914684?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117561425?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ff2e50>
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE70HBP%252F2025-12-01%252Fimage%252F407761c4-dd58-4a76-b77b-57398b4e4594_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE70HBP/2025-12-01/image/407761c4-dd58-4a76-b77b-57398b4e4594_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b71d56d-b899-5c31-8a4e-958243c973ff
2025-12-02 19:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b71d56d-b899-5c31-8a4e-958243c973ff, skipping ID generation
2025-12-02 19:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b71d56d-b899-5c31-8a4e-958243c973ff with scrape type 1
2025-12-02 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4b71d56d-b899-5c31-8a4e-958243c973ff from tracking dictionaries
2025-12-02 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b71d56d-b899-5c31-8a4e-958243c973ff sending to next pipeline
2025-12-02 19:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4b71d56d-b899-5c31-8a4e-958243c973ff, identifier: 117103769
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf067e7d0>
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F8b656dc8-3a27-49f6-839a-106a97530aab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/8b656dc8-3a27-49f6-839a-106a97530aab_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0884fd0>
2025-12-02 19:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F2dd0734d-84c1-4040-80e6-d0b023d064f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/2dd0734d-84c1-4040-80e6-d0b023d064f9_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0419ba6-0eec-506d-939b-06b572dc0b26
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0955550>
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252Fbb97c163-900c-4bf6-b5dc-bf4c8c77b209_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/bb97c163-900c-4bf6-b5dc-bf4c8c77b209_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05085d0>
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F4841806e-1560-4f08-9331-0b95d98c0ec2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4841806e-1560-4f08-9331-0b95d98c0ec2_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0419ba6-0eec-506d-939b-06b572dc0b26
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0831250>
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252Fd6324c42-5365-4338-82e1-5bb3a22788e0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/d6324c42-5365-4338-82e1-5bb3a22788e0_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afc55445-065d-5656-a413-94c60897ffb6
2025-12-02 19:05:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117597727, 'registration': 'FV71SXU', 'account': 'ZEN002', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Sport 5dr [Comfort/Nav Pack]', 'mileage': 22874, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-11-29', 'fuel': 'Petrol', 'motExpiry': '2026-10-14', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FV71SXU/2025-11-28/image/22f75984-6a42-451d-ae5d-ed2b90b09c52_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/d0d41c1c-fbb5-4649-ac5e-c4c32b0b4cae_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/b5420aac-d50d-4345-b247-03ce6686a267_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/3dfcded2-b1ee-416a-bd1d-c85f029b7722_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/df2760f0-ca5f-4451-a91a-0817448f0694_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/2c047584-fadf-43b3-805d-13e4ccbba0db_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/18b777ce-5cd1-4ad4-8ed8-03faec9ec787_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/c66716c2-934e-45c8-9a32-7734c3817805_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/f1035b6b-1cd2-47fa-ae7b-fcad68ffbf91_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/56e9a1ef-527b-4293-9275-0fac359ae28e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24 - 11K, 11/24 - 16K, 03/25 - 18K', 'remarks': '**840**VOSA STATES 16K, 22K SPARE KEY Darkened Rear Glass\tDinamica/Leather\tMoonwalk Grey Panoramic Glass Sunroof', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d47e8f7e-d667-4e83-a61e-f72c155f7a36.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117597727, 'registration': 'FV71SXU', 'account': 'ZEN002', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Sport 5dr [Comfort/Nav Pack]', 'mileage': 22874, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-11-29', 'fuel': 'Petrol', 'motExpiry': '2026-10-14', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FV71SXU/2025-11-28/image/22f75984-6a42-451d-ae5d-ed2b90b09c52_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/d0d41c1c-fbb5-4649-ac5e-c4c32b0b4cae_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/b5420aac-d50d-4345-b247-03ce6686a267_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/3dfcded2-b1ee-416a-bd1d-c85f029b7722_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/df2760f0-ca5f-4451-a91a-0817448f0694_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/2c047584-fadf-43b3-805d-13e4ccbba0db_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/18b777ce-5cd1-4ad4-8ed8-03faec9ec787_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/c66716c2-934e-45c8-9a32-7734c3817805_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/f1035b6b-1cd2-47fa-ae7b-fcad68ffbf91_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/56e9a1ef-527b-4293-9275-0fac359ae28e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24 - 11K, 11/24 - 16K, 03/25 - 18K', 'remarks': '**840**VOSA STATES 16K, 22K SPARE KEY Darkened Rear Glass\tDinamica/Leather\tMoonwalk Grey Panoramic Glass Sunroof', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d47e8f7e-d667-4e83-a61e-f72c155f7a36.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f3219e-41c9-557e-aed5-2984165bb017 with identifier: 117597727
2025-12-02 19:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f3219e-41c9-557e-aed5-2984165bb017 with scrape type 1
2025-12-02 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89f3219e-41c9-557e-aed5-2984165bb017
2025-12-02 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252F22f75984-6a42-451d-ae5d-ed2b90b09c52_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/22f75984-6a42-451d-ae5d-ed2b90b09c52_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:07 [scrapy.extensions.logstats] INFO: Crawled 236 pages (at 42 pages/min), scraped 139 items (at 20 items/min)
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252Fcb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/cb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252Fa49c3110-2c2b-4997-917f-8b093624393c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/a49c3110-2c2b-4997-917f-8b093624393c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252Fa3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/a3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F1cfc8608-ac3e-4fdc-ac2a-7954a0c7bddb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/1cfc8608-ac3e-4fdc-ac2a-7954a0c7bddb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4b71d56d-b899-5c31-8a4e-958243c973ff with identifier: 117103769
2025-12-02 19:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4b71d56d-b899-5c31-8a4e-958243c973ff with identifier: 117103769
2025-12-02 19:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4b71d56d-b899-5c31-8a4e-958243c973ff with identifier: 117103769 to the API
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YE70HBP/2025-12-01/image/407761c4-dd58-4a76-b77b-57398b4e4594_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '4b71d56d-b899-5c31-8a4e-958243c973ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YE70HBP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117103769',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TOYOTA',
 'model': 'COROLLA TOURING SPORT',
 'odometer': 42150,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31350,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/f7740209-e37c-4723-a393-e43f10960b12_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30871,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/407761c4-dd58-4a76-b77b-57398b4e4594_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31017,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/a80b26ac-2436-46af-b53d-d45826aa370b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31739,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/576e828c-ddcf-487d-88ed-8b637b2ee4a1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40473,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/4ad99170-df7d-4157-8f20-67a40b25b95a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51244,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/40b347db-ca9a-453f-bce7-164d75610ce4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40894,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6cfc72d3-1d08-48b3-8205-73df8e8a6f92_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45003,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/6c27f15c-d00a-4607-83e4-33f4c51854ad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b71d56d-b899-5c31-8a4e-958243c973ff/4b71d56d-b899-5c31-8a4e-958243c973ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44780,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YE70HBP/2025-12-01/image/253b78c4-2040-4e04-bd73-ee703829fe1d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-30',
 'seller_name': 'Zenith',
 'title': 'TOYOTA COROLLA TOURING SPORT 2.0 VVT-i Hybrid Design 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.0 VVT-i Hybrid Design 5dr CVT',
 'vin': None,
 'year': 2020}
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103769%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [astonbarclay.gb] INFO: Saving data for 117103769: {'created_time': 1764702307.449346, 'last_price_update_time': 1764702307.449356, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117103769') HTTP/1.1" 204 0
2025-12-02 19:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71FXV/2025-11-28/image/e08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590494?view=catalogue)
2025-12-02 19:05:07 [astonbarclay.gb] INFO: Found listing with ID: 117133968
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117133968%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [astonbarclay.gb] INFO: Scrape type for 117133968: 1
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252F90d87e9d-8236-4a73-a528-944ec02675a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/90d87e9d-8236-4a73-a528-944ec02675a4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252Fd0d41c1c-fbb5-4649-ac5e-c4c32b0b4cae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/d0d41c1c-fbb5-4649-ac5e-c4c32b0b4cae_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252F27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252F423a81b8-c4f0-40c3-8316-5becabc400bd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/423a81b8-c4f0-40c3-8316-5becabc400bd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252Fcc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/cc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F34d7c4f7-4e78-46f4-bc89-2030849c0bfc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/34d7c4f7-4e78-46f4-bc89-2030849c0bfc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117581526?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0957850>
2025-12-02 19:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252F493c1363-c3fe-434f-9a58-941fbc735988_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/493c1363-c3fe-434f-9a58-941fbc735988_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7
2025-12-02 19:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0605110>
2025-12-02 19:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252Fa0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/a0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c05dfe48-04df-50d0-bcd0-70853b464265
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07e47d0>
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be9d4895-6ef7-5e03-84b2-90915f3aff98
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0926b10>
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252F877d51bf-37ae-4779-887b-61362789eee9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/877d51bf-37ae-4779-887b-61362789eee9_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afc55445-065d-5656-a413-94c60897ffb6
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07e4e10>
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71NFX%252F2025-12-02%252Fimage%252F5e41864e-0da3-40fe-88cb-430a4d510481_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71NFX/2025-12-02/image/5e41864e-0da3-40fe-88cb-430a4d510481_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0419ba6-0eec-506d-939b-06b572dc0b26
2025-12-02 19:05:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0419ba6-0eec-506d-939b-06b572dc0b26, skipping ID generation
2025-12-02 19:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0419ba6-0eec-506d-939b-06b572dc0b26 with scrape type 1
2025-12-02 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d0419ba6-0eec-506d-939b-06b572dc0b26 from tracking dictionaries
2025-12-02 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0419ba6-0eec-506d-939b-06b572dc0b26 sending to next pipeline
2025-12-02 19:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d0419ba6-0eec-506d-939b-06b572dc0b26, identifier: 116997115
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03e95d0>
2025-12-02 19:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252Fe941e187-f286-4a87-8235-d3a2660fb856_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e941e187-f286-4a87-8235-d3a2660fb856_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f18510>
2025-12-02 19:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252F8ee385b5-cf6e-4c21-94ec-8f19c1a9b4e7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/8ee385b5-cf6e-4c21-94ec-8f19c1a9b4e7_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afc55445-065d-5656-a413-94c60897ffb6
2025-12-02 19:05:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117029988, 'registration': 'BT70SXH', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 50677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-12-10', 'fuel': 'Electric', 'motExpiry': '2025-12-09', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/BT70SXH/2025-12-02/image/38023e97-8d65-47a8-8cbe-7f29a7d71287_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/ce6be574-abe7-4865-956c-fb968740663b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/4070dd86-218e-40f0-b558-af7f716f3cfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/74e4b84f-d268-4f78-9e2c-06f50c8747bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/a0bdd61a-2454-44f0-8657-d8c4db753874_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/9c6e4765-7f21-4593-92b9-78a0bd612e5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/5ef265e1-a0ed-4775-a404-09cb28a8597b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/1a06f0a2-c655-4eba-a158-18a3d0e962ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/c715e370-046f-4a1e-8be0-ed42422fab81_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**854**VOSA STATES 27K, 41K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dd9cdc71-9862-4c42-b767-217a09069187.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117029988, 'registration': 'BT70SXH', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 50677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-12-10', 'fuel': 'Electric', 'motExpiry': '2025-12-09', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/BT70SXH/2025-12-02/image/38023e97-8d65-47a8-8cbe-7f29a7d71287_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/ce6be574-abe7-4865-956c-fb968740663b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/4070dd86-218e-40f0-b558-af7f716f3cfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/74e4b84f-d268-4f78-9e2c-06f50c8747bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/a0bdd61a-2454-44f0-8657-d8c4db753874_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/9c6e4765-7f21-4593-92b9-78a0bd612e5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/5ef265e1-a0ed-4775-a404-09cb28a8597b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/1a06f0a2-c655-4eba-a158-18a3d0e962ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/c715e370-046f-4a1e-8be0-ed42422fab81_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**854**VOSA STATES 27K, 41K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dd9cdc71-9862-4c42-b767-217a09069187.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0df80b6a-6c89-5fb4-8531-6651333b469d with identifier: 117029988
2025-12-02 19:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0df80b6a-6c89-5fb4-8531-6651333b469d with scrape type 1
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 0df80b6a-6c89-5fb4-8531-6651333b469d
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F38023e97-8d65-47a8-8cbe-7f29a7d71287_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/38023e97-8d65-47a8-8cbe-7f29a7d71287_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117420890, 'registration': 'PO71WUB', 'account': 'DAY005', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK SPECIAL EDITIONS', 'derivative': 'A250e AMG Line Premium Edition 5dr Auto', 'mileage': 107711, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-22', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-12', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 81K 104K,', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117420890, 'registration': 'PO71WUB', 'account': 'DAY005', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK SPECIAL EDITIONS', 'derivative': 'A250e AMG Line Premium Edition 5dr Auto', 'mileage': 107711, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-22', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-12', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 81K 104K,', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88a81fef-eb3e-52a4-9eb6-b50d0d105cff with identifier: 117420890
2025-12-02 19:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88a81fef-eb3e-52a4-9eb6-b50d0d105cff with scrape type 1
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 88a81fef-eb3e-52a4-9eb6-b50d0d105cff
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 88a81fef-eb3e-52a4-9eb6-b50d0d105cff
2025-12-02 19:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 88a81fef-eb3e-52a4-9eb6-b50d0d105cff, identifier: 117420890
2025-12-02 19:05:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116914684, 'registration': 'RE22DFA', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 38212, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-12', 'fuel': 'Diesel', 'motExpiry': '2026-03-12', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22DFA/2025-11-27/image/a57b5c30-e306-4470-9621-7b348218af13_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/957e5d95-7a1c-49e2-8289-b74704c463ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/f11ce8c2-1361-42c5-b2d2-27c5d913a683_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/b664670c-bb49-434b-982a-8531ae3ca926_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/e48459ff-cfa0-40b9-b813-10589b75d9ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/669ef9f4-41b0-4c82-99c7-c07d23aa59a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/f625b9a3-5b2f-44e6-aa8b-f58c09287490_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/172d3fd6-1756-45f8-859f-15f6eccdd08f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/fcb6e96f-d6df-45b7-a0d3-b43759327331_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'NO SERVICE HISTORY', 'remarks': '**245**VOSA STATES 33K  SPARE KEY - / Maze cloth - Soul', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/01e8b16e-016f-41c9-b656-1b86ebb54e2f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116914684, 'registration': 'RE22DFA', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 38212, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-12', 'fuel': 'Diesel', 'motExpiry': '2026-03-12', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22DFA/2025-11-27/image/a57b5c30-e306-4470-9621-7b348218af13_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/957e5d95-7a1c-49e2-8289-b74704c463ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/f11ce8c2-1361-42c5-b2d2-27c5d913a683_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/b664670c-bb49-434b-982a-8531ae3ca926_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/e48459ff-cfa0-40b9-b813-10589b75d9ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/669ef9f4-41b0-4c82-99c7-c07d23aa59a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/f625b9a3-5b2f-44e6-aa8b-f58c09287490_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/172d3fd6-1756-45f8-859f-15f6eccdd08f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/fcb6e96f-d6df-45b7-a0d3-b43759327331_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'NO SERVICE HISTORY', 'remarks': '**245**VOSA STATES 33K  SPARE KEY - / Maze cloth - Soul', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/01e8b16e-016f-41c9-b656-1b86ebb54e2f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with identifier: 116914684
2025-12-02 19:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with scrape type 2
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with scrape type 2
2025-12-02 19:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7fad7b0a-8338-5d85-9ce6-cf257ecafd43, identifier: 116914684
2025-12-02 19:05:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117561425, 'registration': 'FD72LHT', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [136] M Sport 5dr Step Auto [LCP]', 'mileage': 44244, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FD72LHT/2025-11-27/image/48456945-f37f-4695-b02d-02aac3f5bd85_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/11ad892c-59e5-41ac-9e49-1b0d036b7853_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/e707046c-05eb-4c43-8577-3b5ef5a68593_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/eb726f50-78e4-4030-a92c-eabae3506079_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/0cdbae31-29ce-430d-b5a2-962486336015_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/2ba9c46b-7515-4e02-8435-6c00b992d1d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/d5aeb795-d29d-4efe-95ce-2fcfebb18aa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/affd54ad-a60b-4394-983c-c6dd71d2a68d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/431b0595-1c7b-43da-8673-8ae777a89963_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/03e383a1-6f32-42b1-b15e-6610b3d35e84_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**946** SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/306f4ae2-57c7-49d4-8998-7054f8b90b9a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117561425, 'registration': 'FD72LHT', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [136] M Sport 5dr Step Auto [LCP]', 'mileage': 44244, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FD72LHT/2025-11-27/image/48456945-f37f-4695-b02d-02aac3f5bd85_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/11ad892c-59e5-41ac-9e49-1b0d036b7853_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/e707046c-05eb-4c43-8577-3b5ef5a68593_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/eb726f50-78e4-4030-a92c-eabae3506079_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/0cdbae31-29ce-430d-b5a2-962486336015_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/2ba9c46b-7515-4e02-8435-6c00b992d1d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/d5aeb795-d29d-4efe-95ce-2fcfebb18aa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/affd54ad-a60b-4394-983c-c6dd71d2a68d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/431b0595-1c7b-43da-8673-8ae777a89963_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/03e383a1-6f32-42b1-b15e-6610b3d35e84_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**946** SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/306f4ae2-57c7-49d4-8998-7054f8b90b9a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77 with identifier: 117561425
2025-12-02 19:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77 with scrape type 1
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F48456945-f37f-4695-b02d-02aac3f5bd85_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/48456945-f37f-4695-b02d-02aac3f5bd85_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/9a73c87c-bed8-4576-a41f-f1d4d491a281_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/023c1415-32b1-4687-b756-d22179792078_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117410407?view=catalogue)
2025-12-02 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO70YEC/2025-11-27/image/f17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116859206?view=catalogue)
2025-12-02 19:05:09 [astonbarclay.gb] INFO: Found listing with ID: 117457056
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457056%27 HTTP/1.1" 200 None
2025-12-02 19:05:09 [astonbarclay.gb] INFO: Scrape type for 117457056: 1
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252Fc3911f7f-2693-468b-a529-406832ab98ab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/c3911f7f-2693-468b-a529-406832ab98ab_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252Fb5420aac-d50d-4345-b247-03ce6686a267_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/b5420aac-d50d-4345-b247-03ce6686a267_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d0419ba6-0eec-506d-939b-06b572dc0b26 with identifier: 116997115
2025-12-02 19:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d0419ba6-0eec-506d-939b-06b572dc0b26 with identifier: 116997115
2025-12-02 19:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d0419ba6-0eec-506d-939b-06b572dc0b26 with identifier: 116997115 to the API
2025-12-02 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YE71NFX/2025-12-02/image/5e41864e-0da3-40fe-88cb-430a4d510481_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'd0419ba6-0eec-506d-939b-06b572dc0b26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YE71NFX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116997115',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS ESTATE SPECIAL EDITION',
 'odometer': 32837,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28459,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/bca7a0a4-1779-4598-a29d-721155232997_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26148,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/dce62bcc-247d-41d8-a4a4-bded429bb689_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31328,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/16b75115-5f00-4202-99c3-1b2b4f11addb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30583,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4e37d971-4d04-4481-b1b7-5191a3f080d3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42341,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/d82ae84a-96e6-49e9-b67f-178cd118ba69_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64103,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/78ac71d9-662b-4492-aec6-874b99493aac_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50982,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/2dd0734d-84c1-4040-80e6-d0b023d064f9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34566,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/4841806e-1560-4f08-9331-0b95d98c0ec2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0419ba6-0eec-506d-939b-06b572dc0b26/d0419ba6-0eec-506d-939b-06b572dc0b26_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50032,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71NFX/2025-12-02/image/5e41864e-0da3-40fe-88cb-430a4d510481_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN T-CROSS ESTATE SPECIAL EDITION 1.0 TSI 110 Active 5dr '
          'DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI 110 Active 5dr DSG',
 'vin': None,
 'year': 2021}
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997115%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [astonbarclay.gb] INFO: Saving data for 116997115: {'created_time': 1764702310.132533, 'last_price_update_time': 1764702310.132544, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116997115') HTTP/1.1" 204 0
2025-12-02 19:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 88a81fef-eb3e-52a4-9eb6-b50d0d105cff with identifier: 117420890
2025-12-02 19:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 88a81fef-eb3e-52a4-9eb6-b50d0d105cff with identifier: 117420890
2025-12-02 19:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173343 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173343
2025-12-02 19:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 88a81fef-eb3e-52a4-9eb6-b50d0d105cff spider: astonbarclay.gb
2025-12-02 19:05:10 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 88a81fef-eb3e-52a4-9eb6-b50d0d105cff due to rule: high_mileage_for_country.json, error: 173343 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173343
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '88a81fef-eb3e-52a4-9eb6-b50d0d105cff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'PO71WUB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117420890',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK SPECIAL EDITIONS',
 'odometer': 107711,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seller_name': 'Days Fleet',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK SPECIAL EDITIONS A250e AMG Line '
          'Premium Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A250e AMG Line Premium Edition 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420890%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [astonbarclay.gb] INFO: Saving data for 117420890: {'created_time': 1764702310.439725, 'last_price_update_time': 1764702310.439737, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117420890') HTTP/1.1" 204 0
2025-12-02 19:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with identifier: 116914684
2025-12-02 19:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with identifier: 116914684
2025-12-02 19:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with identifier: 116914684 to the API
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116914684?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '7fad7b0a-8338-5d85-9ce6-cf257ecafd43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22DFA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116914684',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 38212,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-12',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116914684%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [astonbarclay.gb] INFO: Saving data for 116914684: {'auction_closing_time': 1764755100.0, 'created_time': 1762974213.491158, 'last_price_update_time': 1764702310.7715}
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116914684') HTTP/1.1" 204 0
2025-12-02 19:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71FXV/2025-11-28/image/6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590494?view=catalogue)
2025-12-02 19:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF71HVO/2025-12-02/image/cfcd1567-3674-4f57-a6f9-4aaab87f4e39_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508326?view=catalogue)
2025-12-02 19:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71FXV/2025-11-28/image/43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590494?view=catalogue)
2025-12-02 19:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF71HVO/2025-12-02/image/43ec6dc9-12ea-4dcd-9edf-d0d8d0770214_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508326?view=catalogue)
2025-12-02 19:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/ac6492bf-9d6e-4cb4-8ae3-c33322e893b6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252Fec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/ec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252F57ab575b-2b38-4e96-95d3-1ccf8a93df15_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/57ab575b-2b38-4e96-95d3-1ccf8a93df15_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252Fb77f7ba9-a36f-43e2-8d1e-738fc7bcb25d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/b77f7ba9-a36f-43e2-8d1e-738fc7bcb25d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252Fce6be574-abe7-4865-956c-fb968740663b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/ce6be574-abe7-4865-956c-fb968740663b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F11ad892c-59e5-41ac-9e49-1b0d036b7853_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/11ad892c-59e5-41ac-9e49-1b0d036b7853_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:10 [astonbarclay.gb] INFO: Found listing with ID: 115510423
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115510423%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [astonbarclay.gb] INFO: Scrape type for 115510423: 1
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252Fa7561868-2bf4-43e0-be00-aec50e17e106_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/a7561868-2bf4-43e0-be00-aec50e17e106_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252F3dfcded2-b1ee-416a-bd1d-c85f029b7722_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/3dfcded2-b1ee-416a-bd1d-c85f029b7722_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116699888?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252Fdb31c692-139c-4873-ade5-932ac328f731_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/db31c692-139c-4873-ade5-932ac328f731_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252Fdc90d459-73a8-4afe-bd2c-bfc65f5081a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/dc90d459-73a8-4afe-bd2c-bfc65f5081a9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252Fdc147456-f8dc-490c-9329-707be9b5b2e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/dc147456-f8dc-490c-9329-707be9b5b2e6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F4070dd86-218e-40f0-b558-af7f716f3cfa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/4070dd86-218e-40f0-b558-af7f716f3cfa_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252Fe707046c-05eb-4c43-8577-3b5ef5a68593_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/e707046c-05eb-4c43-8577-3b5ef5a68593_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71SXU/2025-11-28/image/22f75984-6a42-451d-ae5d-ed2b90b09c52_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117597727?view=catalogue)
2025-12-02 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/30031c29-b09e-4ddb-ad62-6c1039b58d68_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117410407?view=catalogue)
2025-12-02 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116859206?view=catalogue)
2025-12-02 19:05:11 [astonbarclay.gb] INFO: Found listing with ID: 117056567
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117056567%27 HTTP/1.1" 200 None
2025-12-02 19:05:11 [astonbarclay.gb] INFO: Scrape type for 117056567: 1
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252Fdf2760f0-ca5f-4451-a91a-0817448f0694_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/df2760f0-ca5f-4451-a91a-0817448f0694_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098b990>
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252Fe08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/e08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be9d4895-6ef7-5e03-84b2-90915f3aff98
2025-12-02 19:05:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117581526, 'registration': 'SM70DWN', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Standard Plus 4dr Auto', 'mileage': 93006, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-11-25', 'fuel': 'Electric', 'motExpiry': '2026-11-24', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/SM70DWN/2025-11-28/image/b02623c1-e3a5-4b1f-a246-6441d5d51bed_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/1c0faec5-5aa9-42b9-8543-53239a958418_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dd4fd636-f0b0-49c8-8bea-64329b091021_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/2263a198-db4f-4f11-9969-d483b2524413_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/516485e8-b8d3-450c-96f6-5540b3aa3fe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dbf1d95c-f538-4034-abcb-fe9307235024_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/227f1067-1a94-4f57-a988-212f1817b5f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/3a452693-8cf2-456e-9a95-902b6428e222_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/4dd6b837-5cdf-4b1c-88aa-f208703778c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/7961a629-b617-4d75-97d7-322ae1d42814_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 57K, 75K, 92K Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b677ec65-862b-4cb7-a907-88b0c2dc29fc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117581526, 'registration': 'SM70DWN', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Standard Plus 4dr Auto', 'mileage': 93006, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-11-25', 'fuel': 'Electric', 'motExpiry': '2026-11-24', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/SM70DWN/2025-11-28/image/b02623c1-e3a5-4b1f-a246-6441d5d51bed_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/1c0faec5-5aa9-42b9-8543-53239a958418_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dd4fd636-f0b0-49c8-8bea-64329b091021_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/2263a198-db4f-4f11-9969-d483b2524413_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/516485e8-b8d3-450c-96f6-5540b3aa3fe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dbf1d95c-f538-4034-abcb-fe9307235024_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/227f1067-1a94-4f57-a988-212f1817b5f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/3a452693-8cf2-456e-9a95-902b6428e222_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/4dd6b837-5cdf-4b1c-88aa-f208703778c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/7961a629-b617-4d75-97d7-322ae1d42814_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 57K, 75K, 92K Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b677ec65-862b-4cb7-a907-88b0c2dc29fc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9cee39f-7c30-52e4-ba1e-f50e0a0c5580 with identifier: 117581526
2025-12-02 19:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580 with scrape type 1
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252Fb02623c1-e3a5-4b1f-a246-6441d5d51bed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/b02623c1-e3a5-4b1f-a246-6441d5d51bed_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf220add0>
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F9a73c87c-bed8-4576-a41f-f1d4d491a281_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/9a73c87c-bed8-4576-a41f-f1d4d491a281_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0593890>
2025-12-02 19:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252F023c1415-32b1-4687-b756-d22179792078_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/023c1415-32b1-4687-b756-d22179792078_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf040dd90>
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252Ff17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/f17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c05dfe48-04df-50d0-bcd0-70853b464265
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0988fd0>
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be9d4895-6ef7-5e03-84b2-90915f3aff98
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf041f410>
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252Fcfcd1567-3674-4f57-a6f9-4aaab87f4e39_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/cfcd1567-3674-4f57-a6f9-4aaab87f4e39_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afc55445-065d-5656-a413-94c60897ffb6
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e6390>
2025-12-02 19:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be9d4895-6ef7-5e03-84b2-90915f3aff98
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf077dc50>
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252F43ec6dc9-12ea-4dcd-9edf-d0d8d0770214_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/43ec6dc9-12ea-4dcd-9edf-d0d8d0770214_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afc55445-065d-5656-a413-94c60897ffb6
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0609910>
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252Fac6492bf-9d6e-4cb4-8ae3-c33322e893b6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/ac6492bf-9d6e-4cb4-8ae3-c33322e893b6_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT70SXH/2025-12-02/image/38023e97-8d65-47a8-8cbe-7f29a7d71287_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117029988?view=catalogue)
2025-12-02 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/423a81b8-c4f0-40c3-8316-5becabc400bd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117410407?view=catalogue)
2025-12-02 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD72LHT/2025-11-27/image/48456945-f37f-4695-b02d-02aac3f5bd85_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561425?view=catalogue)
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252F0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252Fd14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/d14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F02843cc7-2ce0-416f-984e-e11be69626e2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/02843cc7-2ce0-416f-984e-e11be69626e2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F74e4b84f-d268-4f78-9e2c-06f50c8747bb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/74e4b84f-d268-4f78-9e2c-06f50c8747bb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252Feb726f50-78e4-4030-a92c-eabae3506079_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/eb726f50-78e4-4030-a92c-eabae3506079_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/34d7c4f7-4e78-46f4-bc89-2030849c0bfc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71FXV/2025-11-28/image/cc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590494?view=catalogue)
2025-12-02 19:05:13 [astonbarclay.gb] INFO: Found listing with ID: 117509758
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509758%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [astonbarclay.gb] INFO: Scrape type for 117509758: 1
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252F2c047584-fadf-43b3-805d-13e4ccbba0db_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/2c047584-fadf-43b3-805d-13e4ccbba0db_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F1c0faec5-5aa9-42b9-8543-53239a958418_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/1c0faec5-5aa9-42b9-8543-53239a958418_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117579914?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117549690?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO70YEC/2025-11-27/image/27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116859206?view=catalogue)
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F455e72ec-2eeb-4ba4-9fe0-64a895efcbdd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/455e72ec-2eeb-4ba4-9fe0-64a895efcbdd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252Fa0bdd61a-2454-44f0-8657-d8c4db753874_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/a0bdd61a-2454-44f0-8657-d8c4db753874_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F0cdbae31-29ce-430d-b5a2-962486336015_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/0cdbae31-29ce-430d-b5a2-962486336015_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117420349?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116699888, 'registration': 'RE22WNP', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 32940, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-06-22', 'fuel': 'Diesel', 'motExpiry': '2026-05-11', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22WNP/2025-10-28/image/916007dd-be17-4493-b2f5-3c115711448e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/0b075fd3-3bb0-467d-842a-f77b7a316ba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/d91d1c50-02db-4852-88e4-3b598f171096_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/726119c3-b5dd-4b6e-bd1f-297f3d5c0548_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/8e640a76-e20c-44a4-8cc4-588fa346d811_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/b5c08a57-84df-4bf1-abef-dbc0fa711a6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/4f16066a-3990-48e0-947a-cbe1878043c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/5dae9e3d-13ef-45d7-b566-a36f6a843814_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/f0049c9c-2616-4a2a-a094-47232b784ea7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**224**VOSA STATES 29K  SPARE KEY  / Maze cloth - Soul', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b823f515-24b7-40c5-9a25-0f11c300ca24.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116699888, 'registration': 'RE22WNP', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 32940, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-06-22', 'fuel': 'Diesel', 'motExpiry': '2026-05-11', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22WNP/2025-10-28/image/916007dd-be17-4493-b2f5-3c115711448e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/0b075fd3-3bb0-467d-842a-f77b7a316ba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/d91d1c50-02db-4852-88e4-3b598f171096_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/726119c3-b5dd-4b6e-bd1f-297f3d5c0548_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/8e640a76-e20c-44a4-8cc4-588fa346d811_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/b5c08a57-84df-4bf1-abef-dbc0fa711a6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/4f16066a-3990-48e0-947a-cbe1878043c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/5dae9e3d-13ef-45d7-b566-a36f6a843814_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/f0049c9c-2616-4a2a-a094-47232b784ea7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**224**VOSA STATES 29K  SPARE KEY  / Maze cloth - Soul', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b823f515-24b7-40c5-9a25-0f11c300ca24.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with identifier: 116699888
2025-12-02 19:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with scrape type 2
2025-12-02 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with scrape type 2
2025-12-02 19:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1290c6d4-7c99-57b8-b9f0-0c430eca5074, identifier: 116699888
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04b17d0>
2025-12-02 19:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252F22f75984-6a42-451d-ae5d-ed2b90b09c52_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/22f75984-6a42-451d-ae5d-ed2b90b09c52_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89f3219e-41c9-557e-aed5-2984165bb017
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf051ed50>
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252F30031c29-b09e-4ddb-ad62-6c1039b58d68_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/30031c29-b09e-4ddb-ad62-6c1039b58d68_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf039a0d0>
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252F69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c05dfe48-04df-50d0-bcd0-70853b464265
2025-12-02 19:05:14 [astonbarclay.gb] INFO: Found listing with ID: 117367108
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117367108%27 HTTP/1.1" 200 None
2025-12-02 19:05:14 [astonbarclay.gb] INFO: Scrape type for 117367108: 1
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252F18b777ce-5cd1-4ad4-8ed8-03faec9ec787_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/18b777ce-5cd1-4ad4-8ed8-03faec9ec787_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252Fdd4fd636-f0b0-49c8-8bea-64329b091021_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dd4fd636-f0b0-49c8-8bea-64329b091021_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with identifier: 116699888
2025-12-02 19:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with identifier: 116699888
2025-12-02 19:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with identifier: 116699888 to the API
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116699888?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '1290c6d4-7c99-57b8-b9f0-0c430eca5074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22WNP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116699888',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 32940,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699888%27 HTTP/1.1" 200 None
2025-12-02 19:05:14 [astonbarclay.gb] INFO: Saving data for 116699888: {'auction_closing_time': 1764755100.0, 'created_time': 1762283561.389731, 'last_price_update_time': 1764702314.938897}
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116699888') HTTP/1.1" 204 0
2025-12-02 19:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF71HVO/2025-12-02/image/90d87e9d-8236-4a73-a528-944ec02675a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508326?view=catalogue)
2025-12-02 19:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71SXU/2025-11-28/image/d0d41c1c-fbb5-4649-ac5e-c4c32b0b4cae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117597727?view=catalogue)
2025-12-02 19:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71SXU/2025-11-28/image/3dfcded2-b1ee-416a-bd1d-c85f029b7722_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117597727?view=catalogue)
2025-12-02 19:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF71HVO/2025-12-02/image/a7561868-2bf4-43e0-be00-aec50e17e106_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508326?view=catalogue)
2025-12-02 19:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD72LHT/2025-11-27/image/11ad892c-59e5-41ac-9e49-1b0d036b7853_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561425?view=catalogue)
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F811fe0f8-964f-4a89-ac5b-c2a1061d17a0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/811fe0f8-964f-4a89-ac5b-c2a1061d17a0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F9c6e4765-7f21-4593-92b9-78a0bd612e5d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/9c6e4765-7f21-4593-92b9-78a0bd612e5d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F2ba9c46b-7515-4e02-8435-6c00b992d1d6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/2ba9c46b-7515-4e02-8435-6c00b992d1d6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD72LHT/2025-11-27/image/e707046c-05eb-4c43-8577-3b5ef5a68593_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561425?view=catalogue)
2025-12-02 19:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT70SXH/2025-12-02/image/4070dd86-218e-40f0-b558-af7f716f3cfa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117029988?view=catalogue)
2025-12-02 19:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/dc147456-f8dc-490c-9329-707be9b5b2e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:05:15 [astonbarclay.gb] INFO: Found listing with ID: 117179358
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117179358%27 HTTP/1.1" 200 None
2025-12-02 19:05:15 [astonbarclay.gb] INFO: Scrape type for 117179358: 2
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252Fc66716c2-934e-45c8-9a32-7734c3817805_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/c66716c2-934e-45c8-9a32-7734c3817805_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F2263a198-db4f-4f11-9969-d483b2524413_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/2263a198-db4f-4f11-9969-d483b2524413_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0828810>
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F38023e97-8d65-47a8-8cbe-7f29a7d71287_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/38023e97-8d65-47a8-8cbe-7f29a7d71287_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0df80b6a-6c89-5fb4-8531-6651333b469d
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf082b4d0>
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252F423a81b8-c4f0-40c3-8316-5becabc400bd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/423a81b8-c4f0-40c3-8316-5becabc400bd_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04b2050>
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F48456945-f37f-4695-b02d-02aac3f5bd85_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/48456945-f37f-4695-b02d-02aac3f5bd85_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04b1850>
2025-12-02 19:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F34d7c4f7-4e78-46f4-bc89-2030849c0bfc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/34d7c4f7-4e78-46f4-bc89-2030849c0bfc_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09b8390>
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252Fcc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/cc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be9d4895-6ef7-5e03-84b2-90915f3aff98
2025-12-02 19:05:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117579914, 'registration': 'DF23LXW', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 23896, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23LXW/2025-12-02/image/0ff3bba3-e5e2-4512-a413-8ff0b7b0dba3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/71bd03dd-d648-4e0f-95b8-30ff07654a9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/d5ad4d21-fd23-4dd4-a9c2-e5b9182a19e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/57dae2ad-576e-47e8-b28a-488478197203_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/43390d82-b964-4c4d-9812-bb8bfe781c25_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/8008c348-29d8-4ae4-954a-a4af26dc5c57_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/78bd928e-3dbb-48e6-a4cd-4ca725d01287_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/da8b7304-540f-44c1-aad0-b72fba7596af_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/443f5993-4d2f-4eaf-85cc-6231014f93f0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10c2c44b-8244-41d6-914a-fd6d4c85bc70.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117579914, 'registration': 'DF23LXW', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 23896, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23LXW/2025-12-02/image/0ff3bba3-e5e2-4512-a413-8ff0b7b0dba3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/71bd03dd-d648-4e0f-95b8-30ff07654a9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/d5ad4d21-fd23-4dd4-a9c2-e5b9182a19e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/57dae2ad-576e-47e8-b28a-488478197203_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/43390d82-b964-4c4d-9812-bb8bfe781c25_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/8008c348-29d8-4ae4-954a-a4af26dc5c57_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/78bd928e-3dbb-48e6-a4cd-4ca725d01287_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/da8b7304-540f-44c1-aad0-b72fba7596af_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/443f5993-4d2f-4eaf-85cc-6231014f93f0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10c2c44b-8244-41d6-914a-fd6d4c85bc70.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb50dee-5647-5871-bb16-abf357e3da3b with identifier: 117579914
2025-12-02 19:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb50dee-5647-5871-bb16-abf357e3da3b with scrape type 1
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item cfb50dee-5647-5871-bb16-abf357e3da3b
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F0ff3bba3-e5e2-4512-a413-8ff0b7b0dba3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/0ff3bba3-e5e2-4512-a413-8ff0b7b0dba3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117549690, 'registration': 'LB71OMH', 'account': 'ZEN002', 'make': 'KIA', 'model': 'XCEED HATCHBACK', 'derivative': '1.6 GDi PHEV 3 5dr DCT', 'mileage': 45030, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-14', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-12-13', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB71OMH/2025-12-02/image/31dab96f-c8a9-4692-966b-dd89c398c6ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/0968e117-fc67-4aba-80b2-9ca570f349b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/f33fca43-2e07-4e31-b304-ea19212be4c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/4b7b82b6-667b-41aa-94f7-b47d65f3fa86_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/d83bd4c7-a79a-4a5b-ac74-db6231f12bb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e3d3cd61-9061-4707-bdc7-e31e59945cf0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/8c99c3de-ec5c-414f-86d5-dce77abdaa97_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e2f205c4-412a-46c4-ac3a-4d05e84c5bbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/7aeb1dde-44b0-46e6-a140-a8bb0462e324_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/72540e10-a07a-41b0-8c7e-970fcf91d31c_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/23 - 15K', 'remarks': '**907** VOSA STATES 33K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 32, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bfffbdf-7ca6-46ee-aa98-346f840e5724.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117549690, 'registration': 'LB71OMH', 'account': 'ZEN002', 'make': 'KIA', 'model': 'XCEED HATCHBACK', 'derivative': '1.6 GDi PHEV 3 5dr DCT', 'mileage': 45030, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-14', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-12-13', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB71OMH/2025-12-02/image/31dab96f-c8a9-4692-966b-dd89c398c6ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/0968e117-fc67-4aba-80b2-9ca570f349b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/f33fca43-2e07-4e31-b304-ea19212be4c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/4b7b82b6-667b-41aa-94f7-b47d65f3fa86_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/d83bd4c7-a79a-4a5b-ac74-db6231f12bb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e3d3cd61-9061-4707-bdc7-e31e59945cf0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/8c99c3de-ec5c-414f-86d5-dce77abdaa97_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e2f205c4-412a-46c4-ac3a-4d05e84c5bbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/7aeb1dde-44b0-46e6-a140-a8bb0462e324_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/72540e10-a07a-41b0-8c7e-970fcf91d31c_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/23 - 15K', 'remarks': '**907** VOSA STATES 33K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 32, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bfffbdf-7ca6-46ee-aa98-346f840e5724.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8a7bcf4-1577-51dd-bb26-6bcbaae8a449 with identifier: 117549690
2025-12-02 19:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449 with scrape type 1
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F31dab96f-c8a9-4692-966b-dd89c398c6ba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/31dab96f-c8a9-4692-966b-dd89c398c6ba_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf051b190>
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252F27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c05dfe48-04df-50d0-bcd0-70853b464265
2025-12-02 19:05:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117420349, 'registration': 'SJ71REU', 'account': 'DAY005', 'make': 'SKODA', 'model': 'OCTAVIA DIESEL ESTATE', 'derivative': '2.0 TDI 200 vRS 5dr DSG', 'mileage': 29862, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-11', 'fuel': 'Diesel', 'motExpiry': '2026-10-10', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 26K, 28K,', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117420349, 'registration': 'SJ71REU', 'account': 'DAY005', 'make': 'SKODA', 'model': 'OCTAVIA DIESEL ESTATE', 'derivative': '2.0 TDI 200 vRS 5dr DSG', 'mileage': 29862, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-11', 'fuel': 'Diesel', 'motExpiry': '2026-10-10', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 26K, 28K,', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35130928-f1bd-5940-8f02-6ba876e0effc with identifier: 117420349
2025-12-02 19:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35130928-f1bd-5940-8f02-6ba876e0effc with scrape type 1
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 35130928-f1bd-5940-8f02-6ba876e0effc
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 35130928-f1bd-5940-8f02-6ba876e0effc
2025-12-02 19:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 35130928-f1bd-5940-8f02-6ba876e0effc, identifier: 117420349
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252Ff9c3e0a6-c33a-4f0c-bf9b-8278e3f283e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/f9c3e0a6-c33a-4f0c-bf9b-8278e3f283e5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F5ef265e1-a0ed-4775-a404-09cb28a8597b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/5ef265e1-a0ed-4775-a404-09cb28a8597b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252Fd5aeb795-d29d-4efe-95ce-2fcfebb18aa8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/d5aeb795-d29d-4efe-95ce-2fcfebb18aa8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 35130928-f1bd-5940-8f02-6ba876e0effc with identifier: 117420349
2025-12-02 19:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 35130928-f1bd-5940-8f02-6ba876e0effc with identifier: 117420349
2025-12-02 19:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 35130928-f1bd-5940-8f02-6ba876e0effc with identifier: 117420349 to the API
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2735130928-f1bd-5940-8f02-6ba876e0effc%27 HTTP/1.1" 200 None
2025-12-02 19:05:17 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 35130928-f1bd-5940-8f02-6ba876e0effc: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:05:16 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117420349?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '35130928-f1bd-5940-8f02-6ba876e0effc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SJ71REU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117420349',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'SKODA',
 'model': 'OCTAVIA DIESEL ESTATE',
 'odometer': 29862,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seller_name': 'Days Fleet',
 'title': 'SKODA OCTAVIA DIESEL ESTATE 2.0 TDI 200 vRS 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI 200 vRS 5dr DSG',
 'vin': None,
 'year': 2021}
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420349%27 HTTP/1.1" 200 None
2025-12-02 19:05:17 [astonbarclay.gb] INFO: Saving data for 117420349: {'created_time': 1764702317.066627, 'last_price_update_time': 1764702317.066637, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117420349') HTTP/1.1" 204 0
2025-12-02 19:05:17 [astonbarclay.gb] INFO: Found listing with ID: 117442253
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442253%27 HTTP/1.1" 200 None
2025-12-02 19:05:17 [astonbarclay.gb] INFO: Scrape type for 117442253: 2
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252Ff1035b6b-1cd2-47fa-ae7b-fcad68ffbf91_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/f1035b6b-1cd2-47fa-ae7b-fcad68ffbf91_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F516485e8-b8d3-450c-96f6-5540b3aa3fe1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/516485e8-b8d3-450c-96f6-5540b3aa3fe1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F71bd03dd-d648-4e0f-95b8-30ff07654a9d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/71bd03dd-d648-4e0f-95b8-30ff07654a9d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F0968e117-fc67-4aba-80b2-9ca570f349b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/0968e117-fc67-4aba-80b2-9ca570f349b9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117133968?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115510423?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf032f8d0>
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252F90d87e9d-8236-4a73-a528-944ec02675a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/90d87e9d-8236-4a73-a528-944ec02675a4_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item afc55445-065d-5656-a413-94c60897ffb6
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf081cf90>
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252Fd0d41c1c-fbb5-4649-ac5e-c4c32b0b4cae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/d0d41c1c-fbb5-4649-ac5e-c4c32b0b4cae_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89f3219e-41c9-557e-aed5-2984165bb017
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02eed90>
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252F3dfcded2-b1ee-416a-bd1d-c85f029b7722_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/3dfcded2-b1ee-416a-bd1d-c85f029b7722_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89f3219e-41c9-557e-aed5-2984165bb017
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098f110>
2025-12-02 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252Fa7561868-2bf4-43e0-be00-aec50e17e106_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/a7561868-2bf4-43e0-be00-aec50e17e106_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item afc55445-065d-5656-a413-94c60897ffb6
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ef02d0>
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F11ad892c-59e5-41ac-9e49-1b0d036b7853_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/11ad892c-59e5-41ac-9e49-1b0d036b7853_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77
2025-12-02 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO70YEC/2025-11-27/image/0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116859206?view=catalogue)
2025-12-02 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT70SXH/2025-12-02/image/74e4b84f-d268-4f78-9e2c-06f50c8747bb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117029988?view=catalogue)
2025-12-02 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD72LHT/2025-11-27/image/eb726f50-78e4-4030-a92c-eabae3506079_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561425?view=catalogue)
2025-12-02 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71FXV/2025-11-28/image/d14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590494?view=catalogue)
2025-12-02 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SM70DWN/2025-11-28/image/1c0faec5-5aa9-42b9-8543-53239a958418_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117581526?view=catalogue)
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252Fdb4a8c0c-b52e-427e-a284-09be0daca296_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/db4a8c0c-b52e-427e-a284-09be0daca296_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F1a06f0a2-c655-4eba-a158-18a3d0e962ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/1a06f0a2-c655-4eba-a158-18a3d0e962ce_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252Faffd54ad-a60b-4394-983c-c6dd71d2a68d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/affd54ad-a60b-4394-983c-c6dd71d2a68d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07fc450>
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252Fe707046c-05eb-4c43-8577-3b5ef5a68593_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/e707046c-05eb-4c43-8577-3b5ef5a68593_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03e76d0>
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F4070dd86-218e-40f0-b558-af7f716f3cfa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/4070dd86-218e-40f0-b558-af7f716f3cfa_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0df80b6a-6c89-5fb4-8531-6651333b469d
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0761c10>
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252Fdc147456-f8dc-490c-9329-707be9b5b2e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/dc147456-f8dc-490c-9329-707be9b5b2e6_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/02843cc7-2ce0-416f-984e-e11be69626e2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dd4fd636-f0b0-49c8-8bea-64329b091021_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117581526?view=catalogue)
2025-12-02 19:05:18 [astonbarclay.gb] INFO: Found listing with ID: 117548617
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548617%27 HTTP/1.1" 200 None
2025-12-02 19:05:18 [astonbarclay.gb] INFO: Scrape type for 117548617: 2
2025-12-02 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252F56e9a1ef-527b-4293-9275-0fac359ae28e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/56e9a1ef-527b-4293-9275-0fac359ae28e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252Fdbf1d95c-f538-4034-abcb-fe9307235024_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dbf1d95c-f538-4034-abcb-fe9307235024_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252Fd5ad4d21-fd23-4dd4-a9c2-e5b9182a19e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/d5ad4d21-fd23-4dd4-a9c2-e5b9182a19e3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252Ff33fca43-2e07-4e31-b304-ea19212be4c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/f33fca43-2e07-4e31-b304-ea19212be4c4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71SXU/2025-11-28/image/18b777ce-5cd1-4ad4-8ed8-03faec9ec787_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117597727?view=catalogue)
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F96678bcc-df19-44fe-8aeb-4242196ef4ab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/96678bcc-df19-44fe-8aeb-4242196ef4ab_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252Fc715e370-046f-4a1e-8be0-ed42422fab81_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/c715e370-046f-4a1e-8be0-ed42422fab81_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F431b0595-1c7b-43da-8673-8ae777a89963_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/431b0595-1c7b-43da-8673-8ae777a89963_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117133968, 'registration': 'YE72BBX', 'account': 'ZEN009', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 21568, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-12-08', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YE72BBX/2025-12-02/image/af01cd5b-f2f8-4b01-abc4-59148156fff7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/412e088a-4ba8-4e82-a95a-1a8564417a1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/d7ab3cd3-54fa-408e-9ca9-d25272776b79_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/60a10af9-d549-4b39-aede-264358974905_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/9cb637a5-f120-4f14-b5f1-772f8a584fcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/3ea8d55b-ecf2-4313-8fed-a6b48c639154_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/621792c9-da7f-438c-aa03-c29f3826bb6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/fdde167c-a877-4f23-b2ad-4fe4b67b0c94_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/a8204dd1-567f-422f-8b61-d70637519b53_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/01 - 7K, 01/25 - 14K,', 'remarks': '**833** VOSA STATES 20K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/42a588be-9ba7-47ed-9f8a-e76ed28bc29f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117133968, 'registration': 'YE72BBX', 'account': 'ZEN009', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 21568, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-12-08', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YE72BBX/2025-12-02/image/af01cd5b-f2f8-4b01-abc4-59148156fff7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/412e088a-4ba8-4e82-a95a-1a8564417a1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/d7ab3cd3-54fa-408e-9ca9-d25272776b79_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/60a10af9-d549-4b39-aede-264358974905_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/9cb637a5-f120-4f14-b5f1-772f8a584fcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/3ea8d55b-ecf2-4313-8fed-a6b48c639154_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/621792c9-da7f-438c-aa03-c29f3826bb6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/fdde167c-a877-4f23-b2ad-4fe4b67b0c94_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/a8204dd1-567f-422f-8b61-d70637519b53_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/01 - 7K, 01/25 - 14K,', 'remarks': '**833** VOSA STATES 20K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/42a588be-9ba7-47ed-9f8a-e76ed28bc29f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05a66706-c358-5123-bcef-8417c5455619 with identifier: 117133968
2025-12-02 19:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a66706-c358-5123-bcef-8417c5455619 with scrape type 1
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 05a66706-c358-5123-bcef-8417c5455619
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252Faf01cd5b-f2f8-4b01-abc4-59148156fff7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/af01cd5b-f2f8-4b01-abc4-59148156fff7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 115510423, 'registration': 'FD23CGF', 'account': 'ZEN002', 'make': 'MG MOTOR UK', 'model': 'MG4 HATCHBACK', 'derivative': '150kW Trophy EV Long Range 64kWh 5dr Auto', 'mileage': 14632, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-20', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FD23CGF/2025-12-01/image/c80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/ebdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/a0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/25 - 14K', 'remarks': '**886** SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ee619d90-b705-492e-9bbe-71fc4109a23f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 115510423, 'registration': 'FD23CGF', 'account': 'ZEN002', 'make': 'MG MOTOR UK', 'model': 'MG4 HATCHBACK', 'derivative': '150kW Trophy EV Long Range 64kWh 5dr Auto', 'mileage': 14632, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-20', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FD23CGF/2025-12-01/image/c80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/ebdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/a0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/25 - 14K', 'remarks': '**886** SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ee619d90-b705-492e-9bbe-71fc4109a23f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5908229-1f07-55ad-9804-200c4ea79010 with identifier: 115510423
2025-12-02 19:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5908229-1f07-55ad-9804-200c4ea79010 with scrape type 1
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item d5908229-1f07-55ad-9804-200c4ea79010
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252Fc80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/c80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [astonbarclay.gb] INFO: Found listing with ID: 117575865
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117575865%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [astonbarclay.gb] INFO: Scrape type for 117575865: 1
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F227f1067-1a94-4f57-a988-212f1817b5f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/227f1067-1a94-4f57-a988-212f1817b5f1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F57dae2ad-576e-47e8-b28a-488478197203_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/57dae2ad-576e-47e8-b28a-488478197203_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F4b7b82b6-667b-41aa-94f7-b47d65f3fa86_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/4b7b82b6-667b-41aa-94f7-b47d65f3fa86_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F03dce60b-8f9f-4eff-8776-1fd5a7414cce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/03dce60b-8f9f-4eff-8776-1fd5a7414cce_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F03e383a1-6f32-42b1-b15e-6610b3d35e84_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/03e383a1-6f32-42b1-b15e-6610b3d35e84_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252F412e088a-4ba8-4e82-a95a-1a8564417a1e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/412e088a-4ba8-4e82-a95a-1a8564417a1e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71SXU/2025-11-28/image/2c047584-fadf-43b3-805d-13e4ccbba0db_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117597727?view=catalogue)
2025-12-02 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71FXV/2025-11-28/image/0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590494?view=catalogue)
2025-12-02 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD72LHT/2025-11-27/image/0cdbae31-29ce-430d-b5a2-962486336015_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561425?view=catalogue)
2025-12-02 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT70SXH/2025-12-02/image/a0bdd61a-2454-44f0-8657-d8c4db753874_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117029988?view=catalogue)
2025-12-02 19:05:19 [astonbarclay.gb] INFO: Found listing with ID: 117547879
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547879%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [astonbarclay.gb] INFO: Scrape type for 117547879: 1
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F3a452693-8cf2-456e-9a95-902b6428e222_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/3a452693-8cf2-456e-9a95-902b6428e222_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F43390d82-b964-4c4d-9812-bb8bfe781c25_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/43390d82-b964-4c4d-9812-bb8bfe781c25_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252Fd83bd4c7-a79a-4a5b-ac74-db6231f12bb4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/d83bd4c7-a79a-4a5b-ac74-db6231f12bb4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ca8450>
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252F0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c05dfe48-04df-50d0-bcd0-70853b464265
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05e7850>
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F74e4b84f-d268-4f78-9e2c-06f50c8747bb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/74e4b84f-d268-4f78-9e2c-06f50c8747bb_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0df80b6a-6c89-5fb4-8531-6651333b469d
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08a7290>
2025-12-02 19:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252Feb726f50-78e4-4030-a92c-eabae3506079_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/eb726f50-78e4-4030-a92c-eabae3506079_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08a4b10>
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252Fd14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/d14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be9d4895-6ef7-5e03-84b2-90915f3aff98
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05bbd50>
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F1c0faec5-5aa9-42b9-8543-53239a958418_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/1c0faec5-5aa9-42b9-8543-53239a958418_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf11f69d0>
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F02843cc7-2ce0-416f-984e-e11be69626e2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/02843cc7-2ce0-416f-984e-e11be69626e2_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05b8750>
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252Fdd4fd636-f0b0-49c8-8bea-64329b091021_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dd4fd636-f0b0-49c8-8bea-64329b091021_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0607dd0>
2025-12-02 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252F18b777ce-5cd1-4ad4-8ed8-03faec9ec787_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/18b777ce-5cd1-4ad4-8ed8-03faec9ec787_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89f3219e-41c9-557e-aed5-2984165bb017
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F8e4c409c-bce9-4e07-b52a-0b3d6fa98543_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/8e4c409c-bce9-4e07-b52a-0b3d6fa98543_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252Fd7ab3cd3-54fa-408e-9ca9-d25272776b79_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/d7ab3cd3-54fa-408e-9ca9-d25272776b79_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252Febdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/ebdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT70SXH/2025-12-02/image/5ef265e1-a0ed-4775-a404-09cb28a8597b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117029988?view=catalogue)
2025-12-02 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/455e72ec-2eeb-4ba4-9fe0-64a895efcbdd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/f9c3e0a6-c33a-4f0c-bf9b-8278e3f283e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD72LHT/2025-11-27/image/d5aeb795-d29d-4efe-95ce-2fcfebb18aa8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561425?view=catalogue)
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Found listing with ID: 116163300
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116163300%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Scrape type for 116163300: 0
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Found listing with ID: 115951329
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951329%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Scrape type for 115951329: 0
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Found listing with ID: 115951209
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951209%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Scrape type for 115951209: 0
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Found listing with ID: 115951284
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951284%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Scrape type for 115951284: 0
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Found listing with ID: 115951190
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951190%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Scrape type for 115951190: 0
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Found listing with ID: 117601450
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601450%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [astonbarclay.gb] INFO: Scrape type for 117601450: 2
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F4dd6b837-5cdf-4b1c-88aa-f208703778c9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/4dd6b837-5cdf-4b1c-88aa-f208703778c9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F8008c348-29d8-4ae4-954a-a4af26dc5c57_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/8008c348-29d8-4ae4-954a-a4af26dc5c57_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252Fe3d3cd61-9061-4707-bdc7-e31e59945cf0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e3d3cd61-9061-4707-bdc7-e31e59945cf0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71OMH/2025-12-02/image/31dab96f-c8a9-4692-966b-dd89c398c6ba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549690?view=catalogue)
2025-12-02 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23LXW/2025-12-02/image/0ff3bba3-e5e2-4512-a413-8ff0b7b0dba3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579914?view=catalogue)
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252F60a10af9-d549-4b39-aede-264358974905_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/60a10af9-d549-4b39-aede-264358974905_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0921410>
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252F2c047584-fadf-43b3-805d-13e4ccbba0db_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/2c047584-fadf-43b3-805d-13e4ccbba0db_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89f3219e-41c9-557e-aed5-2984165bb017
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf097f450>
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be9d4895-6ef7-5e03-84b2-90915f3aff98
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0649a90>
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F0cdbae31-29ce-430d-b5a2-962486336015_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/0cdbae31-29ce-430d-b5a2-962486336015_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0431e10>
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252Fa0bdd61a-2454-44f0-8657-d8c4db753874_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/a0bdd61a-2454-44f0-8657-d8c4db753874_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0df80b6a-6c89-5fb4-8531-6651333b469d
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117507387
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507387%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117507387: 0
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117580238
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580238%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117580238: 2
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F7961a629-b617-4d75-97d7-322ae1d42814_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/7961a629-b617-4d75-97d7-322ae1d42814_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F78bd928e-3dbb-48e6-a4cd-4ca725d01287_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/78bd928e-3dbb-48e6-a4cd-4ca725d01287_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F8c99c3de-ec5c-414f-86d5-dce77abdaa97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/8c99c3de-ec5c-414f-86d5-dce77abdaa97_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SM70DWN/2025-11-28/image/2263a198-db4f-4f11-9969-d483b2524413_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117581526?view=catalogue)
2025-12-02 19:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71SXU/2025-11-28/image/c66716c2-934e-45c8-9a32-7734c3817805_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117597727?view=catalogue)
2025-12-02 19:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71OMH/2025-12-02/image/4b7b82b6-667b-41aa-94f7-b47d65f3fa86_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549690?view=catalogue)
2025-12-02 19:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT70SXH/2025-12-02/image/1a06f0a2-c655-4eba-a158-18a3d0e962ce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117029988?view=catalogue)
2025-12-02 19:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD72LHT/2025-11-27/image/affd54ad-a60b-4394-983c-c6dd71d2a68d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561425?view=catalogue)
2025-12-02 19:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/db4a8c0c-b52e-427e-a284-09be0daca296_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252F9cb637a5-f120-4f14-b5f1-772f8a584fcd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/9cb637a5-f120-4f14-b5f1-772f8a584fcd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117489691
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117489691%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117489691: 0
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117427857
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427857%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117427857: 0
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117418330
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418330%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117418330: 0
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117407202
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407202%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117407202: 0
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117272138
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272138%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117272138: 0
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117231043
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117231043%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117231043: 0
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117061252
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117061252%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117061252: 0
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117015819
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117015819%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117015819: 0
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 115422003
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115422003%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [astonbarclay.gb] INFO: Scrape type for 115422003: 2
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252Fda8b7304-540f-44c1-aad0-b72fba7596af_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/da8b7304-540f-44c1-aad0-b72fba7596af_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252Fe2f205c4-412a-46c4-ac3a-4d05e84c5bbf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e2f205c4-412a-46c4-ac3a-4d05e84c5bbf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0892550>
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F5ef265e1-a0ed-4775-a404-09cb28a8597b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/5ef265e1-a0ed-4775-a404-09cb28a8597b_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0df80b6a-6c89-5fb4-8531-6651333b469d
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0642b90>
2025-12-02 19:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F455e72ec-2eeb-4ba4-9fe0-64a895efcbdd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/455e72ec-2eeb-4ba4-9fe0-64a895efcbdd_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0642b90>
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252Ff9c3e0a6-c33a-4f0c-bf9b-8278e3f283e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/f9c3e0a6-c33a-4f0c-bf9b-8278e3f283e5_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0642b90>
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252Fd5aeb795-d29d-4efe-95ce-2fcfebb18aa8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/d5aeb795-d29d-4efe-95ce-2fcfebb18aa8_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0649690>
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F31dab96f-c8a9-4692-966b-dd89c398c6ba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/31dab96f-c8a9-4692-966b-dd89c398c6ba_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf064ae50>
2025-12-02 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F0ff3bba3-e5e2-4512-a413-8ff0b7b0dba3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/0ff3bba3-e5e2-4512-a413-8ff0b7b0dba3_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfb50dee-5647-5871-bb16-abf357e3da3b
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252F3ea8d55b-ecf2-4313-8fed-a6b48c639154_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/3ea8d55b-ecf2-4313-8fed-a6b48c639154_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SM70DWN/2025-11-28/image/227f1067-1a94-4f57-a988-212f1817b5f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117581526?view=catalogue)
2025-12-02 19:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23LXW/2025-12-02/image/57dae2ad-576e-47e8-b28a-488478197203_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579914?view=catalogue)
2025-12-02 19:05:24 [astonbarclay.gb] INFO: Found listing with ID: 117622575
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117622575%27 HTTP/1.1" 200 None
2025-12-02 19:05:24 [astonbarclay.gb] INFO: Scrape type for 117622575: 2
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F443f5993-4d2f-4eaf-85cc-6231014f93f0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/443f5993-4d2f-4eaf-85cc-6231014f93f0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F7aeb1dde-44b0-46e6-a140-a8bb0462e324_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/7aeb1dde-44b0-46e6-a140-a8bb0462e324_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117367108?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252F621792c9-da7f-438c-aa03-c29f3826bb6f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/621792c9-da7f-438c-aa03-c29f3826bb6f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07eac50>
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F2263a198-db4f-4f11-9969-d483b2524413_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/2263a198-db4f-4f11-9969-d483b2524413_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ed1d0>
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252Fc66716c2-934e-45c8-9a32-7734c3817805_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/c66716c2-934e-45c8-9a32-7734c3817805_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89f3219e-41c9-557e-aed5-2984165bb017
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf097b1d0>
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F4b7b82b6-667b-41aa-94f7-b47d65f3fa86_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/4b7b82b6-667b-41aa-94f7-b47d65f3fa86_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07e4890>
2025-12-02 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F1a06f0a2-c655-4eba-a158-18a3d0e962ce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/1a06f0a2-c655-4eba-a158-18a3d0e962ce_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0df80b6a-6c89-5fb4-8531-6651333b469d
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ef410>
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252Faffd54ad-a60b-4394-983c-c6dd71d2a68d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/affd54ad-a60b-4394-983c-c6dd71d2a68d_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e7290>
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252Fdb4a8c0c-b52e-427e-a284-09be0daca296_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/db4a8c0c-b52e-427e-a284-09be0daca296_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD23CGF/2025-12-01/image/ebdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115510423?view=catalogue)
2025-12-02 19:05:25 [astonbarclay.gb] INFO: Found listing with ID: 117573681
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573681%27 HTTP/1.1" 200 None
2025-12-02 19:05:25 [astonbarclay.gb] INFO: Scrape type for 117573681: 2
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F72540e10-a07a-41b0-8c7e-970fcf91d31c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/72540e10-a07a-41b0-8c7e-970fcf91d31c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72BBX/2025-12-02/image/d7ab3cd3-54fa-408e-9ca9-d25272776b79_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117133968?view=catalogue)
2025-12-02 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SM70DWN/2025-11-28/image/3a452693-8cf2-456e-9a95-902b6428e222_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117581526?view=catalogue)
2025-12-02 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71OMH/2025-12-02/image/d83bd4c7-a79a-4a5b-ac74-db6231f12bb4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549690?view=catalogue)
2025-12-02 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23LXW/2025-12-02/image/43390d82-b964-4c4d-9812-bb8bfe781c25_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579914?view=catalogue)
2025-12-02 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71OMH/2025-12-02/image/8c99c3de-ec5c-414f-86d5-dce77abdaa97_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549690?view=catalogue)
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252Ffdde167c-a877-4f23-b2ad-4fe4b67b0c94_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/fdde167c-a877-4f23-b2ad-4fe4b67b0c94_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252Fa0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/a0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:25 [astonbarclay.gb] INFO: Found listing with ID: 117366956
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366956%27 HTTP/1.1" 200 None
2025-12-02 19:05:25 [astonbarclay.gb] INFO: Scrape type for 117366956: 0
2025-12-02 19:05:25 [astonbarclay.gb] INFO: Found listing with ID: 117589550
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117589550%27 HTTP/1.1" 200 None
2025-12-02 19:05:25 [astonbarclay.gb] INFO: Scrape type for 117589550: 2
2025-12-02 19:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07b09d0>
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F227f1067-1a94-4f57-a988-212f1817b5f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/227f1067-1a94-4f57-a988-212f1817b5f1_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0300b10>
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F57dae2ad-576e-47e8-b28a-488478197203_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/57dae2ad-576e-47e8-b28a-488478197203_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cfb50dee-5647-5871-bb16-abf357e3da3b
2025-12-02 19:05:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117367108, 'registration': 'DV22YPU', 'account': 'ZEN009', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Premium 5dr 2WD', 'mileage': 32583, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV22YPU/2025-12-02/image/9bad5488-fd1a-4284-8706-28b11421dd56_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/bc48cec2-274a-4e49-9455-9fd66c032e26_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/e25764f2-c889-4a89-9a9b-1eb88576bd39_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/06de60c5-e95f-4753-8ac4-468df027dc9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/ca885337-157f-4243-8d09-d25047f10040_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/729b4fa0-65d0-401c-ad91-9bfd7fac6daf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/58d70710-a531-4d92-a739-d38d6095d2cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/a779294a-aba2-4feb-8709-4f8f13825190_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/7eefffd5-c356-42fd-acc7-1aa6a9248f04_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 05/23 - 9K, 05/24 - 19K, 06/25 - 28K', 'remarks': '**978** VOSA STATES 27K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/546c1e0b-5332-47ab-a47f-a5b8b814af98.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117367108, 'registration': 'DV22YPU', 'account': 'ZEN009', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Premium 5dr 2WD', 'mileage': 32583, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV22YPU/2025-12-02/image/9bad5488-fd1a-4284-8706-28b11421dd56_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/bc48cec2-274a-4e49-9455-9fd66c032e26_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/e25764f2-c889-4a89-9a9b-1eb88576bd39_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/06de60c5-e95f-4753-8ac4-468df027dc9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/ca885337-157f-4243-8d09-d25047f10040_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/729b4fa0-65d0-401c-ad91-9bfd7fac6daf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/58d70710-a531-4d92-a739-d38d6095d2cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/a779294a-aba2-4feb-8709-4f8f13825190_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/7eefffd5-c356-42fd-acc7-1aa6a9248f04_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 05/23 - 9K, 05/24 - 19K, 06/25 - 28K', 'remarks': '**978** VOSA STATES 27K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/546c1e0b-5332-47ab-a47f-a5b8b814af98.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b000972-93a5-52c8-af34-fcca444aa805 with identifier: 117367108
2025-12-02 19:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b000972-93a5-52c8-af34-fcca444aa805 with scrape type 1
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 8b000972-93a5-52c8-af34-fcca444aa805
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252F9bad5488-fd1a-4284-8706-28b11421dd56_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/9bad5488-fd1a-4284-8706-28b11421dd56_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117575865, 'registration': 'HX70WLG', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e M Sport 4dr Step Auto', 'mileage': 44842, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-12-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-20', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/HX70WLG/2025-12-02/image/04fd62a6-200e-4c32-b8be-7b31f7d9686d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/74a8d578-ce4a-4aba-9fa7-c6749bfd1269_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7e260bdb-b0a5-432d-a2bb-fb728ca8cc43_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/a4fffaf1-69df-469e-9558-85d0cb1e0976_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/caf86002-0538-424f-97e3-fc0dfbb19aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/0298b102-c1c3-4f2e-8d7f-1126dd6ecf39_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7b43982a-365a-4151-b301-c570c452a249_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/1c727fec-cd51-4531-96ae-f0b2148a1a2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/fadb004d-c1dc-409c-b579-a02163181fc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/b816ce11-3c58-4f62-b4be-56af9d253bbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/ec616cd3-ad8f-47d2-ad8e-99f7e7ff8532_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 19K, 26K, 41K,', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 34, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53db543a-9e1e-402e-be70-359198af6fe3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117575865, 'registration': 'HX70WLG', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e M Sport 4dr Step Auto', 'mileage': 44842, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-12-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-20', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/HX70WLG/2025-12-02/image/04fd62a6-200e-4c32-b8be-7b31f7d9686d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/74a8d578-ce4a-4aba-9fa7-c6749bfd1269_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7e260bdb-b0a5-432d-a2bb-fb728ca8cc43_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/a4fffaf1-69df-469e-9558-85d0cb1e0976_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/caf86002-0538-424f-97e3-fc0dfbb19aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/0298b102-c1c3-4f2e-8d7f-1126dd6ecf39_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7b43982a-365a-4151-b301-c570c452a249_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/1c727fec-cd51-4531-96ae-f0b2148a1a2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/fadb004d-c1dc-409c-b579-a02163181fc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/b816ce11-3c58-4f62-b4be-56af9d253bbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/ec616cd3-ad8f-47d2-ad8e-99f7e7ff8532_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 19K, 26K, 41K,', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 34, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53db543a-9e1e-402e-be70-359198af6fe3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8ce5fd8-d9f6-5a60-9f69-9352c4934071 with identifier: 117575865
2025-12-02 19:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071 with scrape type 1
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F04fd62a6-200e-4c32-b8be-7b31f7d9686d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/04fd62a6-200e-4c32-b8be-7b31f7d9686d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252Fa8204dd1-567f-422f-8b61-d70637519b53_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/a8204dd1-567f-422f-8b61-d70637519b53_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD23CGF/2025-12-01/image/391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115510423?view=catalogue)
2025-12-02 19:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SM70DWN/2025-11-28/image/7961a629-b617-4d75-97d7-322ae1d42814_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117581526?view=catalogue)
2025-12-02 19:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23LXW/2025-12-02/image/78bd928e-3dbb-48e6-a4cd-4ca725d01287_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579914?view=catalogue)
2025-12-02 19:05:26 [astonbarclay.gb] INFO: Found listing with ID: 117548415
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548415%27 HTTP/1.1" 200 None
2025-12-02 19:05:26 [astonbarclay.gb] INFO: Scrape type for 117548415: 2
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252Fbc48cec2-274a-4e49-9455-9fd66c032e26_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/bc48cec2-274a-4e49-9455-9fd66c032e26_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F74a8d578-ce4a-4aba-9fa7-c6749bfd1269_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/74a8d578-ce4a-4aba-9fa7-c6749bfd1269_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD23CGF/2025-12-01/image/13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115510423?view=catalogue)
2025-12-02 19:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117547879?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0448590>
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252Febdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/ebdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5908229-1f07-55ad-9804-200c4ea79010
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf086df50>
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252Fd7ab3cd3-54fa-408e-9ca9-d25272776b79_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/d7ab3cd3-54fa-408e-9ca9-d25272776b79_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05a66706-c358-5123-bcef-8417c5455619
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0848490>
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F3a452693-8cf2-456e-9a95-902b6428e222_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/3a452693-8cf2-456e-9a95-902b6428e222_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07a6310>
2025-12-02 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252Fd83bd4c7-a79a-4a5b-ac74-db6231f12bb4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/d83bd4c7-a79a-4a5b-ac74-db6231f12bb4_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf084b910>
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F43390d82-b964-4c4d-9812-bb8bfe781c25_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/43390d82-b964-4c4d-9812-bb8bfe781c25_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfb50dee-5647-5871-bb16-abf357e3da3b
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aae0d0>
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F8c99c3de-ec5c-414f-86d5-dce77abdaa97_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/8c99c3de-ec5c-414f-86d5-dce77abdaa97_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117589537
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117589537%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117589537: 0
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117444820
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444820%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117444820: 2
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252Fe25764f2-c889-4a89-9a9b-1eb88576bd39_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/e25764f2-c889-4a89-9a9b-1eb88576bd39_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F7e260bdb-b0a5-432d-a2bb-fb728ca8cc43_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7e260bdb-b0a5-432d-a2bb-fb728ca8cc43_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD23CGF/2025-12-01/image/0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115510423?view=catalogue)
2025-12-02 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e2f205c4-412a-46c4-ac3a-4d05e84c5bbf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549690?view=catalogue)
2025-12-02 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72BBX/2025-12-02/image/60a10af9-d549-4b39-aede-264358974905_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117133968?view=catalogue)
2025-12-02 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71OMH/2025-12-02/image/72540e10-a07a-41b0-8c7e-970fcf91d31c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549690?view=catalogue)
2025-12-02 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71OMH/2025-12-02/image/7aeb1dde-44b0-46e6-a140-a8bb0462e324_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549690?view=catalogue)
2025-12-02 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23LXW/2025-12-02/image/443f5993-4d2f-4eaf-85cc-6231014f93f0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579914?view=catalogue)
2025-12-02 19:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117240480
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240480%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117240480: 0
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117599215
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599215%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117599215: 0
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117522892
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117522892%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117522892: 0
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117507378
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507378%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117507378: 0
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117584754
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584754%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117584754: 0
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117507367
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507367%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117507367: 0
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117548403
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548403%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117548403: 2
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252F06de60c5-e95f-4753-8ac4-468df027dc9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/06de60c5-e95f-4753-8ac4-468df027dc9e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252Fa4fffaf1-69df-469e-9558-85d0cb1e0976_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/a4fffaf1-69df-469e-9558-85d0cb1e0976_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117580238?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD23CGF/2025-12-01/image/263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115510423?view=catalogue)
2025-12-02 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX70WLG/2025-12-02/image/04fd62a6-200e-4c32-b8be-7b31f7d9686d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue)
2025-12-02 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YPU/2025-12-02/image/9bad5488-fd1a-4284-8706-28b11421dd56_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117367108?view=catalogue)
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117579253
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579253%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117579253: 1
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252Fca885337-157f-4243-8d09-d25047f10040_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/ca885337-157f-4243-8d09-d25047f10040_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252Fcaf86002-0538-424f-97e3-fc0dfbb19aa2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/caf86002-0538-424f-97e3-fc0dfbb19aa2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1e53790>
2025-12-02 19:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5908229-1f07-55ad-9804-200c4ea79010
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0756410>
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F7961a629-b617-4d75-97d7-322ae1d42814_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/7961a629-b617-4d75-97d7-322ae1d42814_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0662fd0>
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F78bd928e-3dbb-48e6-a4cd-4ca725d01287_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/78bd928e-3dbb-48e6-a4cd-4ca725d01287_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cfb50dee-5647-5871-bb16-abf357e3da3b
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf049ed90>
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5908229-1f07-55ad-9804-200c4ea79010
2025-12-02 19:05:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117547879, 'registration': 'OV71UBN', 'account': 'ZEN002', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT Premium 5dr', 'mileage': 14505, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-11-26', 'fuel': 'Petrol', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71UBN/2025-11-27/image/11f4ad98-4e9a-4a14-a5a3-98bf5e125dee_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5c743163-fd39-461b-a197-2f87b4477ff3_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d4880a66-eb79-4858-a97a-8a49b21dd0f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/8e838d39-c4ae-491f-b508-13df56410261_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/2537fc75-d072-47e4-bb74-34440391db58_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/ed2ba0c5-7f15-4811-8962-4fb015f5e308_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d33bb0b9-55e0-4c9c-8bc8-efe75de1c26d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5651e155-0b6a-469d-8c95-8aaf7e9c8b56_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/a924f394-9864-436c-a3f6-203461544cd5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/22 - 3K, 11/23 - 6K, 11/24 - 10K, 11/25 - 14K', 'remarks': '**818** VOSA STATES 10K, 14K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4321456b-8a81-4ce4-9907-4d5004241a4f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117547879, 'registration': 'OV71UBN', 'account': 'ZEN002', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT Premium 5dr', 'mileage': 14505, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-11-26', 'fuel': 'Petrol', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71UBN/2025-11-27/image/11f4ad98-4e9a-4a14-a5a3-98bf5e125dee_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5c743163-fd39-461b-a197-2f87b4477ff3_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d4880a66-eb79-4858-a97a-8a49b21dd0f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/8e838d39-c4ae-491f-b508-13df56410261_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/2537fc75-d072-47e4-bb74-34440391db58_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/ed2ba0c5-7f15-4811-8962-4fb015f5e308_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d33bb0b9-55e0-4c9c-8bc8-efe75de1c26d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5651e155-0b6a-469d-8c95-8aaf7e9c8b56_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/a924f394-9864-436c-a3f6-203461544cd5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/22 - 3K, 11/23 - 6K, 11/24 - 10K, 11/25 - 14K', 'remarks': '**818** VOSA STATES 10K, 14K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4321456b-8a81-4ce4-9907-4d5004241a4f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2f7bf4a-ca7b-5385-977a-21875d6c4bbb with identifier: 117547879
2025-12-02 19:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb with scrape type 1
2025-12-02 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252F11f4ad98-4e9a-4a14-a5a3-98bf5e125dee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/11f4ad98-4e9a-4a14-a5a3-98bf5e125dee_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72BBX/2025-12-02/image/621792c9-da7f-438c-aa03-c29f3826bb6f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117133968?view=catalogue)
2025-12-02 19:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX70WLG/2025-12-02/image/74a8d578-ce4a-4aba-9fa7-c6749bfd1269_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue)
2025-12-02 19:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YPU/2025-12-02/image/bc48cec2-274a-4e49-9455-9fd66c032e26_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117367108?view=catalogue)
2025-12-02 19:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72BBX/2025-12-02/image/a8204dd1-567f-422f-8b61-d70637519b53_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117133968?view=catalogue)
2025-12-02 19:05:29 [astonbarclay.gb] INFO: Found listing with ID: 117580116
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580116%27 HTTP/1.1" 200 None
2025-12-02 19:05:29 [astonbarclay.gb] INFO: Scrape type for 117580116: 1
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252F729b4fa0-65d0-401c-ad91-9bfd7fac6daf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/729b4fa0-65d0-401c-ad91-9bfd7fac6daf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F0298b102-c1c3-4f2e-8d7f-1126dd6ecf39_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/0298b102-c1c3-4f2e-8d7f-1126dd6ecf39_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252F5c743163-fd39-461b-a197-2f87b4477ff3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5c743163-fd39-461b-a197-2f87b4477ff3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07174d0>
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5908229-1f07-55ad-9804-200c4ea79010
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0372ed0>
2025-12-02 19:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252Fe2f205c4-412a-46c4-ac3a-4d05e84c5bbf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e2f205c4-412a-46c4-ac3a-4d05e84c5bbf_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0465650>
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252F60a10af9-d549-4b39-aede-264358974905_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/60a10af9-d549-4b39-aede-264358974905_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05a66706-c358-5123-bcef-8417c5455619
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0714150>
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F72540e10-a07a-41b0-8c7e-970fcf91d31c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/72540e10-a07a-41b0-8c7e-970fcf91d31c_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0636150>
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F7aeb1dde-44b0-46e6-a140-a8bb0462e324_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/7aeb1dde-44b0-46e6-a140-a8bb0462e324_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1dde610>
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F443f5993-4d2f-4eaf-85cc-6231014f93f0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/443f5993-4d2f-4eaf-85cc-6231014f93f0_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cfb50dee-5647-5871-bb16-abf357e3da3b
2025-12-02 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117573681?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD23CGF/2025-12-01/image/a0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115510423?view=catalogue)
2025-12-02 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72BBX/2025-12-02/image/fdde167c-a877-4f23-b2ad-4fe4b67b0c94_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117133968?view=catalogue)
2025-12-02 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23LXW/2025-12-02/image/da8b7304-540f-44c1-aad0-b72fba7596af_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579914?view=catalogue)
2025-12-02 19:05:31 [astonbarclay.gb] INFO: Found listing with ID: 117573137
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573137%27 HTTP/1.1" 200 None
2025-12-02 19:05:31 [astonbarclay.gb] INFO: Scrape type for 117573137: 2
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252F58d70710-a531-4d92-a739-d38d6095d2cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/58d70710-a531-4d92-a739-d38d6095d2cd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F7b43982a-365a-4151-b301-c570c452a249_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7b43982a-365a-4151-b301-c570c452a249_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252Fd4880a66-eb79-4858-a97a-8a49b21dd0f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d4880a66-eb79-4858-a97a-8a49b21dd0f1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117580238, 'registration': 'KO67OXZ', 'account': 'STA058', 'make': 'MERCEDES-BENZ', 'model': 'CLA DIESEL COUPE', 'derivative': 'CLA 220d AMG Line 4dr Tip Auto', 'mileage': 82136, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-02-16', 'fuel': 'Diesel', 'motExpiry': '2026-10-31', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/32ea7332-3753-4d50-9512-a6568d666c31_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/d3dc523d-1527-4b62-ac1e-94a0dee346e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/76afe022-4156-48bf-8954-9b7e35b2b1e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/ec56de01-351e-457b-96db-9f9ff80fd430_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/932fc8be-ab36-4da0-8e3c-50c2112ebd50_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/18d0409f-bdc9-4fec-bf5e-7e81a0c04332_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/a67afa1c-8e11-4593-b612-bff0d7c59865_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/8dade95f-1f63-4484-b328-aa6ec5b11f93_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/4ed69de2-49e4-4002-b0aa-763a36ed9c9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/6d6bb7dd-ee51-4cb3-9464-f914a349e8fc_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 44K, 55K, 68K, 81K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cfda5f0d-2169-4ea8-8fe5-4c7647f26277.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117580238, 'registration': 'KO67OXZ', 'account': 'STA058', 'make': 'MERCEDES-BENZ', 'model': 'CLA DIESEL COUPE', 'derivative': 'CLA 220d AMG Line 4dr Tip Auto', 'mileage': 82136, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-02-16', 'fuel': 'Diesel', 'motExpiry': '2026-10-31', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/32ea7332-3753-4d50-9512-a6568d666c31_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/d3dc523d-1527-4b62-ac1e-94a0dee346e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/76afe022-4156-48bf-8954-9b7e35b2b1e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/ec56de01-351e-457b-96db-9f9ff80fd430_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/932fc8be-ab36-4da0-8e3c-50c2112ebd50_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/18d0409f-bdc9-4fec-bf5e-7e81a0c04332_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/a67afa1c-8e11-4593-b612-bff0d7c59865_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/8dade95f-1f63-4484-b328-aa6ec5b11f93_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/4ed69de2-49e4-4002-b0aa-763a36ed9c9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO67OXZ/2025-11-28/image/6d6bb7dd-ee51-4cb3-9464-f914a349e8fc_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 44K, 55K, 68K, 81K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cfda5f0d-2169-4ea8-8fe5-4c7647f26277.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cc61603-4be4-52df-8c9e-a774aa4542d9 with identifier: 117580238
2025-12-02 19:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cc61603-4be4-52df-8c9e-a774aa4542d9 with scrape type 2
2025-12-02 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cc61603-4be4-52df-8c9e-a774aa4542d9 with scrape type 2
2025-12-02 19:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6cc61603-4be4-52df-8c9e-a774aa4542d9, identifier: 117580238
2025-12-02 19:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0667c90>
2025-12-02 19:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d5908229-1f07-55ad-9804-200c4ea79010
2025-12-02 19:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0778710>
2025-12-02 19:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F04fd62a6-200e-4c32-b8be-7b31f7d9686d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/04fd62a6-200e-4c32-b8be-7b31f7d9686d_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0939f50>
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252F9bad5488-fd1a-4284-8706-28b11421dd56_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/9bad5488-fd1a-4284-8706-28b11421dd56_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b000972-93a5-52c8-af34-fcca444aa805
2025-12-02 19:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6cc61603-4be4-52df-8c9e-a774aa4542d9 with identifier: 117580238
2025-12-02 19:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6cc61603-4be4-52df-8c9e-a774aa4542d9 with identifier: 117580238
2025-12-02 19:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6cc61603-4be4-52df-8c9e-a774aa4542d9 with identifier: 117580238 to the API
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117580238?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6cc61603-4be4-52df-8c9e-a774aa4542d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KO67OXZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117580238',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA DIESEL COUPE',
 'odometer': 82136,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-16',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'MERCEDES-BENZ CLA DIESEL COUPE CLA 220d AMG Line 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 220d AMG Line 4dr Tip Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580238%27 HTTP/1.1" 200 None
2025-12-02 19:05:32 [astonbarclay.gb] INFO: Saving data for 117580238: {'auction_closing_time': 1765188000.0, 'created_time': 1764579729.54475, 'last_price_update_time': 1764702332.662765}
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117580238') HTTP/1.1" 204 0
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf058abd0>
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252F621792c9-da7f-438c-aa03-c29f3826bb6f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/621792c9-da7f-438c-aa03-c29f3826bb6f_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05a66706-c358-5123-bcef-8417c5455619
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf050b350>
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F74a8d578-ce4a-4aba-9fa7-c6749bfd1269_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/74a8d578-ce4a-4aba-9fa7-c6749bfd1269_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf081ced0>
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252Fbc48cec2-274a-4e49-9455-9fd66c032e26_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/bc48cec2-274a-4e49-9455-9fd66c032e26_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b000972-93a5-52c8-af34-fcca444aa805
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0303750>
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252Fa8204dd1-567f-422f-8b61-d70637519b53_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/a8204dd1-567f-422f-8b61-d70637519b53_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05a66706-c358-5123-bcef-8417c5455619
2025-12-02 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71UBN/2025-11-27/image/11f4ad98-4e9a-4a14-a5a3-98bf5e125dee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547879?view=catalogue)
2025-12-02 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7e260bdb-b0a5-432d-a2bb-fb728ca8cc43_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue)
2025-12-02 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX70WLG/2025-12-02/image/a4fffaf1-69df-469e-9558-85d0cb1e0976_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue)
2025-12-02 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YPU/2025-12-02/image/06de60c5-e95f-4753-8ac4-468df027dc9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117367108?view=catalogue)
2025-12-02 19:05:33 [astonbarclay.gb] INFO: Found listing with ID: 117420392
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420392%27 HTTP/1.1" 200 None
2025-12-02 19:05:33 [astonbarclay.gb] INFO: Scrape type for 117420392: 0
2025-12-02 19:05:33 [astonbarclay.gb] INFO: Found listing with ID: 117579278
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579278%27 HTTP/1.1" 200 None
2025-12-02 19:05:33 [astonbarclay.gb] INFO: Scrape type for 117579278: 1
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252Fa779294a-aba2-4feb-8709-4f8f13825190_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/a779294a-aba2-4feb-8709-4f8f13825190_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F1c727fec-cd51-4531-96ae-f0b2148a1a2e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/1c727fec-cd51-4531-96ae-f0b2148a1a2e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252F8e838d39-c4ae-491f-b508-13df56410261_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/8e838d39-c4ae-491f-b508-13df56410261_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX70WLG/2025-12-02/image/caf86002-0538-424f-97e3-fc0dfbb19aa2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue)
2025-12-02 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YPU/2025-12-02/image/ca885337-157f-4243-8d09-d25047f10040_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117367108?view=catalogue)
2025-12-02 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117589550?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117573681, 'registration': 'DA19BEY', 'account': 'STA058', 'make': 'AUDI', 'model': 'Q3 DIESEL ESTATE', 'derivative': '35 TDI Sport 5dr S Tronic', 'mileage': 64950, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-12', 'fuel': 'Diesel', 'motExpiry': '2025-09-12', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DA19BEY/2025-12-02/image/acd9007c-4660-4495-a43d-a1a06d8e20ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/a068ae65-02a6-454b-bbac-168d97eede96_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/f19f94db-0b05-46fd-bba6-3766fed79c0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/09dc7fd2-1149-4baa-82a0-746551226daf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/59e23b54-e846-4e57-96c8-697f285ecb09_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/a364e79d-3603-4f06-8541-a951c0e7a13b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/386a88c3-6efc-4425-af73-93d0ad2b91e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/a60e245f-ea11-483c-b6f9-a7a64d7568ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/2d278f4f-f925-44fe-b0a6-d04c7de3e997_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/2e63bfa9-e8ce-4fb6-a08f-defa2268414b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/984ddda9-9626-4702-8cc7-cd00a940020d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117573681, 'registration': 'DA19BEY', 'account': 'STA058', 'make': 'AUDI', 'model': 'Q3 DIESEL ESTATE', 'derivative': '35 TDI Sport 5dr S Tronic', 'mileage': 64950, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-12', 'fuel': 'Diesel', 'motExpiry': '2025-09-12', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DA19BEY/2025-12-02/image/acd9007c-4660-4495-a43d-a1a06d8e20ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/a068ae65-02a6-454b-bbac-168d97eede96_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/f19f94db-0b05-46fd-bba6-3766fed79c0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/09dc7fd2-1149-4baa-82a0-746551226daf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/59e23b54-e846-4e57-96c8-697f285ecb09_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/a364e79d-3603-4f06-8541-a951c0e7a13b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/386a88c3-6efc-4425-af73-93d0ad2b91e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/a60e245f-ea11-483c-b6f9-a7a64d7568ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/2d278f4f-f925-44fe-b0a6-d04c7de3e997_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA19BEY/2025-12-02/image/2e63bfa9-e8ce-4fb6-a08f-defa2268414b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/984ddda9-9626-4702-8cc7-cd00a940020d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5449c90e-bc48-5d95-a16a-3a2a78e6e9d8 with identifier: 117573681
2025-12-02 19:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5449c90e-bc48-5d95-a16a-3a2a78e6e9d8 with scrape type 2
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5449c90e-bc48-5d95-a16a-3a2a78e6e9d8 with scrape type 2
2025-12-02 19:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5449c90e-bc48-5d95-a16a-3a2a78e6e9d8, identifier: 117573681
2025-12-02 19:05:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117622575, 'registration': 'YB68EYD', 'account': 'STA058', 'make': 'TOYOTA', 'model': 'C-HR HATCHBACK', 'derivative': '1.8 Hybrid Design 5dr CVT', 'mileage': 67438, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-01-10', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-07-30', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB68EYD/2025-12-02/image/cced0592-9012-45fd-9eef-d26dfb46361a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/f0cb9b91-3157-4d93-8c22-d341d0eca6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/3a4baf39-dbea-44d0-9411-eab34f3dcddc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/d7524689-4416-4077-a171-4977cd838fec_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/8c5ed5f1-29a6-4cf4-9291-865b3dde8a04_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/80cb2d15-2829-4e0e-b9ef-504e85b06890_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/712b2488-6039-4ff3-b7b4-7d52efbfdcd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/9014f18f-3fb0-459c-b8e9-f777bbaeb972_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/c9143d73-c2d6-4c4d-865a-83a39909205d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/b9a8ed9a-ab00-4ddb-a0ca-1276b25ce08f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 45K 50K 54K 64K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 86, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad299850-b5f1-4cea-959a-1f6d855d2325.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117622575, 'registration': 'YB68EYD', 'account': 'STA058', 'make': 'TOYOTA', 'model': 'C-HR HATCHBACK', 'derivative': '1.8 Hybrid Design 5dr CVT', 'mileage': 67438, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-01-10', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-07-30', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB68EYD/2025-12-02/image/cced0592-9012-45fd-9eef-d26dfb46361a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/f0cb9b91-3157-4d93-8c22-d341d0eca6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/3a4baf39-dbea-44d0-9411-eab34f3dcddc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/d7524689-4416-4077-a171-4977cd838fec_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/8c5ed5f1-29a6-4cf4-9291-865b3dde8a04_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/80cb2d15-2829-4e0e-b9ef-504e85b06890_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/712b2488-6039-4ff3-b7b4-7d52efbfdcd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/9014f18f-3fb0-459c-b8e9-f777bbaeb972_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/c9143d73-c2d6-4c4d-865a-83a39909205d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-02/image/b9a8ed9a-ab00-4ddb-a0ca-1276b25ce08f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 45K 50K 54K 64K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 86, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad299850-b5f1-4cea-959a-1f6d855d2325.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55ecf4d-4b7d-502e-8147-27eca949960d with identifier: 117622575
2025-12-02 19:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55ecf4d-4b7d-502e-8147-27eca949960d with scrape type 2
2025-12-02 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b55ecf4d-4b7d-502e-8147-27eca949960d with scrape type 2
2025-12-02 19:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b55ecf4d-4b7d-502e-8147-27eca949960d, identifier: 117622575
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04309d0>
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252Fa0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/a0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d5908229-1f07-55ad-9804-200c4ea79010
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098c6d0>
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252Ffdde167c-a877-4f23-b2ad-4fe4b67b0c94_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/fdde167c-a877-4f23-b2ad-4fe4b67b0c94_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05a66706-c358-5123-bcef-8417c5455619
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098c090>
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252Fda8b7304-540f-44c1-aad0-b72fba7596af_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/da8b7304-540f-44c1-aad0-b72fba7596af_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cfb50dee-5647-5871-bb16-abf357e3da3b
2025-12-02 19:05:34 [astonbarclay.gb] INFO: Found listing with ID: 117451336
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451336%27 HTTP/1.1" 200 None
2025-12-02 19:05:34 [astonbarclay.gb] INFO: Scrape type for 117451336: 0
2025-12-02 19:05:34 [astonbarclay.gb] INFO: Found listing with ID: 117452073
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452073%27 HTTP/1.1" 200 None
2025-12-02 19:05:34 [astonbarclay.gb] INFO: Scrape type for 117452073: 2
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252F7eefffd5-c356-42fd-acc7-1aa6a9248f04_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/7eefffd5-c356-42fd-acc7-1aa6a9248f04_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252Ffadb004d-c1dc-409c-b579-a02163181fc2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/fadb004d-c1dc-409c-b579-a02163181fc2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252F2537fc75-d072-47e4-bb74-34440391db58_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/2537fc75-d072-47e4-bb74-34440391db58_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5449c90e-bc48-5d95-a16a-3a2a78e6e9d8 with identifier: 117573681
2025-12-02 19:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5449c90e-bc48-5d95-a16a-3a2a78e6e9d8 with identifier: 117573681
2025-12-02 19:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5449c90e-bc48-5d95-a16a-3a2a78e6e9d8 with identifier: 117573681 to the API
2025-12-02 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275449c90e-bc48-5d95-a16a-3a2a78e6e9d8%27 HTTP/1.1" 200 None
2025-12-02 19:05:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5449c90e-bc48-5d95-a16a-3a2a78e6e9d8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:05:35 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117573681?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '5449c90e-bc48-5d95-a16a-3a2a78e6e9d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DA19BEY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573681',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q3 DIESEL ESTATE',
 'odometer': 64950,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-12',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'AUDI Q3 DIESEL ESTATE 35 TDI Sport 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TDI Sport 5dr S Tronic',
 'vin': None,
 'year': 2019}
2025-12-02 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573681%27 HTTP/1.1" 200 None
2025-12-02 19:05:35 [astonbarclay.gb] INFO: Saving data for 117573681: {'auction_closing_time': 1765188000.0, 'created_time': 1764356629.964482, 'last_price_update_time': 1764702335.765633}
2025-12-02 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117573681') HTTP/1.1" 204 0
2025-12-02 19:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b55ecf4d-4b7d-502e-8147-27eca949960d with identifier: 117622575
2025-12-02 19:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b55ecf4d-4b7d-502e-8147-27eca949960d with identifier: 117622575
2025-12-02 19:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b55ecf4d-4b7d-502e-8147-27eca949960d with identifier: 117622575 to the API
2025-12-02 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'b55ecf4d-4b7d-502e-8147-27eca949960d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YB68EYD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117622575',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'C-HR HATCHBACK',
 'odometer': 67438,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-10',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'TOYOTA C-HR HATCHBACK 1.8 Hybrid Design 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.8 Hybrid Design 5dr CVT',
 'vin': None,
 'year': 2019}
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117622575%27 HTTP/1.1" 200 None
2025-12-02 19:05:36 [astonbarclay.gb] INFO: Saving data for 117622575: {'auction_closing_time': 1765188000.0, 'created_time': 1764615704.129456, 'last_price_update_time': 1764702336.065753}
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117622575') HTTP/1.1" 204 0
2025-12-02 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5c743163-fd39-461b-a197-2f87b4477ff3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547879?view=catalogue)
2025-12-02 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117548403?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03bb150>
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252F11f4ad98-4e9a-4a14-a5a3-98bf5e125dee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/11f4ad98-4e9a-4a14-a5a3-98bf5e125dee_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0900f10>
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F7e260bdb-b0a5-432d-a2bb-fb728ca8cc43_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7e260bdb-b0a5-432d-a2bb-fb728ca8cc43_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07b3e10>
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252Fa4fffaf1-69df-469e-9558-85d0cb1e0976_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/a4fffaf1-69df-469e-9558-85d0cb1e0976_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0902210>
2025-12-02 19:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252F06de60c5-e95f-4753-8ac4-468df027dc9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/06de60c5-e95f-4753-8ac4-468df027dc9e_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b000972-93a5-52c8-af34-fcca444aa805
2025-12-02 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX70WLG/2025-12-02/image/0298b102-c1c3-4f2e-8d7f-1126dd6ecf39_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue)
2025-12-02 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YPU/2025-12-02/image/e25764f2-c889-4a89-9a9b-1eb88576bd39_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117367108?view=catalogue)
2025-12-02 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YPU/2025-12-02/image/729b4fa0-65d0-401c-ad91-9bfd7fac6daf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117367108?view=catalogue)
2025-12-02 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72BBX/2025-12-02/image/3ea8d55b-ecf2-4313-8fed-a6b48c639154_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117133968?view=catalogue)
2025-12-02 19:05:37 [astonbarclay.gb] INFO: Found listing with ID: 117639372
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639372%27 HTTP/1.1" 200 None
2025-12-02 19:05:37 [astonbarclay.gb] INFO: Scrape type for 117639372: 1
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252Fb816ce11-3c58-4f62-b4be-56af9d253bbe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/b816ce11-3c58-4f62-b4be-56af9d253bbe_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252Fed2ba0c5-7f15-4811-8962-4fb015f5e308_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/ed2ba0c5-7f15-4811-8962-4fb015f5e308_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf077f4d0>
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252Fcaf86002-0538-424f-97e3-fc0dfbb19aa2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/caf86002-0538-424f-97e3-fc0dfbb19aa2_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1216bd0>
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252Fca885337-157f-4243-8d09-d25047f10040_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/ca885337-157f-4243-8d09-d25047f10040_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b000972-93a5-52c8-af34-fcca444aa805
2025-12-02 19:05:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117589550, 'registration': 'DF23ZKW', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 21939, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/9e0448a7-a8d9-4e03-bba8-a8d54ee46eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/78cecfa2-1fad-4908-80e0-07bc20fe045f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/cee0cd29-76a8-4595-b716-89c3585edad3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/4c51dd83-eb5e-400a-a72a-655d7857038a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/a2dc5aa7-2dae-4d7a-aafd-89bacc448f14_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/ea9ea6ef-5627-42db-bc25-8ff0390faf8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/9d35816a-cf20-4dd5-9460-f58a0fb69f86_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/0b493c1f-0034-4228-89cb-bca9ef6e6563_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/7aeb79af-8b07-4cae-9c55-05f7488fc7ca_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/25-19K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53af684a-97f0-4a05-9222-0923a61ab634.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117589550, 'registration': 'DF23ZKW', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 21939, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/9e0448a7-a8d9-4e03-bba8-a8d54ee46eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/78cecfa2-1fad-4908-80e0-07bc20fe045f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/cee0cd29-76a8-4595-b716-89c3585edad3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/4c51dd83-eb5e-400a-a72a-655d7857038a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/a2dc5aa7-2dae-4d7a-aafd-89bacc448f14_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/ea9ea6ef-5627-42db-bc25-8ff0390faf8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/9d35816a-cf20-4dd5-9460-f58a0fb69f86_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/0b493c1f-0034-4228-89cb-bca9ef6e6563_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23ZKW/2025-12-02/image/7aeb79af-8b07-4cae-9c55-05f7488fc7ca_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/25-19K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53af684a-97f0-4a05-9222-0923a61ab634.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c1303e2-0c80-5cf1-916c-ce7405d38dde with identifier: 117589550
2025-12-02 19:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c1303e2-0c80-5cf1-916c-ce7405d38dde with scrape type 2
2025-12-02 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c1303e2-0c80-5cf1-916c-ce7405d38dde with scrape type 2
2025-12-02 19:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3c1303e2-0c80-5cf1-916c-ce7405d38dde, identifier: 117589550
2025-12-02 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7b43982a-365a-4151-b301-c570c452a249_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue)
2025-12-02 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YPU/2025-12-02/image/58d70710-a531-4d92-a739-d38d6095d2cd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117367108?view=catalogue)
2025-12-02 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d4880a66-eb79-4858-a97a-8a49b21dd0f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547879?view=catalogue)
2025-12-02 19:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3c1303e2-0c80-5cf1-916c-ce7405d38dde with identifier: 117589550
2025-12-02 19:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3c1303e2-0c80-5cf1-916c-ce7405d38dde with identifier: 117589550
2025-12-02 19:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3c1303e2-0c80-5cf1-916c-ce7405d38dde with identifier: 117589550 to the API
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273c1303e2-0c80-5cf1-916c-ce7405d38dde%27 HTTP/1.1" 200 None
2025-12-02 19:05:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3c1303e2-0c80-5cf1-916c-ce7405d38dde: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:05:37 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117589550?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3c1303e2-0c80-5cf1-916c-ce7405d38dde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DF23ZKW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117589550',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 21939,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-27',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117589550%27 HTTP/1.1" 200 None
2025-12-02 19:05:37 [astonbarclay.gb] INFO: Saving data for 117589550: {'auction_closing_time': 1765188000.0, 'created_time': 1764615685.860513, 'last_price_update_time': 1764702337.898816}
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117589550') HTTP/1.1" 204 0
2025-12-02 19:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71UBN/2025-11-27/image/8e838d39-c4ae-491f-b508-13df56410261_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547879?view=catalogue)
2025-12-02 19:05:37 [astonbarclay.gb] INFO: Found listing with ID: 117615455
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615455%27 HTTP/1.1" 200 None
2025-12-02 19:05:37 [astonbarclay.gb] INFO: Scrape type for 117615455: 0
2025-12-02 19:05:37 [astonbarclay.gb] INFO: Found listing with ID: 117639666
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639666%27 HTTP/1.1" 200 None
2025-12-02 19:05:37 [astonbarclay.gb] INFO: Scrape type for 117639666: 1
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252Fec616cd3-ad8f-47d2-ad8e-99f7e7ff8532_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/ec616cd3-ad8f-47d2-ad8e-99f7e7ff8532_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252Fd33bb0b9-55e0-4c9c-8bc8-efe75de1c26d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d33bb0b9-55e0-4c9c-8bc8-efe75de1c26d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf040abd0>
2025-12-02 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252F5c743163-fd39-461b-a197-2f87b4477ff3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5c743163-fd39-461b-a197-2f87b4477ff3_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb
2025-12-02 19:05:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117548403, 'registration': 'DC23JUU', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 19396, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JUU/2025-12-02/image/b84404f7-6728-41d4-867f-df3814b80068_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/5b328cdd-6f5a-4136-8300-d3e8f75cef6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/9fd65c28-fa82-4ac8-98e4-3f83dd72dd99_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/dfad938b-5b58-4726-b16c-600d2fb735e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/2f2555fa-df25-429e-b09f-7d08b2751987_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/1910603b-6d5e-414f-b5db-c999828354a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/d7b9b2fe-c642-4154-b3c8-9993c681b180_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/8e67da8c-b468-41cf-a06e-f609d4807422_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/2e36f0d2-702c-485f-b8ef-386f0c703728_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/d379e08a-56e5-42a6-81d1-8f2c7ffa7775_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 07/25-14K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ae8af79-fef1-4b7d-ac4c-c2296719bb91.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117548403, 'registration': 'DC23JUU', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 19396, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JUU/2025-12-02/image/b84404f7-6728-41d4-867f-df3814b80068_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/5b328cdd-6f5a-4136-8300-d3e8f75cef6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/9fd65c28-fa82-4ac8-98e4-3f83dd72dd99_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/dfad938b-5b58-4726-b16c-600d2fb735e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/2f2555fa-df25-429e-b09f-7d08b2751987_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/1910603b-6d5e-414f-b5db-c999828354a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/d7b9b2fe-c642-4154-b3c8-9993c681b180_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/8e67da8c-b468-41cf-a06e-f609d4807422_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/2e36f0d2-702c-485f-b8ef-386f0c703728_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUU/2025-12-02/image/d379e08a-56e5-42a6-81d1-8f2c7ffa7775_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 07/25-14K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ae8af79-fef1-4b7d-ac4c-c2296719bb91.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5352e8ce-ef3d-5fb5-b156-d31f7be289ec with identifier: 117548403
2025-12-02 19:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5352e8ce-ef3d-5fb5-b156-d31f7be289ec with scrape type 2
2025-12-02 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5352e8ce-ef3d-5fb5-b156-d31f7be289ec with scrape type 2
2025-12-02 19:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5352e8ce-ef3d-5fb5-b156-d31f7be289ec, identifier: 117548403
2025-12-02 19:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX70WLG/2025-12-02/image/1c727fec-cd51-4531-96ae-f0b2148a1a2e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue)
2025-12-02 19:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5352e8ce-ef3d-5fb5-b156-d31f7be289ec with identifier: 117548403
2025-12-02 19:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5352e8ce-ef3d-5fb5-b156-d31f7be289ec with identifier: 117548403
2025-12-02 19:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5352e8ce-ef3d-5fb5-b156-d31f7be289ec with identifier: 117548403 to the API
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275352e8ce-ef3d-5fb5-b156-d31f7be289ec%27 HTTP/1.1" 200 None
2025-12-02 19:05:38 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5352e8ce-ef3d-5fb5-b156-d31f7be289ec: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:05:38 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117548403?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5352e8ce-ef3d-5fb5-b156-d31f7be289ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23JUU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117548403',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 19396,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-26',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548403%27 HTTP/1.1" 200 None
2025-12-02 19:05:38 [astonbarclay.gb] INFO: Saving data for 117548403: {'auction_closing_time': 1765188000.0, 'created_time': 1764615682.830117, 'last_price_update_time': 1764702338.580095}
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117548403') HTTP/1.1" 204 0
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07cab90>
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F0298b102-c1c3-4f2e-8d7f-1126dd6ecf39_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/0298b102-c1c3-4f2e-8d7f-1126dd6ecf39_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0528d10>
2025-12-02 19:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252Fe25764f2-c889-4a89-9a9b-1eb88576bd39_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/e25764f2-c889-4a89-9a9b-1eb88576bd39_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b000972-93a5-52c8-af34-fcca444aa805
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0340d90>
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252F729b4fa0-65d0-401c-ad91-9bfd7fac6daf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/729b4fa0-65d0-401c-ad91-9bfd7fac6daf_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b000972-93a5-52c8-af34-fcca444aa805
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0782390>
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252F3ea8d55b-ecf2-4313-8fed-a6b48c639154_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/3ea8d55b-ecf2-4313-8fed-a6b48c639154_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05a66706-c358-5123-bcef-8417c5455619
2025-12-02 19:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX70WLG/2025-12-02/image/fadb004d-c1dc-409c-b579-a02163181fc2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue)
2025-12-02 19:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YPU/2025-12-02/image/a779294a-aba2-4feb-8709-4f8f13825190_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117367108?view=catalogue)
2025-12-02 19:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71UBN/2025-11-27/image/2537fc75-d072-47e4-bb74-34440391db58_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547879?view=catalogue)
2025-12-02 19:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YPU/2025-12-02/image/7eefffd5-c356-42fd-acc7-1aa6a9248f04_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117367108?view=catalogue)
2025-12-02 19:05:39 [astonbarclay.gb] INFO: Found listing with ID: 117596515
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117596515%27 HTTP/1.1" 200 None
2025-12-02 19:05:39 [astonbarclay.gb] INFO: Scrape type for 117596515: 1
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252F5651e155-0b6a-469d-8c95-8aaf7e9c8b56_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5651e155-0b6a-469d-8c95-8aaf7e9c8b56_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0892050>
2025-12-02 19:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F7b43982a-365a-4151-b301-c570c452a249_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7b43982a-365a-4151-b301-c570c452a249_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0798450>
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252F58d70710-a531-4d92-a739-d38d6095d2cd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/58d70710-a531-4d92-a739-d38d6095d2cd_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b000972-93a5-52c8-af34-fcca444aa805
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac7f50>
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252Fd4880a66-eb79-4858-a97a-8a49b21dd0f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d4880a66-eb79-4858-a97a-8a49b21dd0f1_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb
2025-12-02 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD23CGF/2025-12-01/image/2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115510423?view=catalogue)
2025-12-02 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72BBX/2025-12-02/image/9cb637a5-f120-4f14-b5f1-772f8a584fcd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117133968?view=catalogue)
2025-12-02 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117573137?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115422003?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ee7890>
2025-12-02 19:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252F8e838d39-c4ae-491f-b508-13df56410261_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/8e838d39-c4ae-491f-b508-13df56410261_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb
2025-12-02 19:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71UBN/2025-11-27/image/ed2ba0c5-7f15-4811-8962-4fb015f5e308_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547879?view=catalogue)
2025-12-02 19:05:41 [astonbarclay.gb] INFO: Found listing with ID: 117271901
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271901%27 HTTP/1.1" 200 None
2025-12-02 19:05:41 [astonbarclay.gb] INFO: Scrape type for 117271901: 2
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252Fa924f394-9864-436c-a3f6-203461544cd5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/a924f394-9864-436c-a3f6-203461544cd5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117579253?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07f3d50>
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252F1c727fec-cd51-4531-96ae-f0b2148a1a2e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/1c727fec-cd51-4531-96ae-f0b2148a1a2e_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117548415?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0302250>
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252Ffadb004d-c1dc-409c-b579-a02163181fc2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/fadb004d-c1dc-409c-b579-a02163181fc2_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf038ee10>
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252Fa779294a-aba2-4feb-8709-4f8f13825190_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/a779294a-aba2-4feb-8709-4f8f13825190_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b000972-93a5-52c8-af34-fcca444aa805
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09896d0>
2025-12-02 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252F2537fc75-d072-47e4-bb74-34440391db58_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/2537fc75-d072-47e4-bb74-34440391db58_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a7ded0>
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YPU%252F2025-12-02%252Fimage%252F7eefffd5-c356-42fd-acc7-1aa6a9248f04_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YPU/2025-12-02/image/7eefffd5-c356-42fd-acc7-1aa6a9248f04_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b000972-93a5-52c8-af34-fcca444aa805
2025-12-02 19:05:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b000972-93a5-52c8-af34-fcca444aa805, skipping ID generation
2025-12-02 19:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b000972-93a5-52c8-af34-fcca444aa805 with scrape type 1
2025-12-02 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8b000972-93a5-52c8-af34-fcca444aa805 from tracking dictionaries
2025-12-02 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b000972-93a5-52c8-af34-fcca444aa805 sending to next pipeline
2025-12-02 19:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8b000972-93a5-52c8-af34-fcca444aa805, identifier: 117367108
2025-12-02 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX70WLG/2025-12-02/image/b816ce11-3c58-4f62-b4be-56af9d253bbe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue)
2025-12-02 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX70WLG/2025-12-02/image/ec616cd3-ad8f-47d2-ad8e-99f7e7ff8532_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117575865?view=catalogue)
2025-12-02 19:05:42 [astonbarclay.gb] INFO: Found listing with ID: 117269087
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269087%27 HTTP/1.1" 200 None
2025-12-02 19:05:42 [astonbarclay.gb] INFO: Scrape type for 117269087: 2
2025-12-02 19:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8b000972-93a5-52c8-af34-fcca444aa805 with identifier: 117367108
2025-12-02 19:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8b000972-93a5-52c8-af34-fcca444aa805 with identifier: 117367108
2025-12-02 19:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8b000972-93a5-52c8-af34-fcca444aa805 with identifier: 117367108 to the API
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DV22YPU/2025-12-02/image/7eefffd5-c356-42fd-acc7-1aa6a9248f04_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '8b000972-93a5-52c8-af34-fcca444aa805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV22YPU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117367108',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 32583,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33341,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/9bad5488-fd1a-4284-8706-28b11421dd56_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32835,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/bc48cec2-274a-4e49-9455-9fd66c032e26_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34393,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/e25764f2-c889-4a89-9a9b-1eb88576bd39_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35839,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/06de60c5-e95f-4753-8ac4-468df027dc9e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46861,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/ca885337-157f-4243-8d09-d25047f10040_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57397,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/729b4fa0-65d0-401c-ad91-9bfd7fac6daf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52597,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/58d70710-a531-4d92-a739-d38d6095d2cd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53433,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/a779294a-aba2-4feb-8709-4f8f13825190_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b000972-93a5-52c8-af34-fcca444aa805/8b000972-93a5-52c8-af34-fcca444aa805_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54176,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YPU/2025-12-02/image/7eefffd5-c356-42fd-acc7-1aa6a9248f04_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-30',
 'seller_name': 'Zenith',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi Premium 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 TGDi Premium 5dr 2WD',
 'vin': None,
 'year': 2022}
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117367108%27 HTTP/1.1" 200 None
2025-12-02 19:05:42 [astonbarclay.gb] INFO: Saving data for 117367108: {'created_time': 1764702342.842524, 'last_price_update_time': 1764702342.842535, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117367108') HTTP/1.1" 204 0
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0406c90>
2025-12-02 19:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5908229-1f07-55ad-9804-200c4ea79010
2025-12-02 19:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf067a090>
2025-12-02 19:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252F9cb637a5-f120-4f14-b5f1-772f8a584fcd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/9cb637a5-f120-4f14-b5f1-772f8a584fcd_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05a66706-c358-5123-bcef-8417c5455619
2025-12-02 19:05:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117573137, 'registration': 'SH19MLJ', 'account': 'STA058', 'make': 'BMW', 'model': '2 SERIES ACTIVE TOURER', 'derivative': '225xe Sport Premium 5dr Auto', 'mileage': 138907, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-08', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/77f44c88-f99b-400c-a1da-e20dfa0ee251_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/9e9ec85b-6086-4be7-90c5-70c787f2e662_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/f19df929-72e2-46a6-b8ce-f66cecbfe627_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/46b635f5-89a1-4632-abac-0f73c458818c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/18e8432c-19e1-4a62-b659-580d19c834f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/5bb20aa2-88ac-42b4-9b86-687530287ba0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/939f3fd3-1a0f-4f6b-8d49-982606fdda6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/4f9feb4f-1af4-4601-aabc-ddadfe2a6806_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/bbcc9493-2a18-4eb9-9846-e7062fc08a0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/dd1cd0ac-3e25-450e-bc07-22a2c7506566_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/fe0bf958-d29c-435e-9a3e-c7a31ab1b786_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire - VOSA STATES, 42K, 73K, 102K, 131K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 52, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e6687c2b-d09e-4d42-bbee-c889664ac7ad.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117573137, 'registration': 'SH19MLJ', 'account': 'STA058', 'make': 'BMW', 'model': '2 SERIES ACTIVE TOURER', 'derivative': '225xe Sport Premium 5dr Auto', 'mileage': 138907, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-08', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/77f44c88-f99b-400c-a1da-e20dfa0ee251_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/9e9ec85b-6086-4be7-90c5-70c787f2e662_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/f19df929-72e2-46a6-b8ce-f66cecbfe627_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/46b635f5-89a1-4632-abac-0f73c458818c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/18e8432c-19e1-4a62-b659-580d19c834f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/5bb20aa2-88ac-42b4-9b86-687530287ba0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/939f3fd3-1a0f-4f6b-8d49-982606fdda6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/4f9feb4f-1af4-4601-aabc-ddadfe2a6806_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/bbcc9493-2a18-4eb9-9846-e7062fc08a0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/dd1cd0ac-3e25-450e-bc07-22a2c7506566_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH19MLJ/2025-11-28/image/fe0bf958-d29c-435e-9a3e-c7a31ab1b786_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire - VOSA STATES, 42K, 73K, 102K, 131K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 52, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e6687c2b-d09e-4d42-bbee-c889664ac7ad.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d78e486b-b0af-5a68-8d8e-531e003d6317 with identifier: 117573137
2025-12-02 19:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d78e486b-b0af-5a68-8d8e-531e003d6317 with scrape type 2
2025-12-02 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d78e486b-b0af-5a68-8d8e-531e003d6317 with scrape type 2
2025-12-02 19:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d78e486b-b0af-5a68-8d8e-531e003d6317, identifier: 117573137
2025-12-02 19:05:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 115422003, 'registration': 'A2UOV', 'account': 'STE131', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '2.0 TSI 4MOTION R 5dr DSG', 'mileage': 57752, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-06-10', 'fuel': 'Petrol', 'motExpiry': '2025-06-09', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/A2UOV/2025-09-18/image/ccc15175-e3bf-4e00-ad0d-132ada753d1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/32485ed9-e7a8-4072-8dd0-6aa655fc8b2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/193d37ce-cb43-472e-9ffc-c01f047e2690_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/b3ecb7cb-8fe0-4ff3-8538-4ab8db299eeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/fe6a0c77-4db4-447f-af9e-89669cd126ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/ae94a4ee-997e-45e6-8277-7da0a0643237_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/bf982db3-14dc-4ccf-9a01-8e41be32c5d8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'CHERISED PLATE TO REMAIN WITH VEHICLE AS PER VENDOR', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 197, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7d439c6f-76c8-430c-9e89-a0768a6998c7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 115422003, 'registration': 'A2UOV', 'account': 'STE131', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '2.0 TSI 4MOTION R 5dr DSG', 'mileage': 57752, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-06-10', 'fuel': 'Petrol', 'motExpiry': '2025-06-09', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/A2UOV/2025-09-18/image/ccc15175-e3bf-4e00-ad0d-132ada753d1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/32485ed9-e7a8-4072-8dd0-6aa655fc8b2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/193d37ce-cb43-472e-9ffc-c01f047e2690_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/b3ecb7cb-8fe0-4ff3-8538-4ab8db299eeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/fe6a0c77-4db4-447f-af9e-89669cd126ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/ae94a4ee-997e-45e6-8277-7da0a0643237_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/bf982db3-14dc-4ccf-9a01-8e41be32c5d8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'CHERISED PLATE TO REMAIN WITH VEHICLE AS PER VENDOR', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 197, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7d439c6f-76c8-430c-9e89-a0768a6998c7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e8ecdcf-db96-5832-a676-c26fb5f17208 with identifier: 115422003
2025-12-02 19:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e8ecdcf-db96-5832-a676-c26fb5f17208 with scrape type 2
2025-12-02 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e8ecdcf-db96-5832-a676-c26fb5f17208 with scrape type 2
2025-12-02 19:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5e8ecdcf-db96-5832-a676-c26fb5f17208, identifier: 115422003
2025-12-02 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d33bb0b9-55e0-4c9c-8bc8-efe75de1c26d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547879?view=catalogue)
2025-12-02 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23LXW/2025-12-02/image/8008c348-29d8-4ae4-954a-a4af26dc5c57_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579914?view=catalogue)
2025-12-02 19:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d78e486b-b0af-5a68-8d8e-531e003d6317 with identifier: 117573137
2025-12-02 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d78e486b-b0af-5a68-8d8e-531e003d6317 with identifier: 117573137
2025-12-02 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'startline motor finance ltd', 'price_includes_vat': False, 'title': 'bmw 2 series active tourer 225xe sport premium 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': '2 series active tourer', 'transmission': 'automatic', 'engine': '1.5l', 'fuel_type': 'petrol/plugin electric hybrid', 'odometer': 138907, 'odometer_reading_unit': 'mi', 'registration_date': '2019-04-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573137', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '225xe sport premium 5dr auto', 'license_plate': 'sh19mlj', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 52, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'd78e486b-b0af-5a68-8d8e-531e003d6317', 'current_year_diff': 6, 'age_in_months': 79, 'make_model': 'bmw 2 series active tourer', 'sanitized_make': 'bmw', 'odometer_in_km': 223548}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 52,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'petrol/plugin electric hybrid',
     'id': 'd78e486b-b0af-5a68-8d8e-531e003d6317',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'sh19mlj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573137',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'bmw',
     'make_model': 'bmw 2 series active tourer',
     'model': '2 series active tourer',
     'odometer': 138907,
     'odometer_in_km': 223548,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-04-08',
     'sanitized_make': 'bmw',
     'seller_name': 'startline motor finance ltd',
     'title': 'bmw 2 series active tourer 225xe sport premium 5dr auto',
     'transmission': 'automatic',
     'trim': '225xe sport premium 5dr auto',
     'vin': None,
     'year': 2019}
2025-12-02 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: d78e486b-b0af-5a68-8d8e-531e003d6317 spider: astonbarclay.gb
2025-12-02 19:05:43 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d78e486b-b0af-5a68-8d8e-531e003d6317 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'startline motor finance ltd', 'price_includes_vat': False, 'title': 'bmw 2 series active tourer 225xe sport premium 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': '2 series active tourer', 'transmission': 'automatic', 'engine': '1.5l', 'fuel_type': 'petrol/plugin electric hybrid', 'odometer': 138907, 'odometer_reading_unit': 'mi', 'registration_date': '2019-04-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573137', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '225xe sport premium 5dr auto', 'license_plate': 'sh19mlj', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 52, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'd78e486b-b0af-5a68-8d8e-531e003d6317', 'current_year_diff': 6, 'age_in_months': 79, 'make_model': 'bmw 2 series active tourer', 'sanitized_make': 'bmw', 'odometer_in_km': 223548}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 52,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'petrol/plugin electric hybrid',
     'id': 'd78e486b-b0af-5a68-8d8e-531e003d6317',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'sh19mlj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573137',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'bmw',
     'make_model': 'bmw 2 series active tourer',
     'model': '2 series active tourer',
     'odometer': 138907,
     'odometer_in_km': 223548,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-04-08',
     'sanitized_make': 'bmw',
     'seller_name': 'startline motor finance ltd',
     'title': 'bmw 2 series active tourer 225xe sport premium 5dr auto',
     'transmission': 'automatic',
     'trim': '225xe sport premium 5dr auto',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 52,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'd78e486b-b0af-5a68-8d8e-531e003d6317',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SH19MLJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573137',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 138907,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-08',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'BMW 2 SERIES ACTIVE TOURER 225xe Sport Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': '225xe Sport Premium 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573137%27 HTTP/1.1" 200 None
2025-12-02 19:05:43 [astonbarclay.gb] INFO: Saving data for 117573137: {'auction_closing_time': 1765188000.0, 'created_time': 1764579729.805274, 'last_price_update_time': 1764702343.729642}
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117573137') HTTP/1.1" 204 0
2025-12-02 19:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5e8ecdcf-db96-5832-a676-c26fb5f17208 with identifier: 115422003
2025-12-02 19:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5e8ecdcf-db96-5832-a676-c26fb5f17208 with identifier: 115422003
2025-12-02 19:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5e8ecdcf-db96-5832-a676-c26fb5f17208 with identifier: 115422003 to the API
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115422003?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5e8ecdcf-db96-5832-a676-c26fb5f17208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'A2UOV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115422003',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC HATCHBACK',
 'odometer': 57752,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-10',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'VOLKSWAGEN T-ROC HATCHBACK 2.0 TSI 4MOTION R 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TSI 4MOTION R 5dr DSG',
 'vin': None,
 'year': 2020}
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115422003%27 HTTP/1.1" 200 None
2025-12-02 19:05:44 [astonbarclay.gb] INFO: Saving data for 115422003: {'auction_closing_time': 1765188000.0, 'created_time': 1764615700.204448, 'last_price_update_time': 1764702344.000526}
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115422003') HTTP/1.1" 204 0
2025-12-02 19:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09c0c50>
2025-12-02 19:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252Fed2ba0c5-7f15-4811-8962-4fb015f5e308_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/ed2ba0c5-7f15-4811-8962-4fb015f5e308_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb
2025-12-02 19:05:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117579253, 'registration': 'OV69UDO', 'account': 'WEF001', 'make': 'JAGUAR', 'model': 'I-PACE ESTATE', 'derivative': '294kW EV400 SE 90kWh 5dr Auto', 'mileage': 69671, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-10-31', 'fuel': 'Electric', 'motExpiry': '2025-11-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'Ex-Private Hire - VOSA STATES, 37K, 50K, 59K, 60K', 'virtual': False, 'seller': 'WeFlex', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5260c130-4187-4adb-82ec-48c71a014637.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117579253, 'registration': 'OV69UDO', 'account': 'WEF001', 'make': 'JAGUAR', 'model': 'I-PACE ESTATE', 'derivative': '294kW EV400 SE 90kWh 5dr Auto', 'mileage': 69671, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-10-31', 'fuel': 'Electric', 'motExpiry': '2025-11-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'Ex-Private Hire - VOSA STATES, 37K, 50K, 59K, 60K', 'virtual': False, 'seller': 'WeFlex', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5260c130-4187-4adb-82ec-48c71a014637.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af3a4db0-ee91-5c68-a341-da61d7ed8b94 with identifier: 117579253
2025-12-02 19:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af3a4db0-ee91-5c68-a341-da61d7ed8b94 with scrape type 1
2025-12-02 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item af3a4db0-ee91-5c68-a341-da61d7ed8b94
2025-12-02 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item af3a4db0-ee91-5c68-a341-da61d7ed8b94
2025-12-02 19:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: af3a4db0-ee91-5c68-a341-da61d7ed8b94, identifier: 117579253
2025-12-02 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5651e155-0b6a-469d-8c95-8aaf7e9c8b56_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547879?view=catalogue)
2025-12-02 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SM70DWN/2025-11-28/image/4dd6b837-5cdf-4b1c-88aa-f208703778c9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117581526?view=catalogue)
2025-12-02 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e3d3cd61-9061-4707-bdc7-e31e59945cf0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549690?view=catalogue)
2025-12-02 19:05:44 [astonbarclay.gb] INFO: Found listing with ID: 117683297
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117683297%27 HTTP/1.1" 200 None
2025-12-02 19:05:44 [astonbarclay.gb] INFO: Scrape type for 117683297: 1
2025-12-02 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117579278?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: af3a4db0-ee91-5c68-a341-da61d7ed8b94 with identifier: 117579253
2025-12-02 19:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: af3a4db0-ee91-5c68-a341-da61d7ed8b94 with identifier: 117579253
2025-12-02 19:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'weflex', 'price_includes_vat': False, 'title': 'jaguar i-pace estate 294kw ev400 se 90kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'jaguar', 'model': 'i-pace estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 69671, 'odometer_reading_unit': 'mi', 'registration_date': '2019-10-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579253', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '294kw ev400 se 90kwh 5dr auto', 'license_plate': 'ov69udo', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'af3a4db0-ee91-5c68-a341-da61d7ed8b94', 'current_year_diff': 6, 'age_in_months': 73, 'make_model': 'jaguar i-pace estate', 'sanitized_make': 'jaguar', 'odometer_in_km': 112124} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': 'af3a4db0-ee91-5c68-a341-da61d7ed8b94',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ov69udo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579253',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'jaguar',
     'make_model': 'jaguar i-pace estate',
     'model': 'i-pace estate',
     'odometer': 69671,
     'odometer_in_km': 112124,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-10-31',
     'sanitized_make': 'jaguar',
     'seller_name': 'weflex',
     'title': 'jaguar i-pace estate 294kw ev400 se 90kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '294kw ev400 se 90kwh 5dr auto',
     'vin': None,
     'year': 2019}
2025-12-02 19:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: af3a4db0-ee91-5c68-a341-da61d7ed8b94 spider: astonbarclay.gb
2025-12-02 19:05:44 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: af3a4db0-ee91-5c68-a341-da61d7ed8b94 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'weflex', 'price_includes_vat': False, 'title': 'jaguar i-pace estate 294kw ev400 se 90kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'jaguar', 'model': 'i-pace estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 69671, 'odometer_reading_unit': 'mi', 'registration_date': '2019-10-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579253', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '294kw ev400 se 90kwh 5dr auto', 'license_plate': 'ov69udo', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'af3a4db0-ee91-5c68-a341-da61d7ed8b94', 'current_year_diff': 6, 'age_in_months': 73, 'make_model': 'jaguar i-pace estate', 'sanitized_make': 'jaguar', 'odometer_in_km': 112124} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': 'af3a4db0-ee91-5c68-a341-da61d7ed8b94',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ov69udo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579253',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'jaguar',
     'make_model': 'jaguar i-pace estate',
     'model': 'i-pace estate',
     'odometer': 69671,
     'odometer_in_km': 112124,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-10-31',
     'sanitized_make': 'jaguar',
     'seller_name': 'weflex',
     'title': 'jaguar i-pace estate 294kw ev400 se 90kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '294kw ev400 se 90kwh 5dr auto',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'af3a4db0-ee91-5c68-a341-da61d7ed8b94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OV69UDO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579253',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JAGUAR',
 'model': 'I-PACE ESTATE',
 'odometer': 69671,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-31',
 'seller_name': 'WeFlex',
 'title': 'JAGUAR I-PACE ESTATE 294kW EV400 SE 90kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '294kW EV400 SE 90kWh 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579253%27 HTTP/1.1" 200 None
2025-12-02 19:05:44 [astonbarclay.gb] INFO: Saving data for 117579253: {'created_time': 1764702344.553769, 'last_price_update_time': 1764702344.55378, 'auction_closing_time': 1765188000.0}
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117579253') HTTP/1.1" 204 0
2025-12-02 19:05:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117548415, 'registration': 'DF23EFP', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 27862, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23EFP/2025-12-02/image/b160bcd8-b432-434b-aaf5-cf990e15cfa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/242da418-e4a5-47c5-86df-791435213ad8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/edb4e0d2-59aa-4f97-bf25-e19c6c4cef62_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/27460c5f-1b2b-4e2c-a41b-76f559c12037_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/84a3fdc4-5449-447f-9bb6-e09e0e46f728_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/c95f81a8-6a44-48d6-ad23-f5a1097e6d2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/35893c72-f64a-48a3-a829-268f37c0dbe6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/bf068681-0b9c-4eb8-8ec6-bd1bd78b92d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/b84613d9-76a5-4054-9861-cc2ce2c35db3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/ec1196f8-088f-4188-ab2b-62b32a9fb876_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/24-19K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/411cfcae-19ff-498a-8375-28540be79a69.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117548415, 'registration': 'DF23EFP', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 27862, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23EFP/2025-12-02/image/b160bcd8-b432-434b-aaf5-cf990e15cfa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/242da418-e4a5-47c5-86df-791435213ad8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/edb4e0d2-59aa-4f97-bf25-e19c6c4cef62_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/27460c5f-1b2b-4e2c-a41b-76f559c12037_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/84a3fdc4-5449-447f-9bb6-e09e0e46f728_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/c95f81a8-6a44-48d6-ad23-f5a1097e6d2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/35893c72-f64a-48a3-a829-268f37c0dbe6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/bf068681-0b9c-4eb8-8ec6-bd1bd78b92d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/b84613d9-76a5-4054-9861-cc2ce2c35db3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23EFP/2025-12-02/image/ec1196f8-088f-4188-ab2b-62b32a9fb876_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/24-19K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/411cfcae-19ff-498a-8375-28540be79a69.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59 with identifier: 117548415
2025-12-02 19:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59 with scrape type 2
2025-12-02 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59 with scrape type 2
2025-12-02 19:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59, identifier: 117548415
2025-12-02 19:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117444820?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59 with identifier: 117548415
2025-12-02 19:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59 with identifier: 117548415
2025-12-02 19:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59 with identifier: 117548415 to the API
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272cfb03ad-19f3-5e2d-895b-d5ded5eebb59%27 HTTP/1.1" 200 None
2025-12-02 19:05:45 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:05:44 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117548415?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2cfb03ad-19f3-5e2d-895b-d5ded5eebb59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DF23EFP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117548415',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 27862,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-27',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548415%27 HTTP/1.1" 200 None
2025-12-02 19:05:45 [astonbarclay.gb] INFO: Saving data for 117548415: {'auction_closing_time': 1765188000.0, 'created_time': 1764615683.106336, 'last_price_update_time': 1764702345.024988}
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117548415') HTTP/1.1" 204 0
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf069d310>
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252Fb816ce11-3c58-4f62-b4be-56af9d253bbe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/b816ce11-3c58-4f62-b4be-56af9d253bbe_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf033e390>
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX70WLG%252F2025-12-02%252Fimage%252Fec616cd3-ad8f-47d2-ad8e-99f7e7ff8532_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX70WLG/2025-12-02/image/ec616cd3-ad8f-47d2-ad8e-99f7e7ff8532_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071
2025-12-02 19:05:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8ce5fd8-d9f6-5a60-9f69-9352c4934071, skipping ID generation
2025-12-02 19:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071 with scrape type 1
2025-12-02 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d8ce5fd8-d9f6-5a60-9f69-9352c4934071 from tracking dictionaries
2025-12-02 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8ce5fd8-d9f6-5a60-9f69-9352c4934071 sending to next pipeline
2025-12-02 19:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d8ce5fd8-d9f6-5a60-9f69-9352c4934071, identifier: 117575865
2025-12-02 19:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71UBN/2025-11-27/image/a924f394-9864-436c-a3f6-203461544cd5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117547879?view=catalogue)
2025-12-02 19:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/8e4c409c-bce9-4e07-b52a-0b3d6fa98543_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:05:45 [astonbarclay.gb] INFO: Found listing with ID: 117505585
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505585%27 HTTP/1.1" 200 None
2025-12-02 19:05:45 [astonbarclay.gb] INFO: Scrape type for 117505585: 2
2025-12-02 19:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d8ce5fd8-d9f6-5a60-9f69-9352c4934071 with identifier: 117575865
2025-12-02 19:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d8ce5fd8-d9f6-5a60-9f69-9352c4934071 with identifier: 117575865
2025-12-02 19:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d8ce5fd8-d9f6-5a60-9f69-9352c4934071 with identifier: 117575865 to the API
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/HX70WLG/2025-12-02/image/ec616cd3-ad8f-47d2-ad8e-99f7e7ff8532_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 34,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'd8ce5fd8-d9f6-5a60-9f69-9352c4934071',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'HX70WLG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117575865',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 44842,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24674,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/04fd62a6-200e-4c32-b8be-7b31f7d9686d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27139,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/74a8d578-ce4a-4aba-9fa7-c6749bfd1269_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24062,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7e260bdb-b0a5-432d-a2bb-fb728ca8cc43_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25587,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/a4fffaf1-69df-469e-9558-85d0cb1e0976_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37528,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/caf86002-0538-424f-97e3-fc0dfbb19aa2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41318,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/0298b102-c1c3-4f2e-8d7f-1126dd6ecf39_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45012,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/7b43982a-365a-4151-b301-c570c452a249_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50636,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/1c727fec-cd51-4531-96ae-f0b2148a1a2e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42179,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/fadb004d-c1dc-409c-b579-a02163181fc2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42863,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/b816ce11-3c58-4f62-b4be-56af9d253bbe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ce5fd8-d9f6-5a60-9f69-9352c4934071/d8ce5fd8-d9f6-5a60-9f69-9352c4934071_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43750,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/HX70WLG/2025-12-02/image/ec616cd3-ad8f-47d2-ad8e-99f7e7ff8532_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-30',
 'seller_name': 'Zenith',
 'title': 'BMW 3 SERIES SALOON 330e M Sport 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e M Sport 4dr Step Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117575865%27 HTTP/1.1" 200 None
2025-12-02 19:05:46 [astonbarclay.gb] INFO: Saving data for 117575865: {'created_time': 1764702346.053573, 'last_price_update_time': 1764702346.053583, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117575865') HTTP/1.1" 204 0
2025-12-02 19:05:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0848cd0>
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252Fd33bb0b9-55e0-4c9c-8bc8-efe75de1c26d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d33bb0b9-55e0-4c9c-8bc8-efe75de1c26d_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf061bc90>
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F8008c348-29d8-4ae4-954a-a4af26dc5c57_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/8008c348-29d8-4ae4-954a-a4af26dc5c57_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cfb50dee-5647-5871-bb16-abf357e3da3b
2025-12-02 19:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD23CGF/2025-12-01/image/8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115510423?view=catalogue)
2025-12-02 19:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72BBX/2025-12-02/image/412e088a-4ba8-4e82-a95a-1a8564417a1e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117133968?view=catalogue)
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09d67d0>
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252F5651e155-0b6a-469d-8c95-8aaf7e9c8b56_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5651e155-0b6a-469d-8c95-8aaf7e9c8b56_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0719d90>
2025-12-02 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F4dd6b837-5cdf-4b1c-88aa-f208703778c9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/4dd6b837-5cdf-4b1c-88aa-f208703778c9_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06bea90>
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252Fe3d3cd61-9061-4707-bdc7-e31e59945cf0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e3d3cd61-9061-4707-bdc7-e31e59945cf0_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449
2025-12-02 19:05:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117579278, 'registration': 'KF21LKL', 'account': 'WEF001', 'make': 'NISSAN', 'model': 'LEAF HATCHBACK', 'derivative': '160kW e+ N-Connecta 62kWh 5dr Auto', 'mileage': 98945, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-07-30', 'fuel': 'Electric', 'motExpiry': '2026-05-20', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KF21LKL/2025-12-02/image/8803cd74-9e6d-4d6d-adc6-604bc0d743ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/0ac72ded-51d8-48aa-9aca-2e80805677e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/d432e2f1-8289-44ec-b1a1-74e9fe980a38_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/a26a3eec-ff02-405c-b4ba-a7f0f46385e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/9ef3f7ed-3642-489f-9e32-8a508be207b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/acfb39ae-e3e4-453a-bc34-1ad7603db7d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3aa77e18-bd33-4213-aa94-bf97effd3b64_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3c4d3f60-f0ae-491c-823d-606511c0bde1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/076651fc-5cd5-460b-ac62-fcb21ea4d517_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/bdc3bf57-df33-42d9-b854-9cc63a6b08dd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire - VOSA STATES, 59K, 74K, 75K, 79K', 'virtual': False, 'seller': 'WeFlex', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8cdd6163-7b36-4d6d-a958-e32f9c381075.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117579278, 'registration': 'KF21LKL', 'account': 'WEF001', 'make': 'NISSAN', 'model': 'LEAF HATCHBACK', 'derivative': '160kW e+ N-Connecta 62kWh 5dr Auto', 'mileage': 98945, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-07-30', 'fuel': 'Electric', 'motExpiry': '2026-05-20', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KF21LKL/2025-12-02/image/8803cd74-9e6d-4d6d-adc6-604bc0d743ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/0ac72ded-51d8-48aa-9aca-2e80805677e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/d432e2f1-8289-44ec-b1a1-74e9fe980a38_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/a26a3eec-ff02-405c-b4ba-a7f0f46385e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/9ef3f7ed-3642-489f-9e32-8a508be207b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/acfb39ae-e3e4-453a-bc34-1ad7603db7d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3aa77e18-bd33-4213-aa94-bf97effd3b64_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3c4d3f60-f0ae-491c-823d-606511c0bde1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/076651fc-5cd5-460b-ac62-fcb21ea4d517_removebg.jpg?w=600', 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/bdc3bf57-df33-42d9-b854-9cc63a6b08dd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire - VOSA STATES, 59K, 74K, 75K, 79K', 'virtual': False, 'seller': 'WeFlex', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8cdd6163-7b36-4d6d-a958-e32f9c381075.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80dfac32-5983-56a1-bd7a-ffd6b8e792b3 with identifier: 117579278
2025-12-02 19:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3 with scrape type 1
2025-12-02 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F8803cd74-9e6d-4d6d-adc6-604bc0d743ec_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/8803cd74-9e6d-4d6d-adc6-604bc0d743ec_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117580116, 'registration': 'LA71YGC', 'account': 'WEF001', 'make': 'KIA', 'model': 'E-NIRO ELECTRIC ESTATE', 'derivative': '150kW 3 64kWh 5dr Auto', 'mileage': 121147, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-02-01', 'fuel': 'Electric', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LA71YGC/2025-12-02/image/4be7c981-ef50-4c1d-ac14-122a4e1fd8ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/d1466b5f-847a-472e-9ea2-45ed322ef80f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a361c7e9-c8cf-4db7-80d9-6d022838008a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/7437b13a-40b0-4ab7-acf8-b4374c142525_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/ce5d59cf-e2fb-4d5e-8f6c-3134eac5327d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/54ee10cd-9dc1-4391-bb14-c6276e4f0c17_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/800e1cc0-dd05-4ff2-afa1-1c1b688cbc28_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a3e6416e-e6bc-44bc-9589-1da1d266124e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/9a4ad354-ead6-4282-8f95-a5ba52185852_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/18121891-be91-4f68-9a71-325056aec16f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/6da24ed3-4f25-4a82-9f14-9adf60e738e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/fdadedc6-8cea-44cf-ba15-3d271faed6e8_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire - 66K, 87K, 104K, 108K', 'virtual': False, 'seller': 'WeFlex', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9b15945f-80fc-425c-907e-482a24678770.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117580116, 'registration': 'LA71YGC', 'account': 'WEF001', 'make': 'KIA', 'model': 'E-NIRO ELECTRIC ESTATE', 'derivative': '150kW 3 64kWh 5dr Auto', 'mileage': 121147, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-02-01', 'fuel': 'Electric', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LA71YGC/2025-12-02/image/4be7c981-ef50-4c1d-ac14-122a4e1fd8ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/d1466b5f-847a-472e-9ea2-45ed322ef80f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a361c7e9-c8cf-4db7-80d9-6d022838008a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/7437b13a-40b0-4ab7-acf8-b4374c142525_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/ce5d59cf-e2fb-4d5e-8f6c-3134eac5327d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/54ee10cd-9dc1-4391-bb14-c6276e4f0c17_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/800e1cc0-dd05-4ff2-afa1-1c1b688cbc28_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a3e6416e-e6bc-44bc-9589-1da1d266124e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/9a4ad354-ead6-4282-8f95-a5ba52185852_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/18121891-be91-4f68-9a71-325056aec16f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/6da24ed3-4f25-4a82-9f14-9adf60e738e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/fdadedc6-8cea-44cf-ba15-3d271faed6e8_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire - 66K, 87K, 104K, 108K', 'virtual': False, 'seller': 'WeFlex', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9b15945f-80fc-425c-907e-482a24678770.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41609080-c5a8-5573-b549-55230e8373b6 with identifier: 117580116
2025-12-02 19:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41609080-c5a8-5573-b549-55230e8373b6 with scrape type 1
2025-12-02 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F4be7c981-ef50-4c1d-ac14-122a4e1fd8ef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/4be7c981-ef50-4c1d-ac14-122a4e1fd8ef_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD72LHT/2025-11-27/image/03e383a1-6f32-42b1-b15e-6610b3d35e84_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561425?view=catalogue)
2025-12-02 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/03dce60b-8f9f-4eff-8776-1fd5a7414cce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:05:47 [astonbarclay.gb] INFO: Found listing with ID: 116928625
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928625%27 HTTP/1.1" 200 None
2025-12-02 19:05:47 [astonbarclay.gb] INFO: Scrape type for 116928625: 2
2025-12-02 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117639372?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117639666?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117444820, 'registration': 'WV70FWM', 'account': 'DAY005', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2 [83] Elite 5dr', 'mileage': 27354, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-09-25', 'fuel': 'Petrol', 'motExpiry': '2026-09-26', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WV70FWM/2025-11-28/image/ea711a78-147f-4fee-b63a-c392f18552de_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/d886fcf1-9e3e-4471-9828-4864a89452cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/19039a4e-e9b2-480b-b833-854b6486573b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/954c1f6b-0fc4-40d6-9bef-7e932b6648e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/0d55b7cf-54c0-42da-8101-95074aed2570_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/e524afe1-71f7-4ad1-8d6a-fee1321df981_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/52d586f3-5f7c-4c6f-b115-d31517e34b35_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/5648ef68-d68f-4a04-8f82-fac60f22248a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/50fa8db1-efed-4ed3-9d2d-bcf30e725aac_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/21 5K, 9/23 14K, 9/24 20K, 9/25 25K', 'remarks': 'NO V5, UNKNOWN AMOUNT OF OWNERS, VOSA STATES 14K, 20K, 25K', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e3968400-ad55-4e84-8243-c96e80a49793.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2025-12-02 19:05:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117444820, 'registration': 'WV70FWM', 'account': 'DAY005', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2 [83] Elite 5dr', 'mileage': 27354, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-09-25', 'fuel': 'Petrol', 'motExpiry': '2026-09-26', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WV70FWM/2025-11-28/image/ea711a78-147f-4fee-b63a-c392f18552de_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/d886fcf1-9e3e-4471-9828-4864a89452cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/19039a4e-e9b2-480b-b833-854b6486573b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/954c1f6b-0fc4-40d6-9bef-7e932b6648e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/0d55b7cf-54c0-42da-8101-95074aed2570_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/e524afe1-71f7-4ad1-8d6a-fee1321df981_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/52d586f3-5f7c-4c6f-b115-d31517e34b35_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/5648ef68-d68f-4a04-8f82-fac60f22248a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV70FWM/2025-11-28/image/50fa8db1-efed-4ed3-9d2d-bcf30e725aac_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/21 5K, 9/23 14K, 9/24 20K, 9/25 25K', 'remarks': 'NO V5, UNKNOWN AMOUNT OF OWNERS, VOSA STATES 14K, 20K, 25K', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e3968400-ad55-4e84-8243-c96e80a49793.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2025-12-02 19:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f30bf7-8810-5cda-9341-dc3c7c10979c with identifier: 117444820
2025-12-02 19:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f30bf7-8810-5cda-9341-dc3c7c10979c with scrape type 2
2025-12-02 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55f30bf7-8810-5cda-9341-dc3c7c10979c with scrape type 2
2025-12-02 19:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 55f30bf7-8810-5cda-9341-dc3c7c10979c, identifier: 117444820
2025-12-02 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD23CGF/2025-12-01/image/c80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115510423?view=catalogue)
2025-12-02 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72BBX/2025-12-02/image/af01cd5b-f2f8-4b01-abc4-59148156fff7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117133968?view=catalogue)
2025-12-02 19:05:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F0ac72ded-51d8-48aa-9aca-2e80805677e1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/0ac72ded-51d8-48aa-9aca-2e80805677e1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252Fd1466b5f-847a-472e-9ea2-45ed322ef80f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/d1466b5f-847a-472e-9ea2-45ed322ef80f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 55f30bf7-8810-5cda-9341-dc3c7c10979c with identifier: 117444820
2025-12-02 19:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 55f30bf7-8810-5cda-9341-dc3c7c10979c with identifier: 117444820
2025-12-02 19:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 55f30bf7-8810-5cda-9341-dc3c7c10979c with identifier: 117444820 to the API
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117444820?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '55f30bf7-8810-5cda-9341-dc3c7c10979c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WV70FWM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117444820',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND X HATCHBACK',
 'odometer': 27354,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-25',
 'seller_name': 'Days Fleet',
 'title': 'VAUXHALL CROSSLAND X HATCHBACK 1.2 [83] Elite 5dr',
 'transmission': 'manual',
 'trim': '1.2 [83] Elite 5dr',
 'vin': None,
 'year': 2020}
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444820%27 HTTP/1.1" 200 None
2025-12-02 19:05:47 [astonbarclay.gb] INFO: Saving data for 117444820: {'auction_closing_time': 1765188000.0, 'created_time': 1764356704.305649, 'last_price_update_time': 1764702347.786555}
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117444820') HTTP/1.1" 204 0
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac9490>
2025-12-02 19:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71UBN%252F2025-11-27%252Fimage%252Fa924f394-9864-436c-a3f6-203461544cd5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71UBN/2025-11-27/image/a924f394-9864-436c-a3f6-203461544cd5_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb
2025-12-02 19:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2f7bf4a-ca7b-5385-977a-21875d6c4bbb, skipping ID generation
2025-12-02 19:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb with scrape type 1
2025-12-02 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb from tracking dictionaries
2025-12-02 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2f7bf4a-ca7b-5385-977a-21875d6c4bbb sending to next pipeline
2025-12-02 19:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a2f7bf4a-ca7b-5385-977a-21875d6c4bbb, identifier: 117547879
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1cbc210>
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_13.jpg HTTP/1.1" 201 0
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F8e4c409c-bce9-4e07-b52a-0b3d6fa98543_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/8e4c409c-bce9-4e07-b52a-0b3d6fa98543_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:48 [astonbarclay.gb] INFO: Found listing with ID: 116928605
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928605%27 HTTP/1.1" 200 None
2025-12-02 19:05:48 [astonbarclay.gb] INFO: Scrape type for 116928605: 2
2025-12-02 19:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117452073?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a2f7bf4a-ca7b-5385-977a-21875d6c4bbb with identifier: 117547879
2025-12-02 19:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a2f7bf4a-ca7b-5385-977a-21875d6c4bbb with identifier: 117547879
2025-12-02 19:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a2f7bf4a-ca7b-5385-977a-21875d6c4bbb with identifier: 117547879 to the API
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/OV71UBN/2025-11-27/image/a924f394-9864-436c-a3f6-203461544cd5_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'a2f7bf4a-ca7b-5385-977a-21875d6c4bbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OV71UBN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117547879',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 14505,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36446,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/11f4ad98-4e9a-4a14-a5a3-98bf5e125dee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35695,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5c743163-fd39-461b-a197-2f87b4477ff3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34868,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d4880a66-eb79-4858-a97a-8a49b21dd0f1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34297,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/8e838d39-c4ae-491f-b508-13df56410261_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37972,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/2537fc75-d072-47e4-bb74-34440391db58_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63611,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/ed2ba0c5-7f15-4811-8962-4fb015f5e308_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50861,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/d33bb0b9-55e0-4c9c-8bc8-efe75de1c26d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44808,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/5651e155-0b6a-469d-8c95-8aaf7e9c8b56_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f7bf4a-ca7b-5385-977a-21875d6c4bbb/a2f7bf4a-ca7b-5385-977a-21875d6c4bbb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55837,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71UBN/2025-11-27/image/a924f394-9864-436c-a3f6-203461544cd5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seller_name': 'Zenith',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech 130 GT Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 GT Premium 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547879%27 HTTP/1.1" 200 None
2025-12-02 19:05:48 [astonbarclay.gb] INFO: Saving data for 117547879: {'created_time': 1764702348.769903, 'last_price_update_time': 1764702348.769912, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117547879') HTTP/1.1" 204 0
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098fa50>
2025-12-02 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252F8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5908229-1f07-55ad-9804-200c4ea79010
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf093c7d0>
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252F412e088a-4ba8-4e82-a95a-1a8564417a1e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/412e088a-4ba8-4e82-a95a-1a8564417a1e_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05a66706-c358-5123-bcef-8417c5455619
2025-12-02 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD72LHT/2025-11-27/image/431b0595-1c7b-43da-8673-8ae777a89963_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561425?view=catalogue)
2025-12-02 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT70SXH/2025-12-02/image/c715e370-046f-4a1e-8be0-ed42422fab81_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117029988?view=catalogue)
2025-12-02 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/96678bcc-df19-44fe-8aeb-4242196ef4ab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71OMH/2025-12-02/image/f33fca43-2e07-4e31-b304-ea19212be4c4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549690?view=catalogue)
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252Fd432e2f1-8289-44ec-b1a1-74e9fe980a38_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/d432e2f1-8289-44ec-b1a1-74e9fe980a38_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252Fa361c7e9-c8cf-4db7-80d9-6d022838008a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a361c7e9-c8cf-4db7-80d9-6d022838008a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23LXW/2025-12-02/image/d5ad4d21-fd23-4dd4-a9c2-e5b9182a19e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579914?view=catalogue)
2025-12-02 19:05:49 [astonbarclay.gb] INFO: Found listing with ID: 117272082
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272082%27 HTTP/1.1" 200 None
2025-12-02 19:05:49 [astonbarclay.gb] INFO: Scrape type for 117272082: 2
2025-12-02 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117596515?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117601450?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03526d0>
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F03e383a1-6f32-42b1-b15e-6610b3d35e84_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/03e383a1-6f32-42b1-b15e-6610b3d35e84_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0433650>
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_12.jpg HTTP/1.1" 201 0
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F03dce60b-8f9f-4eff-8776-1fd5a7414cce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/03dce60b-8f9f-4eff-8776-1fd5a7414cce_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117639372, 'registration': 'LO68DDE', 'account': 'WBA003', 'make': 'CITROEN', 'model': 'C1 HATCHBACK', 'derivative': '1.0 VTi 72 Feel 3dr', 'mileage': 83059, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-02-28', 'fuel': 'Petrol', 'motExpiry': '2026-02-27', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO68DDE/2025-12-02/image/8c6173ff-61ed-401d-b432-d0c4beaf26b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/4392e7bd-b7a2-4de2-8f3a-55d4b2c5dc21_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/d22e1362-25cb-461e-ab51-a716d6f7515b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/02c23998-2ac9-4f64-9819-146596ff2c24_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/632d62c2-4dd2-4abd-9534-ca88e1e0b10d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/cfe60137-b4c4-411c-9cea-979c5b89fef7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/7ea5e44c-9ce4-4cde-9a48-7113f2c0da48_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/5c04f673-6fd7-4c5f-b46b-e7319166bffe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/0502d222-927b-4aa7-9c9c-6ef9790c2e9d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 01/25-70k', 'remarks': 'SPARE KEY - VOSA STATES 70k 55k 42k 30k', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 93, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/447b44ab-9929-4f59-9d71-79d78ff37e79.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117639372, 'registration': 'LO68DDE', 'account': 'WBA003', 'make': 'CITROEN', 'model': 'C1 HATCHBACK', 'derivative': '1.0 VTi 72 Feel 3dr', 'mileage': 83059, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-02-28', 'fuel': 'Petrol', 'motExpiry': '2026-02-27', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO68DDE/2025-12-02/image/8c6173ff-61ed-401d-b432-d0c4beaf26b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/4392e7bd-b7a2-4de2-8f3a-55d4b2c5dc21_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/d22e1362-25cb-461e-ab51-a716d6f7515b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/02c23998-2ac9-4f64-9819-146596ff2c24_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/632d62c2-4dd2-4abd-9534-ca88e1e0b10d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/cfe60137-b4c4-411c-9cea-979c5b89fef7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/7ea5e44c-9ce4-4cde-9a48-7113f2c0da48_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/5c04f673-6fd7-4c5f-b46b-e7319166bffe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/0502d222-927b-4aa7-9c9c-6ef9790c2e9d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 01/25-70k', 'remarks': 'SPARE KEY - VOSA STATES 70k 55k 42k 30k', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 93, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/447b44ab-9929-4f59-9d71-79d78ff37e79.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d66b883-b2fb-50fd-8500-2b12fa1b8e55 with identifier: 117639372
2025-12-02 19:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55 with scrape type 1
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F8c6173ff-61ed-401d-b432-d0c4beaf26b6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/8c6173ff-61ed-401d-b432-d0c4beaf26b6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117639666, 'registration': 'EN18FNK', 'account': 'WBA004', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.0T ecoTEC SRi 5dr', 'mileage': 90587, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-06-25', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN18FNK/2025-12-02/image/fa2808c8-6990-463f-887c-42f2c9bc159c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/513dffc9-9655-4df5-87c9-a27acc6dbeba_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/d1453721-a50f-4e7d-be11-4c9136acd074_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/9d3a44c8-8788-4230-82cc-6ff02c728e91_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/f9a672c9-5fd5-4d32-b88f-13b82d47ae4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/cd315941-7f16-4484-9990-2c39c6594acf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/60b39c45-6880-4e66-8d48-1a406989a5d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/740a472a-ac1e-4ee7-a7c2-869d0aa22ffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/51d11a76-ea2f-4c4a-abea-9d4095793d2f_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 06/19-10k,  06/20-23k,  05/21-34k,', 'remarks': 'VOSA STATES 85k 72k 60k 46k', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4cbd979c-8d4b-4cdc-a993-223a4cb7c7d2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117639666, 'registration': 'EN18FNK', 'account': 'WBA004', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.0T ecoTEC SRi 5dr', 'mileage': 90587, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-06-25', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN18FNK/2025-12-02/image/fa2808c8-6990-463f-887c-42f2c9bc159c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/513dffc9-9655-4df5-87c9-a27acc6dbeba_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/d1453721-a50f-4e7d-be11-4c9136acd074_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/9d3a44c8-8788-4230-82cc-6ff02c728e91_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/f9a672c9-5fd5-4d32-b88f-13b82d47ae4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/cd315941-7f16-4484-9990-2c39c6594acf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/60b39c45-6880-4e66-8d48-1a406989a5d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/740a472a-ac1e-4ee7-a7c2-869d0aa22ffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/51d11a76-ea2f-4c4a-abea-9d4095793d2f_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 06/19-10k,  06/20-23k,  05/21-34k,', 'remarks': 'VOSA STATES 85k 72k 60k 46k', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4cbd979c-8d4b-4cdc-a993-223a4cb7c7d2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f80fd4d2-4ea2-59a1-be89-d08d1cdef747 with identifier: 117639666
2025-12-02 19:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747 with scrape type 1
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252Ffa2808c8-6990-463f-887c-42f2c9bc159c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/fa2808c8-6990-463f-887c-42f2c9bc159c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02ee210>
2025-12-02 19:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD23CGF%252F2025-12-01%252Fimage%252Fc80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD23CGF/2025-12-01/image/c80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5908229-1f07-55ad-9804-200c4ea79010
2025-12-02 19:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5908229-1f07-55ad-9804-200c4ea79010, skipping ID generation
2025-12-02 19:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5908229-1f07-55ad-9804-200c4ea79010 with scrape type 1
2025-12-02 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d5908229-1f07-55ad-9804-200c4ea79010 from tracking dictionaries
2025-12-02 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5908229-1f07-55ad-9804-200c4ea79010 sending to next pipeline
2025-12-02 19:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d5908229-1f07-55ad-9804-200c4ea79010, identifier: 115510423
2025-12-02 19:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0996d90>
2025-12-02 19:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72BBX%252F2025-12-02%252Fimage%252Faf01cd5b-f2f8-4b01-abc4-59148156fff7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72BBX/2025-12-02/image/af01cd5b-f2f8-4b01-abc4-59148156fff7_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05a66706-c358-5123-bcef-8417c5455619
2025-12-02 19:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05a66706-c358-5123-bcef-8417c5455619, skipping ID generation
2025-12-02 19:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a66706-c358-5123-bcef-8417c5455619 with scrape type 1
2025-12-02 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 05a66706-c358-5123-bcef-8417c5455619 from tracking dictionaries
2025-12-02 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05a66706-c358-5123-bcef-8417c5455619 sending to next pipeline
2025-12-02 19:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 05a66706-c358-5123-bcef-8417c5455619, identifier: 117133968
2025-12-02 19:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF21LKL/2025-12-02/image/8803cd74-9e6d-4d6d-adc6-604bc0d743ec_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579278?view=catalogue)
2025-12-02 19:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/4be7c981-ef50-4c1d-ac14-122a4e1fd8ef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252Fa26a3eec-ff02-405c-b4ba-a7f0f46385e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/a26a3eec-ff02-405c-b4ba-a7f0f46385e5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F7437b13a-40b0-4ab7-acf8-b4374c142525_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/7437b13a-40b0-4ab7-acf8-b4374c142525_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d5908229-1f07-55ad-9804-200c4ea79010 with identifier: 115510423
2025-12-02 19:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d5908229-1f07-55ad-9804-200c4ea79010 with identifier: 115510423
2025-12-02 19:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mg motor uk mg4 hatchback 150kw trophy ev long range 64kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'mg4 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 14632, 'odometer_reading_unit': 'mi', 'registration_date': '2023-07-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115510423', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw trophy ev long range 64kwh 5dr auto', 'license_plate': 'fd23cgf', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'd5908229-1f07-55ad-9804-200c4ea79010', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/c80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 32022}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 30296}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/ebdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 31425}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 31599}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 40584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 44130}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 40705}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/a0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 39897}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 41537}], 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'mg motor uk mg4 hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 23547} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'd5908229-1f07-55ad-9804-200c4ea79010',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fd23cgf',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115510423',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk mg4 hatchback',
     'model': 'mg4 hatchback',
     'odometer': 14632,
     'odometer_in_km': 23547,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32022,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/c80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30296,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31425,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/ebdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31599,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40584,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44130,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40705,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39897,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/a0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41537,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-07-20',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'zenith',
     'title': 'mg motor uk mg4 hatchback 150kw trophy ev long range 64kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '150kw trophy ev long range 64kwh 5dr auto',
     'vin': None,
     'year': 2023}
2025-12-02 19:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: d5908229-1f07-55ad-9804-200c4ea79010 spider: astonbarclay.gb
2025-12-02 19:05:50 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d5908229-1f07-55ad-9804-200c4ea79010 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mg motor uk mg4 hatchback 150kw trophy ev long range 64kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'mg4 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 14632, 'odometer_reading_unit': 'mi', 'registration_date': '2023-07-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115510423', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw trophy ev long range 64kwh 5dr auto', 'license_plate': 'fd23cgf', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'd5908229-1f07-55ad-9804-200c4ea79010', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/c80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 32022}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 30296}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/ebdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 31425}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 31599}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 40584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 44130}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 40705}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/a0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 39897}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 41537}], 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'mg motor uk mg4 hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 23547} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'd5908229-1f07-55ad-9804-200c4ea79010',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fd23cgf',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115510423',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk mg4 hatchback',
     'model': 'mg4 hatchback',
     'odometer': 14632,
     'odometer_in_km': 23547,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32022,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/c80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30296,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31425,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/ebdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31599,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40584,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44130,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40705,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39897,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/a0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41537,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-07-20',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'zenith',
     'title': 'mg motor uk mg4 hatchback 150kw trophy ev long range 64kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '150kw trophy ev long range 64kwh 5dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'd5908229-1f07-55ad-9804-200c4ea79010',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FD23CGF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115510423',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MG MOTOR UK',
 'model': 'MG4 HATCHBACK',
 'odometer': 14632,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32022,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/c80d89b5-19eb-428c-b1df-38a789b20809_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30296,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/8d0c67c0-ee08-4b9f-bffd-4c3519bb2722_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31425,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/ebdad4b0-46b1-4b8d-ad59-5be53d8bce44_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31599,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/391af5e6-1be5-4696-b96d-2a475d8dbc27_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40584,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/2bf323d8-0420-4252-a9a8-cc60b70f7d2a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44130,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/13b2dbb8-510d-4029-b9e9-63ff621bd588_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40705,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/0fdf1db5-8e97-47cf-8454-92307fcf7eda_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39897,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/a0cc736a-004b-4971-a4af-1dcd12f96975_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5908229-1f07-55ad-9804-200c4ea79010/d5908229-1f07-55ad-9804-200c4ea79010_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41537,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FD23CGF/2025-12-01/image/263309e5-02cd-4bc1-aebe-08026ed261a6_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-20',
 'seller_name': 'Zenith',
 'title': 'MG MOTOR UK MG4 HATCHBACK 150kW Trophy EV Long Range 64kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW Trophy EV Long Range 64kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115510423%27 HTTP/1.1" 200 None
2025-12-02 19:05:50 [astonbarclay.gb] INFO: Saving data for 115510423: {'created_time': 1764702350.780496, 'last_price_update_time': 1764702350.780507, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115510423') HTTP/1.1" 204 0
2025-12-02 19:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 05a66706-c358-5123-bcef-8417c5455619 with identifier: 117133968
2025-12-02 19:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 05a66706-c358-5123-bcef-8417c5455619 with identifier: 117133968
2025-12-02 19:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 05a66706-c358-5123-bcef-8417c5455619 with identifier: 117133968 to the API
2025-12-02 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YE72BBX/2025-12-02/image/af01cd5b-f2f8-4b01-abc4-59148156fff7_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '05a66706-c358-5123-bcef-8417c5455619',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YE72BBX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117133968',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 21568,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28436,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/af01cd5b-f2f8-4b01-abc4-59148156fff7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25842,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/412e088a-4ba8-4e82-a95a-1a8564417a1e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31826,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/d7ab3cd3-54fa-408e-9ca9-d25272776b79_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31166,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/60a10af9-d549-4b39-aede-264358974905_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50294,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/9cb637a5-f120-4f14-b5f1-772f8a584fcd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62910,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/3ea8d55b-ecf2-4313-8fed-a6b48c639154_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45249,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/621792c9-da7f-438c-aa03-c29f3826bb6f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38339,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/fdde167c-a877-4f23-b2ad-4fe4b67b0c94_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a66706-c358-5123-bcef-8417c5455619/05a66706-c358-5123-bcef-8417c5455619_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49977,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE72BBX/2025-12-02/image/a8204dd1-567f-422f-8b61-d70637519b53_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seller_name': 'Zenith',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH Acenta Premium 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117133968%27 HTTP/1.1" 200 None
2025-12-02 19:05:51 [astonbarclay.gb] INFO: Saving data for 117133968: {'created_time': 1764702351.15364, 'last_price_update_time': 1764702351.153652, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117133968') HTTP/1.1" 204 0
2025-12-02 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dbf1d95c-f538-4034-abcb-fe9307235024_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117581526?view=catalogue)
2025-12-02 19:05:51 [astonbarclay.gb] INFO: Found listing with ID: 117270372
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117270372%27 HTTP/1.1" 200 None
2025-12-02 19:05:51 [astonbarclay.gb] INFO: Scrape type for 117270372: 2
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F4392e7bd-b7a2-4de2-8f3a-55d4b2c5dc21_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/4392e7bd-b7a2-4de2-8f3a-55d4b2c5dc21_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252F513dffc9-9655-4df5-87c9-a27acc6dbeba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/513dffc9-9655-4df5-87c9-a27acc6dbeba_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117452073, 'registration': 'GN68VHD', 'account': 'MAN037', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 180 AMG Line Edition 4dr', 'mileage': 94880, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-26', 'doors': 4, 'engineSize': 1595, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GN68VHD/2025-11-24/image/a0c70d17-dcd3-43fa-b5ba-838f6cdf4534_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/bf749f05-ff3b-4e52-ac09-9f0c96318075_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/dfae070b-4cb2-4d2f-b105-a21d6f89d43e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/9b5dab11-7797-4a62-b455-605db0718d68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/1e022185-de54-494d-965b-89d76f8ef300_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/96946bc3-c9b8-47f9-be59-772107b7cb49_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/f5bd913c-503b-4e3a-8834-ef67b1f649d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/9772f57a-7e5e-4f34-80c2-347e773147fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/ef194f53-1fa0-4d1c-86a7-e1fb2b6d97bb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 08/19- 16K, 08/20- 32K, 07/21- 51K, 05/22- 57K, 06/23- 64K', 'remarks': 'VOSA STATES 57K, 66K, 74K, 91K, SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/37110487-b4b0-4823-8092-915a2f267dd5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117452073, 'registration': 'GN68VHD', 'account': 'MAN037', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 180 AMG Line Edition 4dr', 'mileage': 94880, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-26', 'doors': 4, 'engineSize': 1595, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GN68VHD/2025-11-24/image/a0c70d17-dcd3-43fa-b5ba-838f6cdf4534_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/bf749f05-ff3b-4e52-ac09-9f0c96318075_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/dfae070b-4cb2-4d2f-b105-a21d6f89d43e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/9b5dab11-7797-4a62-b455-605db0718d68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/1e022185-de54-494d-965b-89d76f8ef300_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/96946bc3-c9b8-47f9-be59-772107b7cb49_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/f5bd913c-503b-4e3a-8834-ef67b1f649d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/9772f57a-7e5e-4f34-80c2-347e773147fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/ef194f53-1fa0-4d1c-86a7-e1fb2b6d97bb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 08/19- 16K, 08/20- 32K, 07/21- 51K, 05/22- 57K, 06/23- 64K', 'remarks': 'VOSA STATES 57K, 66K, 74K, 91K, SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/37110487-b4b0-4823-8092-915a2f267dd5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca9e29b-c998-5155-b420-6f077fe12770 with identifier: 117452073
2025-12-02 19:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ca9e29b-c998-5155-b420-6f077fe12770 with scrape type 2
2025-12-02 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ca9e29b-c998-5155-b420-6f077fe12770 with scrape type 2
2025-12-02 19:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2ca9e29b-c998-5155-b420-6f077fe12770, identifier: 117452073
2025-12-02 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71SXU/2025-11-28/image/56e9a1ef-527b-4293-9275-0fac359ae28e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117597727?view=catalogue)
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F9ef3f7ed-3642-489f-9e32-8a508be207b4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/9ef3f7ed-3642-489f-9e32-8a508be207b4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252Fce5d59cf-e2fb-4d5e-8f6c-3134eac5327d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/ce5d59cf-e2fb-4d5e-8f6c-3134eac5327d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2ca9e29b-c998-5155-b420-6f077fe12770 with identifier: 117452073
2025-12-02 19:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2ca9e29b-c998-5155-b420-6f077fe12770 with identifier: 117452073
2025-12-02 19:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152694 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152694
2025-12-02 19:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2ca9e29b-c998-5155-b420-6f077fe12770 spider: astonbarclay.gb
2025-12-02 19:05:51 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 2ca9e29b-c998-5155-b420-6f077fe12770 due to rule: high_mileage_for_country.json, error: 152694 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152694
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '2ca9e29b-c998-5155-b420-6f077fe12770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GN68VHD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117452073',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA COUPE',
 'odometer': 94880,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': 'Manamanx Ltd',
 'title': 'MERCEDES-BENZ CLA COUPE CLA 180 AMG Line Edition 4dr',
 'transmission': 'manual',
 'trim': 'CLA 180 AMG Line Edition 4dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452073%27 HTTP/1.1" 200 None
2025-12-02 19:05:51 [astonbarclay.gb] INFO: Saving data for 117452073: {'auction_closing_time': 1765215000.0, 'created_time': 1764010884.333554, 'last_price_update_time': 1764702351.577715}
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117452073') HTTP/1.1" 204 0
2025-12-02 19:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0427950>
2025-12-02 19:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F431b0595-1c7b-43da-8673-8ae777a89963_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/431b0595-1c7b-43da-8673-8ae777a89963_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77
2025-12-02 19:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04ec7d0>
2025-12-02 19:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252Fc715e370-046f-4a1e-8be0-ed42422fab81_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/c715e370-046f-4a1e-8be0-ed42422fab81_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0df80b6a-6c89-5fb4-8531-6651333b469d
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf068d290>
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_11.jpg HTTP/1.1" 201 0
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F96678bcc-df19-44fe-8aeb-4242196ef4ab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/96678bcc-df19-44fe-8aeb-4242196ef4ab_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ccad0>
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252Ff33fca43-2e07-4e31-b304-ea19212be4c4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/f33fca43-2e07-4e31-b304-ea19212be4c4_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf068f490>
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252Fd5ad4d21-fd23-4dd4-a9c2-e5b9182a19e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/d5ad4d21-fd23-4dd4-a9c2-e5b9182a19e3_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfb50dee-5647-5871-bb16-abf357e3da3b
2025-12-02 19:05:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117596515, 'registration': 'VE65RDZ', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T SE 5dr Auto', 'mileage': 37435, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2015-12-31', 'fuel': 'Petrol', 'motExpiry': '2026-11-21', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/2f541e55-97b1-4fe8-95dc-e76fd72d27f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/7afb8d44-5835-4f7d-acf4-eedb3b5bdc2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0c84f9a2-9ec1-4b7b-8cbc-ab6f5301a8df_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/20f50bc7-4d03-49c4-af2d-49ac520ac6b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0ae7f976-9247-4290-9cfe-b5906f7ba624_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/a680f0bd-a696-4e47-b067-4d37aa2fad36_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/b7af1c5c-22af-4bb8-acea-597f21e78af4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/4da09e78-74ac-4e46-8e51-3c7f955437b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/6c80b8d2-9a7e-4248-9f72-a5dc78e730e3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 1/16 4k, 11/17 8k, 12/18 13k, 2/20 17k, 2/22 22k, 12/23 29k, 11/25 37k', 'remarks': 'VOSA STATES 26K, 29K, 33K, 37K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fef3096a-bcfc-47fe-a0de-56acf205860f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117596515, 'registration': 'VE65RDZ', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T SE 5dr Auto', 'mileage': 37435, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2015-12-31', 'fuel': 'Petrol', 'motExpiry': '2026-11-21', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/2f541e55-97b1-4fe8-95dc-e76fd72d27f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/7afb8d44-5835-4f7d-acf4-eedb3b5bdc2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0c84f9a2-9ec1-4b7b-8cbc-ab6f5301a8df_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/20f50bc7-4d03-49c4-af2d-49ac520ac6b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0ae7f976-9247-4290-9cfe-b5906f7ba624_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/a680f0bd-a696-4e47-b067-4d37aa2fad36_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/b7af1c5c-22af-4bb8-acea-597f21e78af4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/4da09e78-74ac-4e46-8e51-3c7f955437b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/6c80b8d2-9a7e-4248-9f72-a5dc78e730e3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 1/16 4k, 11/17 8k, 12/18 13k, 2/20 17k, 2/22 22k, 12/23 29k, 11/25 37k', 'remarks': 'VOSA STATES 26K, 29K, 33K, 37K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fef3096a-bcfc-47fe-a0de-56acf205860f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15150dd1-06a3-50e5-8828-51d58f2a23ab with identifier: 117596515
2025-12-02 19:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15150dd1-06a3-50e5-8828-51d58f2a23ab with scrape type 1
2025-12-02 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 15150dd1-06a3-50e5-8828-51d58f2a23ab
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F2f541e55-97b1-4fe8-95dc-e76fd72d27f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/2f541e55-97b1-4fe8-95dc-e76fd72d27f5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117601450, 'registration': 'GP17KFC', 'account': 'STA058', 'make': 'JAGUAR', 'model': 'F-PACE ESTATE', 'derivative': '3.0 Supercharged V6 S 5dr Auto AWD', 'mileage': 113763, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-31', 'fuel': 'Petrol', 'motExpiry': '2025-08-21', 'doors': 5, 'engineSize': 2995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GP17KFC/2025-11-29/image/319c4628-5e2a-4989-9fc7-824f7dae52af_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/65892fd4-2362-4ab3-86b2-029b77250371_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/fb39faa5-6baa-4823-aa01-7b80ebd2e6b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/4d1ad15f-4d3f-4975-8b1d-9798fb01c647_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/02146761-1ce3-47cd-b90e-cae505538d96_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/c643ec65-21dc-4184-98f0-a7362b558361_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/266004d7-7e2b-46bb-908c-972b6663124b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/95f5e31f-bd58-4fe9-9641-9f9b1fd98ee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/e9b80121-ebc5-490e-b839-96c7c94cbdd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/1e8d780a-94d4-4276-a963-da205fa03290_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 209, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d76368ae-f49a-45d2-9262-0b134b618bd9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117601450, 'registration': 'GP17KFC', 'account': 'STA058', 'make': 'JAGUAR', 'model': 'F-PACE ESTATE', 'derivative': '3.0 Supercharged V6 S 5dr Auto AWD', 'mileage': 113763, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-31', 'fuel': 'Petrol', 'motExpiry': '2025-08-21', 'doors': 5, 'engineSize': 2995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GP17KFC/2025-11-29/image/319c4628-5e2a-4989-9fc7-824f7dae52af_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/65892fd4-2362-4ab3-86b2-029b77250371_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/fb39faa5-6baa-4823-aa01-7b80ebd2e6b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/4d1ad15f-4d3f-4975-8b1d-9798fb01c647_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/02146761-1ce3-47cd-b90e-cae505538d96_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/c643ec65-21dc-4184-98f0-a7362b558361_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/266004d7-7e2b-46bb-908c-972b6663124b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/95f5e31f-bd58-4fe9-9641-9f9b1fd98ee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/e9b80121-ebc5-490e-b839-96c7c94cbdd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP17KFC/2025-11-29/image/1e8d780a-94d4-4276-a963-da205fa03290_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 209, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d76368ae-f49a-45d2-9262-0b134b618bd9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 310a1492-f516-5a99-90b8-609ced8118e6 with identifier: 117601450
2025-12-02 19:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 310a1492-f516-5a99-90b8-609ced8118e6 with scrape type 2
2025-12-02 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 310a1492-f516-5a99-90b8-609ced8118e6 with scrape type 2
2025-12-02 19:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 310a1492-f516-5a99-90b8-609ced8118e6, identifier: 117601450
2025-12-02 19:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF21LKL/2025-12-02/image/0ac72ded-51d8-48aa-9aca-2e80805677e1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579278?view=catalogue)
2025-12-02 19:05:52 [astonbarclay.gb] INFO: Found listing with ID: 117638370
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638370%27 HTTP/1.1" 200 None
2025-12-02 19:05:52 [astonbarclay.gb] INFO: Scrape type for 117638370: 2
2025-12-02 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252Fd22e1362-25cb-461e-ab51-a716d6f7515b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/d22e1362-25cb-461e-ab51-a716d6f7515b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252Fd1453721-a50f-4e7d-be11-4c9136acd074_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/d1453721-a50f-4e7d-be11-4c9136acd074_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 310a1492-f516-5a99-90b8-609ced8118e6 with identifier: 117601450
2025-12-02 19:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 310a1492-f516-5a99-90b8-609ced8118e6 with identifier: 117601450
2025-12-02 19:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183083 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183083
2025-12-02 19:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 310a1492-f516-5a99-90b8-609ced8118e6 spider: astonbarclay.gb
2025-12-02 19:05:53 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 310a1492-f516-5a99-90b8-609ced8118e6 due to rule: high_mileage_for_country.json, error: 183083 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183083
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '310a1492-f516-5a99-90b8-609ced8118e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GP17KFC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117601450',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JAGUAR',
 'model': 'F-PACE ESTATE',
 'odometer': 113763,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'JAGUAR F-PACE ESTATE 3.0 Supercharged V6 S 5dr Auto AWD',
 'transmission': 'automatic',
 'trim': '3.0 Supercharged V6 S 5dr Auto AWD',
 'vin': None,
 'year': 2017}
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601450%27 HTTP/1.1" 200 None
2025-12-02 19:05:53 [astonbarclay.gb] INFO: Saving data for 117601450: {'auction_closing_time': 1765188000.0, 'created_time': 1764356629.668552, 'last_price_update_time': 1764702353.242194}
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117601450') HTTP/1.1" 204 0
2025-12-02 19:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF21LKL/2025-12-02/image/d432e2f1-8289-44ec-b1a1-74e9fe980a38_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579278?view=catalogue)
2025-12-02 19:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71OMH/2025-12-02/image/0968e117-fc67-4aba-80b2-9ca570f349b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549690?view=catalogue)
2025-12-02 19:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/d1466b5f-847a-472e-9ea2-45ed322ef80f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SM70DWN/2025-11-28/image/516485e8-b8d3-450c-96f6-5540b3aa3fe1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117581526?view=catalogue)
2025-12-02 19:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a361c7e9-c8cf-4db7-80d9-6d022838008a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DF23LXW/2025-12-02/image/71bd03dd-d648-4e0f-95b8-30ff07654a9d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579914?view=catalogue)
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252Facfb39ae-e3e4-453a-bc34-1ad7603db7d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/acfb39ae-e3e4-453a-bc34-1ad7603db7d2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F54ee10cd-9dc1-4391-bb14-c6276e4f0c17_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/54ee10cd-9dc1-4391-bb14-c6276e4f0c17_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F7afb8d44-5835-4f7d-acf4-eedb3b5bdc2c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/7afb8d44-5835-4f7d-acf4-eedb3b5bdc2c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09cc0d0>
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F8803cd74-9e6d-4d6d-adc6-604bc0d743ec_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/8803cd74-9e6d-4d6d-adc6-604bc0d743ec_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03496d0>
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F4be7c981-ef50-4c1d-ac14-122a4e1fd8ef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/4be7c981-ef50-4c1d-ac14-122a4e1fd8ef_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf050dad0>
2025-12-02 19:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252Fdbf1d95c-f538-4034-abcb-fe9307235024_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dbf1d95c-f538-4034-abcb-fe9307235024_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580
2025-12-02 19:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN18FNK/2025-12-02/image/fa2808c8-6990-463f-887c-42f2c9bc159c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639666?view=catalogue)
2025-12-02 19:05:54 [astonbarclay.gb] INFO: Found listing with ID: 117598232
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598232%27 HTTP/1.1" 200 None
2025-12-02 19:05:54 [astonbarclay.gb] INFO: Scrape type for 117598232: 2
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F02c23998-2ac9-4f64-9819-146596ff2c24_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/02c23998-2ac9-4f64-9819-146596ff2c24_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252F9d3a44c8-8788-4230-82cc-6ff02c728e91_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/9d3a44c8-8788-4230-82cc-6ff02c728e91_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F3aa77e18-bd33-4213-aa94-bf97effd3b64_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3aa77e18-bd33-4213-aa94-bf97effd3b64_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F800e1cc0-dd05-4ff2-afa1-1c1b688cbc28_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/800e1cc0-dd05-4ff2-afa1-1c1b688cbc28_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F0c84f9a2-9ec1-4b7b-8cbc-ab6f5301a8df_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0c84f9a2-9ec1-4b7b-8cbc-ab6f5301a8df_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117505585?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf049ad90>
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252F56e9a1ef-527b-4293-9275-0fac359ae28e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/56e9a1ef-527b-4293-9275-0fac359ae28e_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89f3219e-41c9-557e-aed5-2984165bb017
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0373110>
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F0ac72ded-51d8-48aa-9aca-2e80805677e1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/0ac72ded-51d8-48aa-9aca-2e80805677e1_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3
2025-12-02 19:05:54 [astonbarclay.gb] INFO: Found listing with ID: 117570049
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570049%27 HTTP/1.1" 200 None
2025-12-02 19:05:54 [astonbarclay.gb] INFO: Scrape type for 117570049: 2
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F632d62c2-4dd2-4abd-9534-ca88e1e0b10d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/632d62c2-4dd2-4abd-9534-ca88e1e0b10d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252Ff9a672c9-5fd5-4d32-b88f-13b82d47ae4b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/f9a672c9-5fd5-4d32-b88f-13b82d47ae4b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117271901?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf081f390>
2025-12-02 19:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252Fd432e2f1-8289-44ec-b1a1-74e9fe980a38_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/d432e2f1-8289-44ec-b1a1-74e9fe980a38_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03fbb50>
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71OMH%252F2025-12-02%252Fimage%252F0968e117-fc67-4aba-80b2-9ca570f349b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71OMH/2025-12-02/image/0968e117-fc67-4aba-80b2-9ca570f349b9_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449
2025-12-02 19:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8a7bcf4-1577-51dd-bb26-6bcbaae8a449, skipping ID generation
2025-12-02 19:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449 with scrape type 1
2025-12-02 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449 from tracking dictionaries
2025-12-02 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8a7bcf4-1577-51dd-bb26-6bcbaae8a449 sending to next pipeline
2025-12-02 19:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e8a7bcf4-1577-51dd-bb26-6bcbaae8a449, identifier: 117549690
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf37e18d0>
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252Fd1466b5f-847a-472e-9ea2-45ed322ef80f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/d1466b5f-847a-472e-9ea2-45ed322ef80f_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0588b90>
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252F516485e8-b8d3-450c-96f6-5540b3aa3fe1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/516485e8-b8d3-450c-96f6-5540b3aa3fe1_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08a5450>
2025-12-02 19:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252Fa361c7e9-c8cf-4db7-80d9-6d022838008a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a361c7e9-c8cf-4db7-80d9-6d022838008a_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf094a750>
2025-12-02 19:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDF23LXW%252F2025-12-02%252Fimage%252F71bd03dd-d648-4e0f-95b8-30ff07654a9d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DF23LXW/2025-12-02/image/71bd03dd-d648-4e0f-95b8-30ff07654a9d_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cfb50dee-5647-5871-bb16-abf357e3da3b
2025-12-02 19:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfb50dee-5647-5871-bb16-abf357e3da3b, skipping ID generation
2025-12-02 19:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb50dee-5647-5871-bb16-abf357e3da3b with scrape type 1
2025-12-02 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cfb50dee-5647-5871-bb16-abf357e3da3b from tracking dictionaries
2025-12-02 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfb50dee-5647-5871-bb16-abf357e3da3b sending to next pipeline
2025-12-02 19:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cfb50dee-5647-5871-bb16-abf357e3da3b, identifier: 117579914
2025-12-02 19:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/2f541e55-97b1-4fe8-95dc-e76fd72d27f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596515?view=catalogue)
2025-12-02 19:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF21LKL/2025-12-02/image/a26a3eec-ff02-405c-b4ba-a7f0f46385e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579278?view=catalogue)
2025-12-02 19:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF21LKL/2025-12-02/image/9ef3f7ed-3642-489f-9e32-8a508be207b4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579278?view=catalogue)
2025-12-02 19:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO68DDE/2025-12-02/image/4392e7bd-b7a2-4de2-8f3a-55d4b2c5dc21_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639372?view=catalogue)
2025-12-02 19:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/7437b13a-40b0-4ab7-acf8-b4374c142525_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN18FNK/2025-12-02/image/513dffc9-9655-4df5-87c9-a27acc6dbeba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639666?view=catalogue)
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F3c4d3f60-f0ae-491c-823d-606511c0bde1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3c4d3f60-f0ae-491c-823d-606511c0bde1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252Fa3e6416e-e6bc-44bc-9589-1da1d266124e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a3e6416e-e6bc-44bc-9589-1da1d266124e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F20f50bc7-4d03-49c4-af2d-49ac520ac6b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/20f50bc7-4d03-49c4-af2d-49ac520ac6b0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e8a7bcf4-1577-51dd-bb26-6bcbaae8a449 with identifier: 117549690
2025-12-02 19:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e8a7bcf4-1577-51dd-bb26-6bcbaae8a449 with identifier: 117549690
2025-12-02 19:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e8a7bcf4-1577-51dd-bb26-6bcbaae8a449 with identifier: 117549690 to the API
2025-12-02 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LB71OMH/2025-12-02/image/0968e117-fc67-4aba-80b2-9ca570f349b9_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'e8a7bcf4-1577-51dd-bb26-6bcbaae8a449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LB71OMH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117549690',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'KIA',
 'model': 'XCEED HATCHBACK',
 'odometer': 45030,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35190,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/31dab96f-c8a9-4692-966b-dd89c398c6ba_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37019,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/0968e117-fc67-4aba-80b2-9ca570f349b9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32310,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/f33fca43-2e07-4e31-b304-ea19212be4c4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34680,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/4b7b82b6-667b-41aa-94f7-b47d65f3fa86_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49529,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/d83bd4c7-a79a-4a5b-ac74-db6231f12bb4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71370,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e3d3cd61-9061-4707-bdc7-e31e59945cf0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57533,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/8c99c3de-ec5c-414f-86d5-dce77abdaa97_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52670,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/e2f205c4-412a-46c4-ac3a-4d05e84c5bbf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63467,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/7aeb1dde-44b0-46e6-a140-a8bb0462e324_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a7bcf4-1577-51dd-bb26-6bcbaae8a449/e8a7bcf4-1577-51dd-bb26-6bcbaae8a449_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24574,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71OMH/2025-12-02/image/72540e10-a07a-41b0-8c7e-970fcf91d31c_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seller_name': 'Zenith',
 'title': 'KIA XCEED HATCHBACK 1.6 GDi PHEV 3 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.6 GDi PHEV 3 5dr DCT',
 'vin': None,
 'year': 2021}
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549690%27 HTTP/1.1" 200 None
2025-12-02 19:05:57 [astonbarclay.gb] INFO: Saving data for 117549690: {'created_time': 1764702357.550535, 'last_price_update_time': 1764702357.550546, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117549690') HTTP/1.1" 204 0
2025-12-02 19:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cfb50dee-5647-5871-bb16-abf357e3da3b with identifier: 117579914
2025-12-02 19:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cfb50dee-5647-5871-bb16-abf357e3da3b with identifier: 117579914
2025-12-02 19:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cfb50dee-5647-5871-bb16-abf357e3da3b with identifier: 117579914 to the API
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DF23LXW/2025-12-02/image/71bd03dd-d648-4e0f-95b8-30ff07654a9d_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'cfb50dee-5647-5871-bb16-abf357e3da3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DF23LXW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579914',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 23896,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35843,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/0ff3bba3-e5e2-4512-a413-8ff0b7b0dba3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38456,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/71bd03dd-d648-4e0f-95b8-30ff07654a9d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36564,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/d5ad4d21-fd23-4dd4-a9c2-e5b9182a19e3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36037,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/57dae2ad-576e-47e8-b28a-488478197203_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48885,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/43390d82-b964-4c4d-9812-bb8bfe781c25_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60663,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/8008c348-29d8-4ae4-954a-a4af26dc5c57_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57449,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/78bd928e-3dbb-48e6-a4cd-4ca725d01287_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50829,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/da8b7304-540f-44c1-aad0-b72fba7596af_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb50dee-5647-5871-bb16-abf357e3da3b/cfb50dee-5647-5871-bb16-abf357e3da3b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58874,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DF23LXW/2025-12-02/image/443f5993-4d2f-4eaf-85cc-6231014f93f0_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579914%27 HTTP/1.1" 200 None
2025-12-02 19:05:57 [astonbarclay.gb] INFO: Saving data for 117579914: {'created_time': 1764702357.931826, 'last_price_update_time': 1764702357.931836, 'auction_closing_time': 1764927900.0}
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117579914') HTTP/1.1" 204 0
2025-12-02 19:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN18FNK/2025-12-02/image/d1453721-a50f-4e7d-be11-4c9136acd074_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639666?view=catalogue)
2025-12-02 19:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/ce5d59cf-e2fb-4d5e-8f6c-3134eac5327d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:05:57 [astonbarclay.gb] INFO: Found listing with ID: 117601685
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601685%27 HTTP/1.1" 200 None
2025-12-02 19:05:57 [astonbarclay.gb] INFO: Scrape type for 117601685: 1
2025-12-02 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252Fcfe60137-b4c4-411c-9cea-979c5b89fef7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/cfe60137-b4c4-411c-9cea-979c5b89fef7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252Fcd315941-7f16-4484-9990-2c39c6594acf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/cd315941-7f16-4484-9990-2c39c6594acf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117548617?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04b1b90>
2025-12-02 19:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252Ffa2808c8-6990-463f-887c-42f2c9bc159c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/fa2808c8-6990-463f-887c-42f2c9bc159c_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747
2025-12-02 19:05:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117505585, 'registration': 'SC16VMZ', 'account': 'MAN037', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr', 'mileage': 89504, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-05-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/25259f5d-cb47-4a8d-8d68-b04cea9a70ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/5f5c96d6-e72a-46cc-87fd-dcf83392b78b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/88ba5598-a20d-4171-9812-79becccfdb38_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/d0a08072-110f-448e-86b2-b38decddbb15_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/ad6156dc-ca0c-4f5d-9228-5fcdbf8527fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/ae6e408a-8d6c-432d-a6c3-78ee9faedc91_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/3a87e982-04b4-4bee-a5df-e9490ffb55ae_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 52k, 65k, 80k, 89k - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d3ef40fb-c436-49a8-9c93-8014dee2b113.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117505585, 'registration': 'SC16VMZ', 'account': 'MAN037', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr', 'mileage': 89504, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-05-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/25259f5d-cb47-4a8d-8d68-b04cea9a70ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/5f5c96d6-e72a-46cc-87fd-dcf83392b78b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/88ba5598-a20d-4171-9812-79becccfdb38_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/d0a08072-110f-448e-86b2-b38decddbb15_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/ad6156dc-ca0c-4f5d-9228-5fcdbf8527fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/ae6e408a-8d6c-432d-a6c3-78ee9faedc91_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16VMZ/2025-11-26/image/3a87e982-04b4-4bee-a5df-e9490ffb55ae_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 52k, 65k, 80k, 89k - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d3ef40fb-c436-49a8-9c93-8014dee2b113.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e174a53-e904-5226-b379-a250434c2924 with identifier: 117505585
2025-12-02 19:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e174a53-e904-5226-b379-a250434c2924 with scrape type 2
2025-12-02 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e174a53-e904-5226-b379-a250434c2924 with scrape type 2
2025-12-02 19:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6e174a53-e904-5226-b379-a250434c2924, identifier: 117505585
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F076651fc-5cd5-460b-ac62-fcb21ea4d517_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/076651fc-5cd5-460b-ac62-fcb21ea4d517_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F9a4ad354-ead6-4282-8f95-a5ba52185852_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/9a4ad354-ead6-4282-8f95-a5ba52185852_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F0ae7f976-9247-4290-9cfe-b5906f7ba624_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0ae7f976-9247-4290-9cfe-b5906f7ba624_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117269087?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116928605?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117683297?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116928625?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6e174a53-e904-5226-b379-a250434c2924 with identifier: 117505585
2025-12-02 19:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6e174a53-e904-5226-b379-a250434c2924 with identifier: 117505585
2025-12-02 19:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6e174a53-e904-5226-b379-a250434c2924 with identifier: 117505585 to the API
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276e174a53-e904-5226-b379-a250434c2924%27 HTTP/1.1" 200 None
2025-12-02 19:05:58 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6e174a53-e904-5226-b379-a250434c2924: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:05:58 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117505585?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '6e174a53-e904-5226-b379-a250434c2924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SC16VMZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117505585',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 89504,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': 'Manamanx Ltd',
 'title': 'BMW 1 SERIES HATCHBACK 118i [1.5] Sport 5dr',
 'transmission': 'manual',
 'trim': '118i [1.5] Sport 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505585%27 HTTP/1.1" 200 None
2025-12-02 19:05:59 [astonbarclay.gb] INFO: Saving data for 117505585: {'auction_closing_time': 1765215000.0, 'created_time': 1764097432.106052, 'last_price_update_time': 1764702359.007543}
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117505585') HTTP/1.1" 204 0
2025-12-02 19:05:59 [astonbarclay.gb] INFO: Found listing with ID: 117614020
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117614020%27 HTTP/1.1" 200 None
2025-12-02 19:05:59 [astonbarclay.gb] INFO: Scrape type for 117614020: 0
2025-12-02 19:05:59 [astonbarclay.gb] INFO: Found listing with ID: 117615786
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615786%27 HTTP/1.1" 200 None
2025-12-02 19:05:59 [astonbarclay.gb] INFO: Scrape type for 117615786: 0
2025-12-02 19:05:59 [astonbarclay.gb] INFO: Found listing with ID: 117615634
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615634%27 HTTP/1.1" 200 None
2025-12-02 19:05:59 [astonbarclay.gb] INFO: Scrape type for 117615634: 0
2025-12-02 19:05:59 [astonbarclay.gb] INFO: Found listing with ID: 117572803
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572803%27 HTTP/1.1" 200 None
2025-12-02 19:05:59 [astonbarclay.gb] INFO: Scrape type for 117572803: 2
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F7ea5e44c-9ce4-4cde-9a48-7113f2c0da48_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/7ea5e44c-9ce4-4cde-9a48-7113f2c0da48_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252F60b39c45-6880-4e66-8d48-1a406989a5d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/60b39c45-6880-4e66-8d48-1a406989a5d4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN18FNK/2025-12-02/image/9d3a44c8-8788-4230-82cc-6ff02c728e91_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639666?view=catalogue)
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252Fbdc3bf57-df33-42d9-b854-9cc63a6b08dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/bdc3bf57-df33-42d9-b854-9cc63a6b08dd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F18121891-be91-4f68-9a71-325056aec16f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/18121891-be91-4f68-9a71-325056aec16f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252Fa680f0bd-a696-4e47-b067-4d37aa2fad36_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/a680f0bd-a696-4e47-b067-4d37aa2fad36_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:05:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117271901, 'registration': 'FY17OMM', 'account': 'MAN037', 'make': 'HONDA', 'model': 'CIVIC HATCHBACK', 'derivative': '1.0 VTEC Turbo SR 5dr', 'mileage': 94796, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-20', 'fuel': 'Petrol', 'motExpiry': '2025-09-26', 'doors': 5, 'engineSize': 988, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FY17OMM/2025-11-17/image/58889a6b-9400-44c0-9c91-3cbf9252e330_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/f4b0db65-558e-45b0-af9f-915b2209a224_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/38efef9f-bb12-4fad-8536-3ca96e268a5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/29ca15b0-2cf6-4cf9-adde-fa91108be60d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/f1932f8f-6855-4517-be95-75c8c3c8783b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/c35fdda4-3511-43d1-a48e-8eeb3e2d3d9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/c6e9f880-d3b0-4f01-93d1-013febce6191_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 26K- 33K - 52K - 73K -', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7c4ed0fb-35c7-4035-8e56-0ed3adc16d91.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117271901, 'registration': 'FY17OMM', 'account': 'MAN037', 'make': 'HONDA', 'model': 'CIVIC HATCHBACK', 'derivative': '1.0 VTEC Turbo SR 5dr', 'mileage': 94796, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-20', 'fuel': 'Petrol', 'motExpiry': '2025-09-26', 'doors': 5, 'engineSize': 988, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FY17OMM/2025-11-17/image/58889a6b-9400-44c0-9c91-3cbf9252e330_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/f4b0db65-558e-45b0-af9f-915b2209a224_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/38efef9f-bb12-4fad-8536-3ca96e268a5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/29ca15b0-2cf6-4cf9-adde-fa91108be60d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/f1932f8f-6855-4517-be95-75c8c3c8783b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/c35fdda4-3511-43d1-a48e-8eeb3e2d3d9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FY17OMM/2025-11-17/image/c6e9f880-d3b0-4f01-93d1-013febce6191_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 26K- 33K - 52K - 73K -', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7c4ed0fb-35c7-4035-8e56-0ed3adc16d91.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb9b71c0-3bfd-53b8-a85c-0abea0358cd5 with identifier: 117271901
2025-12-02 19:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb9b71c0-3bfd-53b8-a85c-0abea0358cd5 with scrape type 2
2025-12-02 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb9b71c0-3bfd-53b8-a85c-0abea0358cd5 with scrape type 2
2025-12-02 19:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fb9b71c0-3bfd-53b8-a85c-0abea0358cd5, identifier: 117271901
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09012d0>
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F2f541e55-97b1-4fe8-95dc-e76fd72d27f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/2f541e55-97b1-4fe8-95dc-e76fd72d27f5_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15150dd1-06a3-50e5-8828-51d58f2a23ab
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07fd450>
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252Fa26a3eec-ff02-405c-b4ba-a7f0f46385e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/a26a3eec-ff02-405c-b4ba-a7f0f46385e5_removebg.jpg?w=600 saved to cache
2025-12-02 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0604990>
2025-12-02 19:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F9ef3f7ed-3642-489f-9e32-8a508be207b4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/9ef3f7ed-3642-489f-9e32-8a508be207b4_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf060bc50>
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F4392e7bd-b7a2-4de2-8f3a-55d4b2c5dc21_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/4392e7bd-b7a2-4de2-8f3a-55d4b2c5dc21_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c6d50>
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F7437b13a-40b0-4ab7-acf8-b4374c142525_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/7437b13a-40b0-4ab7-acf8-b4374c142525_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0609c50>
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252F513dffc9-9655-4df5-87c9-a27acc6dbeba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/513dffc9-9655-4df5-87c9-a27acc6dbeba_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0590050>
2025-12-02 19:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252Fd1453721-a50f-4e7d-be11-4c9136acd074_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/d1453721-a50f-4e7d-be11-4c9136acd074_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747
2025-12-02 19:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf079f990>
2025-12-02 19:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252Fce5d59cf-e2fb-4d5e-8f6c-3134eac5327d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/ce5d59cf-e2fb-4d5e-8f6c-3134eac5327d_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:06:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117548617, 'registration': 'DF23VHW', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 41176, 'mileageWarranty': False, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23VHW/2025-12-02/image/ecd75a47-0310-4b3f-9cf0-0ecaf57eaba4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/5b9e3d2b-13a6-41e5-993f-a32b57e72ffb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/8015f66a-6772-4abd-b39d-0f47dba43609_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/72752a63-26a7-4116-ab69-87db105eea42_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/aaca0899-f5df-418c-9527-a8eeb210b244_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/a5f25e41-985f-4af2-8afc-531b4928e06d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/79e05257-210e-4731-9f4d-d2b0b14e1b7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/77dc8164-c42c-41e0-a341-d5f512da0417_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/8f2276f6-0c14-4cb2-9a63-b2d343c7ab6d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1840** SPARE KEY', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/890ab1b2-4acd-4967-900a-48964d461011.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:06:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117548617, 'registration': 'DF23VHW', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 41176, 'mileageWarranty': False, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23VHW/2025-12-02/image/ecd75a47-0310-4b3f-9cf0-0ecaf57eaba4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/5b9e3d2b-13a6-41e5-993f-a32b57e72ffb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/8015f66a-6772-4abd-b39d-0f47dba43609_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/72752a63-26a7-4116-ab69-87db105eea42_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/aaca0899-f5df-418c-9527-a8eeb210b244_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/a5f25e41-985f-4af2-8afc-531b4928e06d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/79e05257-210e-4731-9f4d-d2b0b14e1b7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/77dc8164-c42c-41e0-a341-d5f512da0417_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VHW/2025-12-02/image/8f2276f6-0c14-4cb2-9a63-b2d343c7ab6d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1840** SPARE KEY', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/890ab1b2-4acd-4967-900a-48964d461011.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0 with identifier: 117548617
2025-12-02 19:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0 with scrape type 2
2025-12-02 19:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0 with scrape type 2
2025-12-02 19:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0, identifier: 117548617
2025-12-02 19:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3aa77e18-bd33-4213-aa94-bf97effd3b64_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579278?view=catalogue)
2025-12-02 19:06:01 [astonbarclay.gb] INFO: Found listing with ID: 117570719
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570719%27 HTTP/1.1" 200 None
2025-12-02 19:06:01 [astonbarclay.gb] INFO: Scrape type for 117570719: 2
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F5c04f673-6fd7-4c5f-b46b-e7319166bffe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/5c04f673-6fd7-4c5f-b46b-e7319166bffe_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252F740a472a-ac1e-4ee7-a7c2-869d0aa22ffa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/740a472a-ac1e-4ee7-a7c2-869d0aa22ffa_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fb9b71c0-3bfd-53b8-a85c-0abea0358cd5 with identifier: 117271901
2025-12-02 19:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fb9b71c0-3bfd-53b8-a85c-0abea0358cd5 with identifier: 117271901
2025-12-02 19:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152558 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152558
2025-12-02 19:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fb9b71c0-3bfd-53b8-a85c-0abea0358cd5 spider: astonbarclay.gb
2025-12-02 19:06:01 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: fb9b71c0-3bfd-53b8-a85c-0abea0358cd5 due to rule: high_mileage_for_country.json, error: 152558 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152558
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'fb9b71c0-3bfd-53b8-a85c-0abea0358cd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FY17OMM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117271901',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'CIVIC HATCHBACK',
 'odometer': 94796,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': 'Manamanx Ltd',
 'title': 'HONDA CIVIC HATCHBACK 1.0 VTEC Turbo SR 5dr',
 'transmission': 'manual',
 'trim': '1.0 VTEC Turbo SR 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271901%27 HTTP/1.1" 200 None
2025-12-02 19:06:01 [astonbarclay.gb] INFO: Saving data for 117271901: {'auction_closing_time': 1765215000.0, 'created_time': 1763406268.503798, 'last_price_update_time': 1764702361.796672}
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117271901') HTTP/1.1" 204 0
2025-12-02 19:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0 with identifier: 117548617
2025-12-02 19:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0 with identifier: 117548617
2025-12-02 19:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0 with identifier: 117548617 to the API
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2784cf3344-bd7b-532c-932d-f1a9fc1fc3e0%27 HTTP/1.1" 200 None
2025-12-02 19:06:02 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117548617?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '84cf3344-bd7b-532c-932d-f1a9fc1fc3e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DF23VHW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117548617',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 41176,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-24',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548617%27 HTTP/1.1" 200 None
2025-12-02 19:06:02 [astonbarclay.gb] INFO: Saving data for 117548617: {'auction_closing_time': 1764927900.0, 'created_time': 1764615695.845042, 'last_price_update_time': 1764702362.19606}
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117548617') HTTP/1.1" 204 0
2025-12-02 19:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0c84f9a2-9ec1-4b7b-8cbc-ab6f5301a8df_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596515?view=catalogue)
2025-12-02 19:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO68DDE/2025-12-02/image/02c23998-2ac9-4f64-9819-146596ff2c24_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639372?view=catalogue)
2025-12-02 19:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/7afb8d44-5835-4f7d-acf4-eedb3b5bdc2c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596515?view=catalogue)
2025-12-02 19:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN18FNK/2025-12-02/image/f9a672c9-5fd5-4d32-b88f-13b82d47ae4b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639666?view=catalogue)
2025-12-02 19:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO68DDE/2025-12-02/image/632d62c2-4dd2-4abd-9534-ca88e1e0b10d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639372?view=catalogue)
2025-12-02 19:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/800e1cc0-dd05-4ff2-afa1-1c1b688cbc28_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F6da24ed3-4f25-4a82-9f14-9adf60e738e1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/6da24ed3-4f25-4a82-9f14-9adf60e738e1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252Fb7af1c5c-22af-4bb8-acea-597f21e78af4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/b7af1c5c-22af-4bb8-acea-597f21e78af4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117269087, 'registration': 'BF68CWJ', 'account': 'MAN037', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] SE 5dr [Nav/Servotronic] Step Auto', 'mileage': 77738, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-26', 'fuel': 'Petrol', 'motExpiry': '2026-05-05', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/fd8e59c8-a46c-4107-b2e7-5f6f4d03ae33_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/ed11f1a7-6c85-46d6-902b-9cc63f311a1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/66991414-9008-4739-93a2-b7df9ff41683_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/6c94d947-4637-4726-8a86-478d84ea7e3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/db945584-698a-4a0e-b3fb-ebfde599bee4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/a0bb5e70-2f56-4173-8391-d887c5c661bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/13d4d483-7aeb-431b-b628-76131117e1d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/a0fc912d-8ab1-4f14-9f83-e437f2bc369a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/ffe4a390-f07b-420a-a2ca-5983b8e57aa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/d5ef0a87-fe4c-42fe-9b29-4bc90172a172_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/c894628a-b594-495b-86f3-c7d98e81250c_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 05/19 10K - 07/19 12K- 02/20 20K - 09/21 63K-  11/24 63K', 'remarks': 'VOSA STATES 42K - 42K- 53K- 70K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10fead9f-5106-4da7-8555-72619e0ebdb3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117269087, 'registration': 'BF68CWJ', 'account': 'MAN037', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] SE 5dr [Nav/Servotronic] Step Auto', 'mileage': 77738, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-26', 'fuel': 'Petrol', 'motExpiry': '2026-05-05', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/fd8e59c8-a46c-4107-b2e7-5f6f4d03ae33_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/ed11f1a7-6c85-46d6-902b-9cc63f311a1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/66991414-9008-4739-93a2-b7df9ff41683_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/6c94d947-4637-4726-8a86-478d84ea7e3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/db945584-698a-4a0e-b3fb-ebfde599bee4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/a0bb5e70-2f56-4173-8391-d887c5c661bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/13d4d483-7aeb-431b-b628-76131117e1d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/a0fc912d-8ab1-4f14-9f83-e437f2bc369a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/ffe4a390-f07b-420a-a2ca-5983b8e57aa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/d5ef0a87-fe4c-42fe-9b29-4bc90172a172_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF68CWJ/2025-11-17/image/c894628a-b594-495b-86f3-c7d98e81250c_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 05/19 10K - 07/19 12K- 02/20 20K - 09/21 63K-  11/24 63K', 'remarks': 'VOSA STATES 42K - 42K- 53K- 70K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10fead9f-5106-4da7-8555-72619e0ebdb3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3daef06c-03ad-51f5-835a-03992944b484 with identifier: 117269087
2025-12-02 19:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3daef06c-03ad-51f5-835a-03992944b484 with scrape type 2
2025-12-02 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3daef06c-03ad-51f5-835a-03992944b484 with scrape type 2
2025-12-02 19:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3daef06c-03ad-51f5-835a-03992944b484, identifier: 117269087
2025-12-02 19:06:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116928605, 'registration': 'SB66OPT', 'account': 'MAN037', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT Line 5dr', 'mileage': 73111, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-01-17', 'fuel': 'Petrol', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SB66OPT/2025-11-05/image/3369f2fb-d09d-4d81-8ac4-d8f49758d7b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/173c175a-c306-4f47-b266-b0124a0fbdd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/354320c6-d7ca-4a96-b991-8cfc047543aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/a892d3a5-fc1d-4eee-98b7-af8d3451934d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/08850844-e972-44e4-8a8d-7bc3ee1dbd9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/6d6f4a41-58b5-4b88-a9d2-a62b0363fa44_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/be401b82-9c9a-42a1-9e9c-e512638b15bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/3836d7bc-8be9-435c-8ec4-3557260f3ccc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/4d01e7ef-34d1-4a96-9426-4af09d57fc61_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 01/18 10K - 01/19 19K - 01/20 27K - 10/22 48K - 05/23 56K - 05/24 63K', 'remarks': 'VOSA STATES, 48K, 56K, 63K, 71K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/41d77ed0-55c2-4fb5-b104-c871e1bbbf13.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116928605, 'registration': 'SB66OPT', 'account': 'MAN037', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT Line 5dr', 'mileage': 73111, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-01-17', 'fuel': 'Petrol', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SB66OPT/2025-11-05/image/3369f2fb-d09d-4d81-8ac4-d8f49758d7b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/173c175a-c306-4f47-b266-b0124a0fbdd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/354320c6-d7ca-4a96-b991-8cfc047543aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/a892d3a5-fc1d-4eee-98b7-af8d3451934d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/08850844-e972-44e4-8a8d-7bc3ee1dbd9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/6d6f4a41-58b5-4b88-a9d2-a62b0363fa44_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/be401b82-9c9a-42a1-9e9c-e512638b15bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/3836d7bc-8be9-435c-8ec4-3557260f3ccc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB66OPT/2025-11-05/image/4d01e7ef-34d1-4a96-9426-4af09d57fc61_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 01/18 10K - 01/19 19K - 01/20 27K - 10/22 48K - 05/23 56K - 05/24 63K', 'remarks': 'VOSA STATES, 48K, 56K, 63K, 71K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/41d77ed0-55c2-4fb5-b104-c871e1bbbf13.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bef6ea5-e37c-5b27-a2a5-400231941e70 with identifier: 116928605
2025-12-02 19:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bef6ea5-e37c-5b27-a2a5-400231941e70 with scrape type 2
2025-12-02 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bef6ea5-e37c-5b27-a2a5-400231941e70 with scrape type 2
2025-12-02 19:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9bef6ea5-e37c-5b27-a2a5-400231941e70, identifier: 116928605
2025-12-02 19:06:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117683297, 'registration': 'LL65VBY', 'account': 'MAN037', 'make': 'MAZDA', 'model': 'MAZDA2 HATCHBACK', 'derivative': '1.5 75 SE-L 5dr', 'mileage': 78016, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-01-08', 'fuel': 'Petrol', 'motExpiry': '2026-02-09', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/18 33K - 03/19 37K - 03/20 42K', 'remarks': 'VOSA STATES 53K- 62K- 69K- 74K-', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9dc95014-b66d-4711-bff0-fe9e302f7e2e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117683297, 'registration': 'LL65VBY', 'account': 'MAN037', 'make': 'MAZDA', 'model': 'MAZDA2 HATCHBACK', 'derivative': '1.5 75 SE-L 5dr', 'mileage': 78016, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-01-08', 'fuel': 'Petrol', 'motExpiry': '2026-02-09', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/18 33K - 03/19 37K - 03/20 42K', 'remarks': 'VOSA STATES 53K- 62K- 69K- 74K-', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9dc95014-b66d-4711-bff0-fe9e302f7e2e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be2c6f10-4929-5cbb-afb0-ac822ecc7125 with identifier: 117683297
2025-12-02 19:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be2c6f10-4929-5cbb-afb0-ac822ecc7125 with scrape type 1
2025-12-02 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item be2c6f10-4929-5cbb-afb0-ac822ecc7125
2025-12-02 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item be2c6f10-4929-5cbb-afb0-ac822ecc7125
2025-12-02 19:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: be2c6f10-4929-5cbb-afb0-ac822ecc7125, identifier: 117683297
2025-12-02 19:06:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116928625, 'registration': 'EN17HLA', 'account': 'MAN037', 'make': 'FORD', 'model': 'B-MAX HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium Navigator 5dr', 'mileage': 60668, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-28', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN17HLA/2025-12-01/image/5d68e42c-6e76-4475-a3a2-6c35cd25960a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/a87128ec-5b18-4b10-9b3c-84959d5072ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/7a89f7c8-47bf-42d2-bb08-84aca00187fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/33e3fbe4-b8e1-42f4-a04c-54f390e397d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/f52b921d-e2f6-4e16-a831-6077de403ea0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/9bdda476-24b5-4723-abb2-ec452b451517_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/eb431b7d-48a7-4b7f-9124-2eacb9ee2527_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/95ba1d96-8472-49e3-9aeb-872ce5bf1d39_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/f6ebe02c-c845-4b66-b1e3-bc860ca2ca2e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 10/18 9K - 10/19 14K - 07/20 20K - 07/21 27K - 7/22 34K', 'remarks': 'VOSA STATES, 34K, 39K, 44K, 53K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/35bb74c6-a959-49a0-a39c-f4b4f82de385.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116928625, 'registration': 'EN17HLA', 'account': 'MAN037', 'make': 'FORD', 'model': 'B-MAX HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium Navigator 5dr', 'mileage': 60668, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-28', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN17HLA/2025-12-01/image/5d68e42c-6e76-4475-a3a2-6c35cd25960a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/a87128ec-5b18-4b10-9b3c-84959d5072ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/7a89f7c8-47bf-42d2-bb08-84aca00187fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/33e3fbe4-b8e1-42f4-a04c-54f390e397d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/f52b921d-e2f6-4e16-a831-6077de403ea0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/9bdda476-24b5-4723-abb2-ec452b451517_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/eb431b7d-48a7-4b7f-9124-2eacb9ee2527_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/95ba1d96-8472-49e3-9aeb-872ce5bf1d39_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN17HLA/2025-12-01/image/f6ebe02c-c845-4b66-b1e3-bc860ca2ca2e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 10/18 9K - 10/19 14K - 07/20 20K - 07/21 27K - 7/22 34K', 'remarks': 'VOSA STATES, 34K, 39K, 44K, 53K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/35bb74c6-a959-49a0-a39c-f4b4f82de385.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e29f12-042c-5185-a8e9-9e655af448f6 with identifier: 116928625
2025-12-02 19:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e29f12-042c-5185-a8e9-9e655af448f6 with scrape type 2
2025-12-02 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e29f12-042c-5185-a8e9-9e655af448f6 with scrape type 2
2025-12-02 19:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e2e29f12-042c-5185-a8e9-9e655af448f6, identifier: 116928625
2025-12-02 19:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/20f50bc7-4d03-49c4-af2d-49ac520ac6b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596515?view=catalogue)
2025-12-02 19:06:02 [astonbarclay.gb] INFO: Found listing with ID: 117623725
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623725%27 HTTP/1.1" 200 None
2025-12-02 19:06:02 [astonbarclay.gb] INFO: Scrape type for 117623725: 2
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F0502d222-927b-4aa7-9c9c-6ef9790c2e9d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/0502d222-927b-4aa7-9c9c-6ef9790c2e9d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252F51d11a76-ea2f-4c4a-abea-9d4095793d2f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/51d11a76-ea2f-4c4a-abea-9d4095793d2f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117270372?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3daef06c-03ad-51f5-835a-03992944b484 with identifier: 117269087
2025-12-02 19:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3daef06c-03ad-51f5-835a-03992944b484 with identifier: 117269087
2025-12-02 19:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3daef06c-03ad-51f5-835a-03992944b484 with identifier: 117269087 to the API
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273daef06c-03ad-51f5-835a-03992944b484%27 HTTP/1.1" 200 None
2025-12-02 19:06:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3daef06c-03ad-51f5-835a-03992944b484: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117269087?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '3daef06c-03ad-51f5-835a-03992944b484',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BF68CWJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117269087',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 77738,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-26',
 'seller_name': 'Manamanx Ltd',
 'title': 'BMW 1 SERIES HATCHBACK 118i [1.5] SE 5dr [Nav/Servotronic] Step '
          'Auto',
 'transmission': 'automatic',
 'trim': '118i [1.5] SE 5dr [Nav/Servotronic] Step Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269087%27 HTTP/1.1" 200 None
2025-12-02 19:06:03 [astonbarclay.gb] INFO: Saving data for 117269087: {'auction_closing_time': 1765215000.0, 'created_time': 1763406268.441813, 'last_price_update_time': 1764702363.018077}
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117269087') HTTP/1.1" 204 0
2025-12-02 19:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9bef6ea5-e37c-5b27-a2a5-400231941e70 with identifier: 116928605
2025-12-02 19:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9bef6ea5-e37c-5b27-a2a5-400231941e70 with identifier: 116928605
2025-12-02 19:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9bef6ea5-e37c-5b27-a2a5-400231941e70 with identifier: 116928605 to the API
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279bef6ea5-e37c-5b27-a2a5-400231941e70%27 HTTP/1.1" 200 None
2025-12-02 19:06:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9bef6ea5-e37c-5b27-a2a5-400231941e70: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:03 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116928605?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '9bef6ea5-e37c-5b27-a2a5-400231941e70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SB66OPT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116928605',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 73111,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-17',
 'seller_name': 'Manamanx Ltd',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech 130 GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 GT Line 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928605%27 HTTP/1.1" 200 None
2025-12-02 19:06:03 [astonbarclay.gb] INFO: Saving data for 116928605: {'auction_closing_time': 1765215000.0, 'created_time': 1762283818.17179, 'last_price_update_time': 1764702363.369319}
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116928605') HTTP/1.1" 204 0
2025-12-02 19:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: be2c6f10-4929-5cbb-afb0-ac822ecc7125 with identifier: 117683297
2025-12-02 19:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: be2c6f10-4929-5cbb-afb0-ac822ecc7125 with identifier: 117683297
2025-12-02 19:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: be2c6f10-4929-5cbb-afb0-ac822ecc7125 with identifier: 117683297 to the API
2025-12-02 19:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27be2c6f10-4929-5cbb-afb0-ac822ecc7125%27 HTTP/1.1" 200 None
2025-12-02 19:06:04 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id be2c6f10-4929-5cbb-afb0-ac822ecc7125: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:04 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117683297?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'be2c6f10-4929-5cbb-afb0-ac822ecc7125',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL65VBY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117683297',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MAZDA',
 'model': 'MAZDA2 HATCHBACK',
 'odometer': 78016,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-08',
 'seller_name': 'Manamanx Ltd',
 'title': 'MAZDA MAZDA2 HATCHBACK 1.5 75 SE-L 5dr',
 'transmission': 'manual',
 'trim': '1.5 75 SE-L 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117683297%27 HTTP/1.1" 200 None
2025-12-02 19:06:04 [astonbarclay.gb] INFO: Saving data for 117683297: {'created_time': 1764702364.500947, 'last_price_update_time': 1764702364.500957, 'auction_closing_time': 1765215000.0}
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117683297') HTTP/1.1" 204 0
2025-12-02 19:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e2e29f12-042c-5185-a8e9-9e655af448f6 with identifier: 116928625
2025-12-02 19:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e2e29f12-042c-5185-a8e9-9e655af448f6 with identifier: 116928625
2025-12-02 19:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e2e29f12-042c-5185-a8e9-9e655af448f6 with identifier: 116928625 to the API
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e2e29f12-042c-5185-a8e9-9e655af448f6%27 HTTP/1.1" 200 None
2025-12-02 19:06:04 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e2e29f12-042c-5185-a8e9-9e655af448f6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:04 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116928625?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'e2e29f12-042c-5185-a8e9-9e655af448f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN17HLA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116928625',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'B-MAX HATCHBACK',
 'odometer': 60668,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': 'Manamanx Ltd',
 'title': 'FORD B-MAX HATCHBACK 1.0 EcoBoost 125 Titanium Navigator 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Titanium Navigator 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928625%27 HTTP/1.1" 200 None
2025-12-02 19:06:04 [astonbarclay.gb] INFO: Saving data for 116928625: {'auction_closing_time': 1765215000.0, 'created_time': 1762283805.303547, 'last_price_update_time': 1764702364.784158}
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116928625') HTTP/1.1" 204 0
2025-12-02 19:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf091c0d0>
2025-12-02 19:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252F9d3a44c8-8788-4230-82cc-6ff02c728e91_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/9d3a44c8-8788-4230-82cc-6ff02c728e91_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747
2025-12-02 19:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0ae7f976-9247-4290-9cfe-b5906f7ba624_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596515?view=catalogue)
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252Ffdadedc6-8cea-44cf-ba15-3d271faed6e8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/fdadedc6-8cea-44cf-ba15-3d271faed6e8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F4da09e78-74ac-4e46-8e51-3c7f955437b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/4da09e78-74ac-4e46-8e51-3c7f955437b9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF21LKL/2025-12-02/image/076651fc-5cd5-460b-ac62-fcb21ea4d517_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579278?view=catalogue)
2025-12-02 19:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/9a4ad354-ead6-4282-8f95-a5ba52185852_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:06:05 [astonbarclay.gb] INFO: Found listing with ID: 117663579
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117663579%27 HTTP/1.1" 200 None
2025-12-02 19:06:05 [astonbarclay.gb] INFO: Scrape type for 117663579: 1
2025-12-02 19:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08aedd0>
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F3aa77e18-bd33-4213-aa94-bf97effd3b64_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3aa77e18-bd33-4213-aa94-bf97effd3b64_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ddc190>
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F0c84f9a2-9ec1-4b7b-8cbc-ab6f5301a8df_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0c84f9a2-9ec1-4b7b-8cbc-ab6f5301a8df_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15150dd1-06a3-50e5-8828-51d58f2a23ab
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08a5790>
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F02c23998-2ac9-4f64-9819-146596ff2c24_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/02c23998-2ac9-4f64-9819-146596ff2c24_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ed090>
2025-12-02 19:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F7afb8d44-5835-4f7d-acf4-eedb3b5bdc2c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/7afb8d44-5835-4f7d-acf4-eedb3b5bdc2c_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15150dd1-06a3-50e5-8828-51d58f2a23ab
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf077e250>
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252Ff9a672c9-5fd5-4d32-b88f-13b82d47ae4b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/f9a672c9-5fd5-4d32-b88f-13b82d47ae4b_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0440b90>
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F632d62c2-4dd2-4abd-9534-ca88e1e0b10d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/632d62c2-4dd2-4abd-9534-ca88e1e0b10d_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac8790>
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F800e1cc0-dd05-4ff2-afa1-1c1b688cbc28_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/800e1cc0-dd05-4ff2-afa1-1c1b688cbc28_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO68DDE/2025-12-02/image/cfe60137-b4c4-411c-9cea-979c5b89fef7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639372?view=catalogue)
2025-12-02 19:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN18FNK/2025-12-02/image/cd315941-7f16-4484-9990-2c39c6594acf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639666?view=catalogue)
2025-12-02 19:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN18FNK/2025-12-02/image/60b39c45-6880-4e66-8d48-1a406989a5d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639666?view=catalogue)
2025-12-02 19:06:06 [scrapy.extensions.logstats] INFO: Crawled 271 pages (at 35 pages/min), scraped 164 items (at 25 items/min)
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F6c80b8d2-9a7e-4248-9f72-a5dc78e730e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/6c80b8d2-9a7e-4248-9f72-a5dc78e730e3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/18121891-be91-4f68-9a71-325056aec16f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/a680f0bd-a696-4e47-b067-4d37aa2fad36_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596515?view=catalogue)
2025-12-02 19:06:06 [astonbarclay.gb] INFO: Found listing with ID: 117672698
2025-12-02 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672698%27 HTTP/1.1" 200 None
2025-12-02 19:06:07 [astonbarclay.gb] INFO: Scrape type for 117672698: 1
2025-12-02 19:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf37e1ed0>
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F20f50bc7-4d03-49c4-af2d-49ac520ac6b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/20f50bc7-4d03-49c4-af2d-49ac520ac6b0_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15150dd1-06a3-50e5-8828-51d58f2a23ab
2025-12-02 19:06:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117270372, 'registration': 'MK68FZX', 'account': 'MAN037', 'make': 'CITROEN', 'model': 'C4 SPACETOURER ESTATE', 'derivative': '1.2 PureTech 130 Flair 5dr', 'mileage': 55695, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-02-18', 'fuel': 'Petrol', 'motExpiry': '2026-02-18', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MK68FZX/2025-11-17/image/af8b80d8-3351-4c53-9e5b-cffa8bdca614_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/1a079ffd-87a2-4286-844d-d38e1db28128_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/af0b305c-113f-408e-9998-f06717d23aca_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/9ff79f43-ec38-4b87-8e74-9f6b412895c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/041766b8-ee9f-4169-8993-bc316be22b52_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/6d0de12a-6040-41e0-ba22-0040232a7519_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/5f8efce6-2935-4a40-ba10-573fe6380c24_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 02/20 11K - 03/21 18K - 05/22 27K - 02/24 44K - 02/25 53K', 'remarks': 'VOSA STATES 25K - 34K- 44K - 53K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad7f232d-aff9-45e1-aa25-0fbb980ce85d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117270372, 'registration': 'MK68FZX', 'account': 'MAN037', 'make': 'CITROEN', 'model': 'C4 SPACETOURER ESTATE', 'derivative': '1.2 PureTech 130 Flair 5dr', 'mileage': 55695, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-02-18', 'fuel': 'Petrol', 'motExpiry': '2026-02-18', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MK68FZX/2025-11-17/image/af8b80d8-3351-4c53-9e5b-cffa8bdca614_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/1a079ffd-87a2-4286-844d-d38e1db28128_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/af0b305c-113f-408e-9998-f06717d23aca_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/9ff79f43-ec38-4b87-8e74-9f6b412895c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/041766b8-ee9f-4169-8993-bc316be22b52_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/6d0de12a-6040-41e0-ba22-0040232a7519_removebg.jpg?w=600', 'https://abimg003.imgix.net/MK68FZX/2025-11-17/image/5f8efce6-2935-4a40-ba10-573fe6380c24_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 02/20 11K - 03/21 18K - 05/22 27K - 02/24 44K - 02/25 53K', 'remarks': 'VOSA STATES 25K - 34K- 44K - 53K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad7f232d-aff9-45e1-aa25-0fbb980ce85d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fc0c382-c245-5e86-aaf8-5ec60c0674df with identifier: 117270372
2025-12-02 19:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fc0c382-c245-5e86-aaf8-5ec60c0674df with scrape type 2
2025-12-02 19:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fc0c382-c245-5e86-aaf8-5ec60c0674df with scrape type 2
2025-12-02 19:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3fc0c382-c245-5e86-aaf8-5ec60c0674df, identifier: 117270372
2025-12-02 19:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3fc0c382-c245-5e86-aaf8-5ec60c0674df with identifier: 117270372
2025-12-02 19:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3fc0c382-c245-5e86-aaf8-5ec60c0674df with identifier: 117270372
2025-12-02 19:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3fc0c382-c245-5e86-aaf8-5ec60c0674df with identifier: 117270372 to the API
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273fc0c382-c245-5e86-aaf8-5ec60c0674df%27 HTTP/1.1" 200 None
2025-12-02 19:06:07 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3fc0c382-c245-5e86-aaf8-5ec60c0674df: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:07 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117270372?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '3fc0c382-c245-5e86-aaf8-5ec60c0674df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MK68FZX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117270372',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'CITROEN',
 'model': 'C4 SPACETOURER ESTATE',
 'odometer': 55695,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-18',
 'seller_name': 'Manamanx Ltd',
 'title': 'CITROEN C4 SPACETOURER ESTATE 1.2 PureTech 130 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 Flair 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117270372%27 HTTP/1.1" 200 None
2025-12-02 19:06:07 [astonbarclay.gb] INFO: Saving data for 117270372: {'auction_closing_time': 1765215000.0, 'created_time': 1763406268.471892, 'last_price_update_time': 1764702367.709674}
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117270372') HTTP/1.1" 204 0
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06cc110>
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F0ae7f976-9247-4290-9cfe-b5906f7ba624_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0ae7f976-9247-4290-9cfe-b5906f7ba624_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15150dd1-06a3-50e5-8828-51d58f2a23ab
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf093a590>
2025-12-02 19:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F076651fc-5cd5-460b-ac62-fcb21ea4d517_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/076651fc-5cd5-460b-ac62-fcb21ea4d517_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf20078d0>
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F9a4ad354-ead6-4282-8f95-a5ba52185852_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/9a4ad354-ead6-4282-8f95-a5ba52185852_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/b7af1c5c-22af-4bb8-acea-597f21e78af4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596515?view=catalogue)
2025-12-02 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO68DDE/2025-12-02/image/7ea5e44c-9ce4-4cde-9a48-7113f2c0da48_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639372?view=catalogue)
2025-12-02 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN18FNK/2025-12-02/image/740a472a-ac1e-4ee7-a7c2-869d0aa22ffa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639666?view=catalogue)
2025-12-02 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO68DDE/2025-12-02/image/0502d222-927b-4aa7-9c9c-6ef9790c2e9d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639372?view=catalogue)
2025-12-02 19:06:08 [astonbarclay.gb] INFO: Found listing with ID: 117661968
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661968%27 HTTP/1.1" 200 None
2025-12-02 19:06:08 [astonbarclay.gb] INFO: Scrape type for 117661968: 1
2025-12-02 19:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EN18FNK/2025-12-02/image/51d11a76-ea2f-4c4a-abea-9d4095793d2f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639666?view=catalogue)
2025-12-02 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/4da09e78-74ac-4e46-8e51-3c7f955437b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596515?view=catalogue)
2025-12-02 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/fdadedc6-8cea-44cf-ba15-3d271faed6e8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF21LKL/2025-12-02/image/bdc3bf57-df33-42d9-b854-9cc63a6b08dd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579278?view=catalogue)
2025-12-02 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570049?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117601685?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117572803?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf094b190>
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252Fcfe60137-b4c4-411c-9cea-979c5b89fef7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/cfe60137-b4c4-411c-9cea-979c5b89fef7_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07e8810>
2025-12-02 19:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252Fcd315941-7f16-4484-9990-2c39c6594acf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/cd315941-7f16-4484-9990-2c39c6594acf_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf097b810>
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252F60b39c45-6880-4e66-8d48-1a406989a5d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/60b39c45-6880-4e66-8d48-1a406989a5d4_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf091c7d0>
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F18121891-be91-4f68-9a71-325056aec16f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/18121891-be91-4f68-9a71-325056aec16f_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0511f50>
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252Fa680f0bd-a696-4e47-b067-4d37aa2fad36_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/a680f0bd-a696-4e47-b067-4d37aa2fad36_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15150dd1-06a3-50e5-8828-51d58f2a23ab
2025-12-02 19:06:09 [astonbarclay.gb] INFO: Found listing with ID: 116617318
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116617318%27 HTTP/1.1" 200 None
2025-12-02 19:06:09 [astonbarclay.gb] INFO: Scrape type for 116617318: 0
2025-12-02 19:06:09 [astonbarclay.gb] INFO: Found listing with ID: 117600062
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600062%27 HTTP/1.1" 200 None
2025-12-02 19:06:09 [astonbarclay.gb] INFO: Scrape type for 117600062: 1
2025-12-02 19:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO68DDE/2025-12-02/image/5c04f673-6fd7-4c5f-b46b-e7319166bffe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639372?view=catalogue)
2025-12-02 19:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/6da24ed3-4f25-4a82-9f14-9adf60e738e1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:10 [astonbarclay.gb] INFO: Found listing with ID: 117623566
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623566%27 HTTP/1.1" 200 None
2025-12-02 19:06:10 [astonbarclay.gb] INFO: Scrape type for 117623566: 0
2025-12-02 19:06:10 [astonbarclay.gb] INFO: Found listing with ID: 117099385
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099385%27 HTTP/1.1" 200 None
2025-12-02 19:06:10 [astonbarclay.gb] INFO: Scrape type for 117099385: 2
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0405c10>
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252Fb7af1c5c-22af-4bb8-acea-597f21e78af4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/b7af1c5c-22af-4bb8-acea-597f21e78af4_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15150dd1-06a3-50e5-8828-51d58f2a23ab
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0391dd0>
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F7ea5e44c-9ce4-4cde-9a48-7113f2c0da48_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/7ea5e44c-9ce4-4cde-9a48-7113f2c0da48_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0379450>
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252F740a472a-ac1e-4ee7-a7c2-869d0aa22ffa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/740a472a-ac1e-4ee7-a7c2-869d0aa22ffa_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0390f10>
2025-12-02 19:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F0502d222-927b-4aa7-9c9c-6ef9790c2e9d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/0502d222-927b-4aa7-9c9c-6ef9790c2e9d_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf086fe90>
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEN18FNK%252F2025-12-02%252Fimage%252F51d11a76-ea2f-4c4a-abea-9d4095793d2f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EN18FNK/2025-12-02/image/51d11a76-ea2f-4c4a-abea-9d4095793d2f_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747
2025-12-02 19:06:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f80fd4d2-4ea2-59a1-be89-d08d1cdef747, skipping ID generation
2025-12-02 19:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747 with scrape type 1
2025-12-02 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f80fd4d2-4ea2-59a1-be89-d08d1cdef747 from tracking dictionaries
2025-12-02 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f80fd4d2-4ea2-59a1-be89-d08d1cdef747 sending to next pipeline
2025-12-02 19:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f80fd4d2-4ea2-59a1-be89-d08d1cdef747, identifier: 117639666
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06cd410>
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F4da09e78-74ac-4e46-8e51-3c7f955437b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/4da09e78-74ac-4e46-8e51-3c7f955437b9_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15150dd1-06a3-50e5-8828-51d58f2a23ab
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08e9950>
2025-12-02 19:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_11.jpg HTTP/1.1" 201 0
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252Ffdadedc6-8cea-44cf-ba15-3d271faed6e8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/fdadedc6-8cea-44cf-ba15-3d271faed6e8_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02eca10>
2025-12-02 19:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252Fbdc3bf57-df33-42d9-b854-9cc63a6b08dd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/bdc3bf57-df33-42d9-b854-9cc63a6b08dd_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3
2025-12-02 19:06:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570049, 'registration': 'YC67FUF', 'account': 'MAN037', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.25 GT-line 5dr', 'mileage': 81608, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-09-21', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC67FUF/2025-11-27/image/f1f3abd8-4211-462f-a5b0-b705a0eed2ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/2eb943bb-7e4b-4ade-a899-5b04f70cadb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/ced34744-e26f-43aa-a2e4-8e304106bcea_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/3def4c87-5114-4806-a53e-4c3c2bd9e4dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/d7d4c8bc-1602-4e8e-92ee-a760756fdb1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/0e765aad-b919-4dd2-8388-45554e2617f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/e1294769-b32e-49ac-97e7-3514ad22d129_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/19b13a03-ead8-43c9-8990-45f0ff3df8c1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 09/18 695 MILES 695 08/19 1K - 09/20 3K - 07/21 9K - 02/22 19K - 08/22 29K - 03/23 39K - 09/23 49K - 03/24 59K - 09/24 68K', 'remarks': 'VOSA STATES 29K- 49K - 68K - 79K  - SPARE KEY IN OFFICE- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b59d25df-e1a0-459c-9168-d1662192d033.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570049, 'registration': 'YC67FUF', 'account': 'MAN037', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.25 GT-line 5dr', 'mileage': 81608, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-09-21', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC67FUF/2025-11-27/image/f1f3abd8-4211-462f-a5b0-b705a0eed2ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/2eb943bb-7e4b-4ade-a899-5b04f70cadb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/ced34744-e26f-43aa-a2e4-8e304106bcea_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/3def4c87-5114-4806-a53e-4c3c2bd9e4dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/d7d4c8bc-1602-4e8e-92ee-a760756fdb1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/0e765aad-b919-4dd2-8388-45554e2617f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/e1294769-b32e-49ac-97e7-3514ad22d129_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/19b13a03-ead8-43c9-8990-45f0ff3df8c1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 09/18 695 MILES 695 08/19 1K - 09/20 3K - 07/21 9K - 02/22 19K - 08/22 29K - 03/23 39K - 09/23 49K - 03/24 59K - 09/24 68K', 'remarks': 'VOSA STATES 29K- 49K - 68K - 79K  - SPARE KEY IN OFFICE- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b59d25df-e1a0-459c-9168-d1662192d033.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d73c9564-91e7-5fdb-b164-eb4f54479e8b with identifier: 117570049
2025-12-02 19:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d73c9564-91e7-5fdb-b164-eb4f54479e8b with scrape type 2
2025-12-02 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d73c9564-91e7-5fdb-b164-eb4f54479e8b with scrape type 2
2025-12-02 19:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d73c9564-91e7-5fdb-b164-eb4f54479e8b, identifier: 117570049
2025-12-02 19:06:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117601685, 'registration': 'VE17WZN', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL GRAND SPORT', 'derivative': '1.6 Turbo D ecoTec Design 5dr', 'mileage': 102211, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-07-14', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/928e2b5a-b6b3-4d4f-8bf7-9d671f27c062.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117601685, 'registration': 'VE17WZN', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL GRAND SPORT', 'derivative': '1.6 Turbo D ecoTec Design 5dr', 'mileage': 102211, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-07-14', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/928e2b5a-b6b3-4d4f-8bf7-9d671f27c062.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02be3b19-c215-5dec-9f71-fff56a83a756 with identifier: 117601685
2025-12-02 19:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02be3b19-c215-5dec-9f71-fff56a83a756 with scrape type 1
2025-12-02 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 02be3b19-c215-5dec-9f71-fff56a83a756
2025-12-02 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 02be3b19-c215-5dec-9f71-fff56a83a756
2025-12-02 19:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 02be3b19-c215-5dec-9f71-fff56a83a756, identifier: 117601685
2025-12-02 19:06:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117572803, 'registration': 'FH65FLL', 'account': 'WBA003', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '118d Sport 5dr', 'mileage': 74788, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-21', 'fuel': 'Diesel', 'motExpiry': '2026-11-20', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FH65FLL/2025-11-27/image/e1767bc7-0829-4f63-b413-440c0b1d1833_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/89a89f9e-53a4-4953-b7ba-a6908a85d7e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/076b7546-10fa-4d28-89ed-823d0e751b99_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/ee36608f-e3f3-4a4a-ad73-4f15e0db6fbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/10bc07f4-6f77-4054-8237-d8be583d19df_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/583b8a5f-b564-4cce-a805-f9b4b936819a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/ed702b46-91b0-435c-a189-32eeff420c99_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/7726b54c-7815-4269-99c9-f259d18a02aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/94b507cf-b219-4f09-9857-a12960bc23b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/a1128109-71d7-4558-a59e-d0a2d0055e6d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/17-19K, 12/18- 33K, 05/24- 70K - BOOK & IDRIVE', 'remarks': 'VOSA STATES 65K, 68K, 72K, 74K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6b76560c-86d6-4c93-ba63-790c9c4dd302.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117572803, 'registration': 'FH65FLL', 'account': 'WBA003', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '118d Sport 5dr', 'mileage': 74788, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-21', 'fuel': 'Diesel', 'motExpiry': '2026-11-20', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FH65FLL/2025-11-27/image/e1767bc7-0829-4f63-b413-440c0b1d1833_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/89a89f9e-53a4-4953-b7ba-a6908a85d7e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/076b7546-10fa-4d28-89ed-823d0e751b99_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/ee36608f-e3f3-4a4a-ad73-4f15e0db6fbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/10bc07f4-6f77-4054-8237-d8be583d19df_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/583b8a5f-b564-4cce-a805-f9b4b936819a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/ed702b46-91b0-435c-a189-32eeff420c99_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/7726b54c-7815-4269-99c9-f259d18a02aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/94b507cf-b219-4f09-9857-a12960bc23b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH65FLL/2025-11-27/image/a1128109-71d7-4558-a59e-d0a2d0055e6d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/17-19K, 12/18- 33K, 05/24- 70K - BOOK & IDRIVE', 'remarks': 'VOSA STATES 65K, 68K, 72K, 74K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6b76560c-86d6-4c93-ba63-790c9c4dd302.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf112bc-9308-5fde-9178-699232a1d759 with identifier: 117572803
2025-12-02 19:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbf112bc-9308-5fde-9178-699232a1d759 with scrape type 2
2025-12-02 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbf112bc-9308-5fde-9178-699232a1d759 with scrape type 2
2025-12-02 19:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cbf112bc-9308-5fde-9178-699232a1d759, identifier: 117572803
2025-12-02 19:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF21LKL/2025-12-02/image/acfb39ae-e3e4-453a-bc34-1ad7603db7d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579278?view=catalogue)
2025-12-02 19:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3c4d3f60-f0ae-491c-823d-606511c0bde1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117579278?view=catalogue)
2025-12-02 19:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f80fd4d2-4ea2-59a1-be89-d08d1cdef747 with identifier: 117639666
2025-12-02 19:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f80fd4d2-4ea2-59a1-be89-d08d1cdef747 with identifier: 117639666
2025-12-02 19:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f80fd4d2-4ea2-59a1-be89-d08d1cdef747 with identifier: 117639666 to the API
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EN18FNK/2025-12-02/image/51d11a76-ea2f-4c4a-abea-9d4095793d2f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'f80fd4d2-4ea2-59a1-be89-d08d1cdef747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN18FNK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117639666',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'ASTRA HATCHBACK',
 'odometer': 90587,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25981,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/fa2808c8-6990-463f-887c-42f2c9bc159c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23886,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/513dffc9-9655-4df5-87c9-a27acc6dbeba_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21760,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/d1453721-a50f-4e7d-be11-4c9136acd074_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23539,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/9d3a44c8-8788-4230-82cc-6ff02c728e91_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47507,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/f9a672c9-5fd5-4d32-b88f-13b82d47ae4b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74237,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/cd315941-7f16-4484-9990-2c39c6594acf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70628,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/60b39c45-6880-4e66-8d48-1a406989a5d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52460,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/740a472a-ac1e-4ee7-a7c2-869d0aa22ffa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80fd4d2-4ea2-59a1-be89-d08d1cdef747/f80fd4d2-4ea2-59a1-be89-d08d1cdef747_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35042,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EN18FNK/2025-12-02/image/51d11a76-ea2f-4c4a-abea-9d4095793d2f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-25',
 'seller_name': 'UKCGR - Trade',
 'title': 'VAUXHALL ASTRA HATCHBACK 1.0T ecoTEC SRi 5dr',
 'transmission': 'manual',
 'trim': '1.0T ecoTEC SRi 5dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639666%27 HTTP/1.1" 200 None
2025-12-02 19:06:12 [astonbarclay.gb] INFO: Saving data for 117639666: {'created_time': 1764702372.98931, 'last_price_update_time': 1764702372.989325, 'auction_closing_time': 1765215000.0}
2025-12-02 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117639666') HTTP/1.1" 204 0
2025-12-02 19:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d73c9564-91e7-5fdb-b164-eb4f54479e8b with identifier: 117570049
2025-12-02 19:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d73c9564-91e7-5fdb-b164-eb4f54479e8b with identifier: 117570049
2025-12-02 19:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d73c9564-91e7-5fdb-b164-eb4f54479e8b with identifier: 117570049 to the API
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117570049?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'd73c9564-91e7-5fdb-b164-eb4f54479e8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YC67FUF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570049',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'PICANTO HATCHBACK',
 'odometer': 81608,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-22',
 'seller_name': 'Manamanx Ltd',
 'title': 'KIA PICANTO HATCHBACK 1.25 GT-line 5dr',
 'transmission': 'manual',
 'trim': '1.25 GT-line 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570049%27 HTTP/1.1" 200 None
2025-12-02 19:06:13 [astonbarclay.gb] INFO: Saving data for 117570049: {'auction_closing_time': 1765215000.0, 'created_time': 1764270227.883402, 'last_price_update_time': 1764702373.28723}
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570049') HTTP/1.1" 204 0
2025-12-02 19:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 02be3b19-c215-5dec-9f71-fff56a83a756 with identifier: 117601685
2025-12-02 19:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 02be3b19-c215-5dec-9f71-fff56a83a756 with identifier: 117601685
2025-12-02 19:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164492 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164492
2025-12-02 19:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 02be3b19-c215-5dec-9f71-fff56a83a756 spider: astonbarclay.gb
2025-12-02 19:06:13 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 02be3b19-c215-5dec-9f71-fff56a83a756 due to rule: high_mileage_for_country.json, error: 164492 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164492
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '02be3b19-c215-5dec-9f71-fff56a83a756',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VE17WZN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117601685',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA DIESEL GRAND SPORT',
 'odometer': 102211,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-14',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL INSIGNIA DIESEL GRAND SPORT 1.6 Turbo D ecoTec Design 5dr',
 'transmission': 'manual',
 'trim': '1.6 Turbo D ecoTec Design 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601685%27 HTTP/1.1" 200 None
2025-12-02 19:06:13 [astonbarclay.gb] INFO: Saving data for 117601685: {'created_time': 1764702373.504376, 'last_price_update_time': 1764702373.504386, 'auction_closing_time': 1765215000.0}
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117601685') HTTP/1.1" 204 0
2025-12-02 19:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cbf112bc-9308-5fde-9178-699232a1d759 with identifier: 117572803
2025-12-02 19:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cbf112bc-9308-5fde-9178-699232a1d759 with identifier: 117572803
2025-12-02 19:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-02 19:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: cbf112bc-9308-5fde-9178-699232a1d759 spider: astonbarclay.gb
2025-12-02 19:06:13 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: cbf112bc-9308-5fde-9178-699232a1d759 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': 'cbf112bc-9308-5fde-9178-699232a1d759',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FH65FLL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117572803',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 74788,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-21',
 'seller_name': 'UKCGR - Select',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 118d Sport 5dr',
 'transmission': 'manual',
 'trim': '118d Sport 5dr',
 'vin': None,
 'year': 2015}
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572803%27 HTTP/1.1" 200 None
2025-12-02 19:06:13 [astonbarclay.gb] INFO: Saving data for 117572803: {'auction_closing_time': 1765215000.0, 'created_time': 1764356716.874724, 'last_price_update_time': 1764702373.716341}
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117572803') HTTP/1.1" 204 0
2025-12-02 19:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO68DDE/2025-12-02/image/8c6173ff-61ed-401d-b432-d0c4beaf26b6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639372?view=catalogue)
2025-12-02 19:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/6c80b8d2-9a7e-4248-9f72-a5dc78e730e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596515?view=catalogue)
2025-12-02 19:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO68DDE/2025-12-02/image/d22e1362-25cb-461e-ab51-a716d6f7515b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117639372?view=catalogue)
2025-12-02 19:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a3e6416e-e6bc-44bc-9589-1da1d266124e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LA71YGC/2025-12-02/image/54ee10cd-9dc1-4391-bb14-c6276e4f0c17_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117580116?view=catalogue)
2025-12-02 19:06:13 [astonbarclay.gb] INFO: Found listing with ID: 117638131
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638131%27 HTTP/1.1" 200 None
2025-12-02 19:06:13 [astonbarclay.gb] INFO: Scrape type for 117638131: 2
2025-12-02 19:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71SXU/2025-11-28/image/f1035b6b-1cd2-47fa-ae7b-fcad68ffbf91_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117597727?view=catalogue)
2025-12-02 19:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117663579?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117623725?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:13 [astonbarclay.gb] INFO: Found listing with ID: 117664913
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117664913%27 HTTP/1.1" 200 None
2025-12-02 19:06:13 [astonbarclay.gb] INFO: Scrape type for 117664913: 1
2025-12-02 19:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04f9850>
2025-12-02 19:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F5c04f673-6fd7-4c5f-b46b-e7319166bffe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/5c04f673-6fd7-4c5f-b46b-e7319166bffe_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0783d10>
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F6da24ed3-4f25-4a82-9f14-9adf60e738e1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/6da24ed3-4f25-4a82-9f14-9adf60e738e1_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf3706d50>
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252Facfb39ae-e3e4-453a-bc34-1ad7603db7d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/acfb39ae-e3e4-453a-bc34-1ad7603db7d2_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04fbf90>
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKF21LKL%252F2025-12-02%252Fimage%252F3c4d3f60-f0ae-491c-823d-606511c0bde1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3c4d3f60-f0ae-491c-823d-606511c0bde1_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3
2025-12-02 19:06:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80dfac32-5983-56a1-bd7a-ffd6b8e792b3, skipping ID generation
2025-12-02 19:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3 with scrape type 1
2025-12-02 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3 from tracking dictionaries
2025-12-02 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80dfac32-5983-56a1-bd7a-ffd6b8e792b3 sending to next pipeline
2025-12-02 19:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 80dfac32-5983-56a1-bd7a-ffd6b8e792b3, identifier: 117579278
2025-12-02 19:06:14 [astonbarclay.gb] INFO: Found listing with ID: 117345378
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117345378%27 HTTP/1.1" 200 None
2025-12-02 19:06:14 [astonbarclay.gb] INFO: Scrape type for 117345378: 2
2025-12-02 19:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 80dfac32-5983-56a1-bd7a-ffd6b8e792b3 with identifier: 117579278
2025-12-02 19:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 80dfac32-5983-56a1-bd7a-ffd6b8e792b3 with identifier: 117579278
2025-12-02 19:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159236 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159236
2025-12-02 19:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 80dfac32-5983-56a1-bd7a-ffd6b8e792b3 spider: astonbarclay.gb
2025-12-02 19:06:15 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 80dfac32-5983-56a1-bd7a-ffd6b8e792b3 due to rule: high_mileage_for_country.json, error: 159236 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159236
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '80dfac32-5983-56a1-bd7a-ffd6b8e792b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KF21LKL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579278',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'LEAF HATCHBACK',
 'odometer': 98945,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40924,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/8803cd74-9e6d-4d6d-adc6-604bc0d743ec_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44685,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/0ac72ded-51d8-48aa-9aca-2e80805677e1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30494,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/d432e2f1-8289-44ec-b1a1-74e9fe980a38_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43151,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/a26a3eec-ff02-405c-b4ba-a7f0f46385e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52398,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/9ef3f7ed-3642-489f-9e32-8a508be207b4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43590,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/acfb39ae-e3e4-453a-bc34-1ad7603db7d2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47146,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3aa77e18-bd33-4213-aa94-bf97effd3b64_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30281,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/3c4d3f60-f0ae-491c-823d-606511c0bde1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56447,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/076651fc-5cd5-460b-ac62-fcb21ea4d517_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80dfac32-5983-56a1-bd7a-ffd6b8e792b3/80dfac32-5983-56a1-bd7a-ffd6b8e792b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66612,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KF21LKL/2025-12-02/image/bdc3bf57-df33-42d9-b854-9cc63a6b08dd_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-30',
 'seller_name': 'WeFlex',
 'title': 'NISSAN LEAF HATCHBACK 160kW e+ N-Connecta 62kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '160kW e+ N-Connecta 62kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579278%27 HTTP/1.1" 200 None
2025-12-02 19:06:15 [astonbarclay.gb] INFO: Saving data for 117579278: {'created_time': 1764702375.073928, 'last_price_update_time': 1764702375.073976, 'auction_closing_time': 1765188000.0}
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117579278') HTTP/1.1" 204 0
2025-12-02 19:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/811fe0f8-964f-4a89-ac5b-c2a1061d17a0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT70SXH/2025-12-02/image/9c6e4765-7f21-4593-92b9-78a0bd612e5d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117029988?view=catalogue)
2025-12-02 19:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FD72LHT/2025-11-27/image/2ba9c46b-7515-4e02-8435-6c00b992d1d6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561425?view=catalogue)
2025-12-02 19:06:15 [astonbarclay.gb] INFO: Found listing with ID: 117672175
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672175%27 HTTP/1.1" 200 None
2025-12-02 19:06:15 [astonbarclay.gb] INFO: Scrape type for 117672175: 1
2025-12-02 19:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570719?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0864050>
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252F8c6173ff-61ed-401d-b432-d0c4beaf26b6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/8c6173ff-61ed-401d-b432-d0c4beaf26b6_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f0c6d0>
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVE65RDZ%252F2025-12-02%252Fimage%252F6c80b8d2-9a7e-4248-9f72-a5dc78e730e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/6c80b8d2-9a7e-4248-9f72-a5dc78e730e3_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15150dd1-06a3-50e5-8828-51d58f2a23ab
2025-12-02 19:06:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15150dd1-06a3-50e5-8828-51d58f2a23ab, skipping ID generation
2025-12-02 19:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15150dd1-06a3-50e5-8828-51d58f2a23ab with scrape type 1
2025-12-02 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 15150dd1-06a3-50e5-8828-51d58f2a23ab from tracking dictionaries
2025-12-02 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15150dd1-06a3-50e5-8828-51d58f2a23ab sending to next pipeline
2025-12-02 19:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 15150dd1-06a3-50e5-8828-51d58f2a23ab, identifier: 117596515
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06ccd90>
2025-12-02 19:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO68DDE%252F2025-12-02%252Fimage%252Fd22e1362-25cb-461e-ab51-a716d6f7515b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO68DDE/2025-12-02/image/d22e1362-25cb-461e-ab51-a716d6f7515b_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55
2025-12-02 19:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d66b883-b2fb-50fd-8500-2b12fa1b8e55, skipping ID generation
2025-12-02 19:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55 with scrape type 1
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55 from tracking dictionaries
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d66b883-b2fb-50fd-8500-2b12fa1b8e55 sending to next pipeline
2025-12-02 19:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d66b883-b2fb-50fd-8500-2b12fa1b8e55, identifier: 117639372
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f0c5d0>
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252Fa3e6416e-e6bc-44bc-9589-1da1d266124e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a3e6416e-e6bc-44bc-9589-1da1d266124e_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06abc90>
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLA71YGC%252F2025-12-02%252Fimage%252F54ee10cd-9dc1-4391-bb14-c6276e4f0c17_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LA71YGC/2025-12-02/image/54ee10cd-9dc1-4391-bb14-c6276e4f0c17_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41609080-c5a8-5573-b549-55230e8373b6
2025-12-02 19:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41609080-c5a8-5573-b549-55230e8373b6, skipping ID generation
2025-12-02 19:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41609080-c5a8-5573-b549-55230e8373b6 with scrape type 1
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 41609080-c5a8-5573-b549-55230e8373b6 from tracking dictionaries
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41609080-c5a8-5573-b549-55230e8373b6 sending to next pipeline
2025-12-02 19:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 41609080-c5a8-5573-b549-55230e8373b6, identifier: 117580116
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf060a890>
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252Ff1035b6b-1cd2-47fa-ae7b-fcad68ffbf91_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/f1035b6b-1cd2-47fa-ae7b-fcad68ffbf91_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89f3219e-41c9-557e-aed5-2984165bb017
2025-12-02 19:06:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117663579, 'registration': 'EJ16TMY', 'account': 'MOT075', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '2.0d R-Sport 5dr Auto AWD', 'mileage': 99051, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-05-28', 'fuel': 'Diesel', 'motExpiry': '2026-04-10', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 47K 66K 70K 77K 87K 92K 96K, NUMBER OF FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1eca30ce-fac7-4548-99d5-556298554202.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117663579, 'registration': 'EJ16TMY', 'account': 'MOT075', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '2.0d R-Sport 5dr Auto AWD', 'mileage': 99051, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-05-28', 'fuel': 'Diesel', 'motExpiry': '2026-04-10', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 47K 66K 70K 77K 87K 92K 96K, NUMBER OF FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1eca30ce-fac7-4548-99d5-556298554202.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19c8878a-28f6-5729-8bb0-d2f8b1a29f52 with identifier: 117663579
2025-12-02 19:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19c8878a-28f6-5729-8bb0-d2f8b1a29f52 with scrape type 1
2025-12-02 19:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 19c8878a-28f6-5729-8bb0-d2f8b1a29f52
2025-12-02 19:06:17 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 19c8878a-28f6-5729-8bb0-d2f8b1a29f52
2025-12-02 19:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 19c8878a-28f6-5729-8bb0-d2f8b1a29f52, identifier: 117663579
2025-12-02 19:06:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117623725, 'registration': 'AO72WSU', 'account': 'KIN032', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW M Sport 80kWh 5dr Auto', 'mileage': 15823, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-28', 'fuel': 'Electric', 'motExpiry': '2026-11-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AO72WSU/2025-12-02/image/fd0f4974-a57d-4fbc-962c-1361199a7a0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/bd11bb43-083f-4344-90a7-bf92ec3b9538_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/edf16b02-010b-4756-9e2f-8bb9e8615619_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/a7b8c459-8484-4775-b60a-9860b0086856_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/83cdc093-ca9c-4ad3-9f2c-e074dd80ab39_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/41fd699b-3a2a-44ab-9e5c-ef5a27033d49_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/670570d7-329e-42ce-b6b5-2247670401e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/84f4cc64-a675-46a3-8473-aeb82b3d974b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/4d9595cf-6a79-4a2d-8e4e-8390e46f99b4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/47765153-6e5e-4e87-ba92-fcae093ec2a8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:06:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117623725, 'registration': 'AO72WSU', 'account': 'KIN032', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW M Sport 80kWh 5dr Auto', 'mileage': 15823, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-28', 'fuel': 'Electric', 'motExpiry': '2026-11-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AO72WSU/2025-12-02/image/fd0f4974-a57d-4fbc-962c-1361199a7a0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/bd11bb43-083f-4344-90a7-bf92ec3b9538_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/edf16b02-010b-4756-9e2f-8bb9e8615619_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/a7b8c459-8484-4775-b60a-9860b0086856_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/83cdc093-ca9c-4ad3-9f2c-e074dd80ab39_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/41fd699b-3a2a-44ab-9e5c-ef5a27033d49_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/670570d7-329e-42ce-b6b5-2247670401e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/84f4cc64-a675-46a3-8473-aeb82b3d974b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72WSU/2025-12-02/image/4d9595cf-6a79-4a2d-8e4e-8390e46f99b4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/47765153-6e5e-4e87-ba92-fcae093ec2a8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 with identifier: 117623725
2025-12-02 19:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 with scrape type 2
2025-12-02 19:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 with scrape type 2
2025-12-02 19:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4, identifier: 117623725
2025-12-02 19:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 15150dd1-06a3-50e5-8828-51d58f2a23ab with identifier: 117596515
2025-12-02 19:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 15150dd1-06a3-50e5-8828-51d58f2a23ab with identifier: 117596515
2025-12-02 19:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-02 19:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 15150dd1-06a3-50e5-8828-51d58f2a23ab spider: astonbarclay.gb
2025-12-02 19:06:17 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 15150dd1-06a3-50e5-8828-51d58f2a23ab due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '15150dd1-06a3-50e5-8828-51d58f2a23ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VE65RDZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117596515',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 37435,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37684,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/2f541e55-97b1-4fe8-95dc-e76fd72d27f5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37856,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/7afb8d44-5835-4f7d-acf4-eedb3b5bdc2c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31538,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0c84f9a2-9ec1-4b7b-8cbc-ab6f5301a8df_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30219,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/20f50bc7-4d03-49c4-af2d-49ac520ac6b0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56485,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/0ae7f976-9247-4290-9cfe-b5906f7ba624_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39563,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/a680f0bd-a696-4e47-b067-4d37aa2fad36_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49766,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/b7af1c5c-22af-4bb8-acea-597f21e78af4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49535,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/4da09e78-74ac-4e46-8e51-3c7f955437b9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15150dd1-06a3-50e5-8828-51d58f2a23ab/15150dd1-06a3-50e5-8828-51d58f2a23ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51183,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VE65RDZ/2025-12-02/image/6c80b8d2-9a7e-4248-9f72-a5dc78e730e3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.4T SE 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.4T SE 5dr Auto',
 'vin': None,
 'year': 2015}
2025-12-02 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117596515%27 HTTP/1.1" 200 None
2025-12-02 19:06:17 [astonbarclay.gb] INFO: Saving data for 117596515: {'created_time': 1764702377.41219, 'last_price_update_time': 1764702377.4122, 'auction_closing_time': 1765215000.0}
2025-12-02 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117596515') HTTP/1.1" 204 0
2025-12-02 19:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d66b883-b2fb-50fd-8500-2b12fa1b8e55 with identifier: 117639372
2025-12-02 19:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d66b883-b2fb-50fd-8500-2b12fa1b8e55 with identifier: 117639372
2025-12-02 19:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0d66b883-b2fb-50fd-8500-2b12fa1b8e55 with identifier: 117639372 to the API
2025-12-02 19:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LO68DDE/2025-12-02/image/d22e1362-25cb-461e-ab51-a716d6f7515b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '0d66b883-b2fb-50fd-8500-2b12fa1b8e55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LO68DDE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117639372',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'CITROEN',
 'model': 'C1 HATCHBACK',
 'odometer': 83059,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22898,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/8c6173ff-61ed-401d-b432-d0c4beaf26b6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24374,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/4392e7bd-b7a2-4de2-8f3a-55d4b2c5dc21_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24195,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/d22e1362-25cb-461e-ab51-a716d6f7515b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22498,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/02c23998-2ac9-4f64-9819-146596ff2c24_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43123,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/632d62c2-4dd2-4abd-9534-ca88e1e0b10d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87129,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/cfe60137-b4c4-411c-9cea-979c5b89fef7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42226,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/7ea5e44c-9ce4-4cde-9a48-7113f2c0da48_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33684,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/5c04f673-6fd7-4c5f-b46b-e7319166bffe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d66b883-b2fb-50fd-8500-2b12fa1b8e55/0d66b883-b2fb-50fd-8500-2b12fa1b8e55_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43361,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LO68DDE/2025-12-02/image/0502d222-927b-4aa7-9c9c-6ef9790c2e9d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-28',
 'seller_name': 'UKCGR - Select',
 'title': 'CITROEN C1 HATCHBACK 1.0 VTi 72 Feel 3dr',
 'transmission': 'manual',
 'trim': '1.0 VTi 72 Feel 3dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639372%27 HTTP/1.1" 200 None
2025-12-02 19:06:17 [astonbarclay.gb] INFO: Saving data for 117639372: {'created_time': 1764702377.795528, 'last_price_update_time': 1764702377.795541, 'auction_closing_time': 1765215000.0}
2025-12-02 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117639372') HTTP/1.1" 204 0
2025-12-02 19:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 41609080-c5a8-5573-b549-55230e8373b6 with identifier: 117580116
2025-12-02 19:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 41609080-c5a8-5573-b549-55230e8373b6 with identifier: 117580116
2025-12-02 19:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194966 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194966
2025-12-02 19:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 41609080-c5a8-5573-b549-55230e8373b6 spider: astonbarclay.gb
2025-12-02 19:06:18 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 41609080-c5a8-5573-b549-55230e8373b6 due to rule: high_mileage_for_country.json, error: 194966 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194966
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '41609080-c5a8-5573-b549-55230e8373b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LA71YGC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117580116',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'E-NIRO ELECTRIC ESTATE',
 'odometer': 121147,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30288,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/4be7c981-ef50-4c1d-ac14-122a4e1fd8ef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30135,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/d1466b5f-847a-472e-9ea2-45ed322ef80f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33662,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a361c7e9-c8cf-4db7-80d9-6d022838008a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34175,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/7437b13a-40b0-4ab7-acf8-b4374c142525_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39140,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/ce5d59cf-e2fb-4d5e-8f6c-3134eac5327d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42981,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/54ee10cd-9dc1-4391-bb14-c6276e4f0c17_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52549,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/800e1cc0-dd05-4ff2-afa1-1c1b688cbc28_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39346,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/a3e6416e-e6bc-44bc-9589-1da1d266124e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48365,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/9a4ad354-ead6-4282-8f95-a5ba52185852_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37863,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/18121891-be91-4f68-9a71-325056aec16f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58505,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/6da24ed3-4f25-4a82-9f14-9adf60e738e1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41609080-c5a8-5573-b549-55230e8373b6/41609080-c5a8-5573-b549-55230e8373b6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59307,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/LA71YGC/2025-12-02/image/fdadedc6-8cea-44cf-ba15-3d271faed6e8_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seller_name': 'WeFlex',
 'title': 'KIA E-NIRO ELECTRIC ESTATE 150kW 3 64kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW 3 64kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580116%27 HTTP/1.1" 200 None
2025-12-02 19:06:18 [astonbarclay.gb] INFO: Saving data for 117580116: {'created_time': 1764702378.054201, 'last_price_update_time': 1764702378.054211, 'auction_closing_time': 1765188000.0}
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117580116') HTTP/1.1" 204 0
2025-12-02 19:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 19c8878a-28f6-5729-8bb0-d2f8b1a29f52 with identifier: 117663579
2025-12-02 19:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 19c8878a-28f6-5729-8bb0-d2f8b1a29f52 with identifier: 117663579
2025-12-02 19:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159406 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159406
2025-12-02 19:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 19c8878a-28f6-5729-8bb0-d2f8b1a29f52 spider: astonbarclay.gb
2025-12-02 19:06:18 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 19c8878a-28f6-5729-8bb0-d2f8b1a29f52 due to rule: high_mileage_for_country.json, error: 159406 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159406
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '19c8878a-28f6-5729-8bb0-d2f8b1a29f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EJ16TMY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117663579',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'JAGUAR',
 'model': 'F-PACE DIESEL ESTATE',
 'odometer': 99051,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-28',
 'seller_name': 'MotoNovo Finance',
 'title': 'JAGUAR F-PACE DIESEL ESTATE 2.0d R-Sport 5dr Auto AWD',
 'transmission': 'automatic',
 'trim': '2.0d R-Sport 5dr Auto AWD',
 'vin': None,
 'year': 2016}
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117663579%27 HTTP/1.1" 200 None
2025-12-02 19:06:18 [astonbarclay.gb] INFO: Saving data for 117663579: {'created_time': 1764702378.259147, 'last_price_update_time': 1764702378.259156, 'auction_closing_time': 1765274400.0}
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117663579') HTTP/1.1" 204 0
2025-12-02 19:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 with identifier: 117623725
2025-12-02 19:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 with identifier: 117623725
2025-12-02 19:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'bmw ix3 electric estate 210kw m sport 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'ix3 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15823, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623725', 'expiration_date': '2025-12-09t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '210kw m sport 80kwh 5dr auto', 'license_plate': 'ao72wsu', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '39bcafb4-2ee3-5394-95e3-8fc20ce693f4', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'bmw ix3 electric estate', 'sanitized_make': 'bmw', 'odometer_in_km': 25464} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:00:00z',
     'fuel_type': 'electric',
     'id': '39bcafb4-2ee3-5394-95e3-8fc20ce693f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ao72wsu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623725',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw ix3 electric estate',
     'model': 'ix3 electric estate',
     'odometer': 15823,
     'odometer_in_km': 25464,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-28',
     'sanitized_make': 'bmw',
     'seller_name': 'kinto',
     'title': 'bmw ix3 electric estate 210kw m sport 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw m sport 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 spider: astonbarclay.gb
2025-12-02 19:06:18 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'bmw ix3 electric estate 210kw m sport 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'ix3 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15823, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623725', 'expiration_date': '2025-12-09t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '210kw m sport 80kwh 5dr auto', 'license_plate': 'ao72wsu', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '39bcafb4-2ee3-5394-95e3-8fc20ce693f4', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'bmw ix3 electric estate', 'sanitized_make': 'bmw', 'odometer_in_km': 25464} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:00:00z',
     'fuel_type': 'electric',
     'id': '39bcafb4-2ee3-5394-95e3-8fc20ce693f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ao72wsu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623725',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw ix3 electric estate',
     'model': 'ix3 electric estate',
     'odometer': 15823,
     'odometer_in_km': 25464,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-28',
     'sanitized_make': 'bmw',
     'seller_name': 'kinto',
     'title': 'bmw ix3 electric estate 210kw m sport 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw m sport 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '39bcafb4-2ee3-5394-95e3-8fc20ce693f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AO72WSU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623725',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': 'iX3 ELECTRIC ESTATE',
 'odometer': 15823,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seller_name': 'Kinto',
 'title': 'BMW iX3 ELECTRIC ESTATE 210kW M Sport 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '210kW M Sport 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623725%27 HTTP/1.1" 200 None
2025-12-02 19:06:18 [astonbarclay.gb] INFO: Saving data for 117623725: {'auction_closing_time': 1765274400.0, 'created_time': 1764615687.485687, 'last_price_update_time': 1764702378.490689}
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117623725') HTTP/1.1" 204 0
2025-12-02 19:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SM70DWN/2025-11-28/image/b02623c1-e3a5-4b1f-a246-6441d5d51bed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117581526?view=catalogue)
2025-12-02 19:06:18 [astonbarclay.gb] INFO: Found listing with ID: 117599696
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599696%27 HTTP/1.1" 200 None
2025-12-02 19:06:18 [astonbarclay.gb] INFO: Scrape type for 117599696: 2
2025-12-02 19:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117672698?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf033c710>
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F811fe0f8-964f-4a89-ac5b-c2a1061d17a0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/811fe0f8-964f-4a89-ac5b-c2a1061d17a0_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf065ee90>
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252F9c6e4765-7f21-4593-92b9-78a0bd612e5d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/9c6e4765-7f21-4593-92b9-78a0bd612e5d_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0df80b6a-6c89-5fb4-8531-6651333b469d
2025-12-02 19:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f0f210>
2025-12-02 19:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFD72LHT%252F2025-11-27%252Fimage%252F2ba9c46b-7515-4e02-8435-6c00b992d1d6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FD72LHT/2025-11-27/image/2ba9c46b-7515-4e02-8435-6c00b992d1d6_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77
2025-12-02 19:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77, skipping ID generation
2025-12-02 19:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77 with scrape type 1
2025-12-02 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77 from tracking dictionaries
2025-12-02 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77 sending to next pipeline
2025-12-02 19:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77, identifier: 117561425
2025-12-02 19:06:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570719, 'registration': 'AF66FHH', 'account': 'MAN037', 'make': 'KIA', 'model': 'OPTIMA SALOON', 'derivative': '2.0 GDi PHEV 4dr Auto', 'mileage': 36586, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-16', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-01', 'doors': 4, 'engineSize': 1999, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AF66FHH/2025-11-27/image/7efe941a-2bc3-4519-a32a-5059259e516e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/bc0c3df4-6827-40ac-8054-165fcbbbcc7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/35360234-c078-4f1f-b24b-867f85e7ccbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/f9423201-b388-438f-930c-2094f02e0c41_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/4a6959c1-446d-4358-b35c-e5a1a569183e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/beedc68e-95a5-4450-863c-eba0eabc891d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/6fde6a56-2f86-429b-ba27-14247c10fcdf_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 11/21 12K -', 'remarks': 'VOSA STATES 12K- 21K- 30K - 36K SPARE KEY IN OFFICE - SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 37, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/89f30c0c-9ec7-4779-832f-05b85dfe1655.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570719, 'registration': 'AF66FHH', 'account': 'MAN037', 'make': 'KIA', 'model': 'OPTIMA SALOON', 'derivative': '2.0 GDi PHEV 4dr Auto', 'mileage': 36586, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-16', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-01', 'doors': 4, 'engineSize': 1999, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AF66FHH/2025-11-27/image/7efe941a-2bc3-4519-a32a-5059259e516e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/bc0c3df4-6827-40ac-8054-165fcbbbcc7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/35360234-c078-4f1f-b24b-867f85e7ccbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/f9423201-b388-438f-930c-2094f02e0c41_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/4a6959c1-446d-4358-b35c-e5a1a569183e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/beedc68e-95a5-4450-863c-eba0eabc891d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/6fde6a56-2f86-429b-ba27-14247c10fcdf_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 11/21 12K -', 'remarks': 'VOSA STATES 12K- 21K- 30K - 36K SPARE KEY IN OFFICE - SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 37, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/89f30c0c-9ec7-4779-832f-05b85dfe1655.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 948320e5-e8e7-5700-ac0d-311450e5b351 with identifier: 117570719
2025-12-02 19:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 948320e5-e8e7-5700-ac0d-311450e5b351 with scrape type 2
2025-12-02 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 948320e5-e8e7-5700-ac0d-311450e5b351 with scrape type 2
2025-12-02 19:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 948320e5-e8e7-5700-ac0d-311450e5b351, identifier: 117570719
2025-12-02 19:06:19 [astonbarclay.gb] INFO: Found listing with ID: 117606946
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117606946%27 HTTP/1.1" 200 None
2025-12-02 19:06:19 [astonbarclay.gb] INFO: Scrape type for 117606946: 2
2025-12-02 19:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77 with identifier: 117561425
2025-12-02 19:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77 with identifier: 117561425
2025-12-02 19:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77 with identifier: 117561425 to the API
2025-12-02 19:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FD72LHT/2025-11-27/image/2ba9c46b-7515-4e02-8435-6c00b992d1d6_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FD72LHT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117561425',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 44244,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33900,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/48456945-f37f-4695-b02d-02aac3f5bd85_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35431,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/11ad892c-59e5-41ac-9e49-1b0d036b7853_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34371,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/e707046c-05eb-4c43-8577-3b5ef5a68593_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36050,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/eb726f50-78e4-4030-a92c-eabae3506079_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46545,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/0cdbae31-29ce-430d-b5a2-962486336015_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36052,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/2ba9c46b-7515-4e02-8435-6c00b992d1d6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63659,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/d5aeb795-d29d-4efe-95ce-2fcfebb18aa8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54194,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/affd54ad-a60b-4394-983c-c6dd71d2a68d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47104,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/431b0595-1c7b-43da-8673-8ae777a89963_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77/f61f0cc8-a3a9-5ac3-8cf2-417b2c5aed77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55687,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FD72LHT/2025-11-27/image/03e383a1-6f32-42b1-b15e-6610b3d35e84_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seller_name': 'Zenith',
 'title': 'BMW 1 SERIES HATCHBACK 118i [136] M Sport 5dr Step Auto [LCP]',
 'transmission': 'automatic',
 'trim': '118i [136] M Sport 5dr Step Auto [LCP]',
 'vin': None,
 'year': 2022}
2025-12-02 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117561425%27 HTTP/1.1" 200 None
2025-12-02 19:06:20 [astonbarclay.gb] INFO: Saving data for 117561425: {'created_time': 1764702380.75348, 'last_price_update_time': 1764702380.75349, 'auction_closing_time': 1764927900.0}
2025-12-02 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117561425') HTTP/1.1" 204 0
2025-12-02 19:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 948320e5-e8e7-5700-ac0d-311450e5b351 with identifier: 117570719
2025-12-02 19:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 948320e5-e8e7-5700-ac0d-311450e5b351 with identifier: 117570719
2025-12-02 19:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 948320e5-e8e7-5700-ac0d-311450e5b351 with identifier: 117570719 to the API
2025-12-02 19:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117570719?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '948320e5-e8e7-5700-ac0d-311450e5b351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AF66FHH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570719',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'OPTIMA SALOON',
 'odometer': 36586,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-16',
 'seller_name': 'Manamanx Ltd',
 'title': 'KIA OPTIMA SALOON 2.0 GDi PHEV 4dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 GDi PHEV 4dr Auto',
 'vin': None,
 'year': 2016}
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570719%27 HTTP/1.1" 200 None
2025-12-02 19:06:21 [astonbarclay.gb] INFO: Saving data for 117570719: {'auction_closing_time': 1765215000.0, 'created_time': 1764270132.725713, 'last_price_update_time': 1764702381.076917}
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570719') HTTP/1.1" 204 0
2025-12-02 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71SXU/2025-11-28/image/df2760f0-ca5f-4451-a91a-0817448f0694_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117597727?view=catalogue)
2025-12-02 19:06:21 [astonbarclay.gb] INFO: Found listing with ID: 117543807
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543807%27 HTTP/1.1" 200 None
2025-12-02 19:06:21 [astonbarclay.gb] INFO: Scrape type for 117543807: 0
2025-12-02 19:06:21 [astonbarclay.gb] INFO: Found listing with ID: 117666809
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117666809%27 HTTP/1.1" 200 None
2025-12-02 19:06:21 [astonbarclay.gb] INFO: Scrape type for 117666809: 1
2025-12-02 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117661968?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117600062?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117099385?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:21 [astonbarclay.gb] INFO: Found listing with ID: 117631028
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631028%27 HTTP/1.1" 200 None
2025-12-02 19:06:21 [astonbarclay.gb] INFO: Scrape type for 117631028: 2
2025-12-02 19:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07ce610>
2025-12-02 19:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSM70DWN%252F2025-11-28%252Fimage%252Fb02623c1-e3a5-4b1f-a246-6441d5d51bed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SM70DWN/2025-11-28/image/b02623c1-e3a5-4b1f-a246-6441d5d51bed_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580
2025-12-02 19:06:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9cee39f-7c30-52e4-ba1e-f50e0a0c5580, skipping ID generation
2025-12-02 19:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580 with scrape type 1
2025-12-02 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580 from tracking dictionaries
2025-12-02 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9cee39f-7c30-52e4-ba1e-f50e0a0c5580 sending to next pipeline
2025-12-02 19:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b9cee39f-7c30-52e4-ba1e-f50e0a0c5580, identifier: 117581526
2025-12-02 19:06:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117672698, 'registration': 'AU16RYK', 'account': 'MOT075', 'make': 'BMW', 'model': 'Z4 ROADSTER', 'derivative': '20i sDrive M Sport 2dr', 'mileage': 35736, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-03-01', 'fuel': 'Petrol', 'motExpiry': '2025-02-14', 'doors': 2, 'engineSize': 1997, 'bodyType': 'Roadster', 'images': None, 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'NUMBER OF FORMER KEEPERS UNKNOWN, VOSA STATES 9K 17K 19K 23K 28K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/be04f987-5465-431f-a866-7d54165450d4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117672698, 'registration': 'AU16RYK', 'account': 'MOT075', 'make': 'BMW', 'model': 'Z4 ROADSTER', 'derivative': '20i sDrive M Sport 2dr', 'mileage': 35736, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-03-01', 'fuel': 'Petrol', 'motExpiry': '2025-02-14', 'doors': 2, 'engineSize': 1997, 'bodyType': 'Roadster', 'images': None, 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'NUMBER OF FORMER KEEPERS UNKNOWN, VOSA STATES 9K 17K 19K 23K 28K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/be04f987-5465-431f-a866-7d54165450d4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d2f876a-3e8b-5209-a82e-cca40cb223f8 with identifier: 117672698
2025-12-02 19:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d2f876a-3e8b-5209-a82e-cca40cb223f8 with scrape type 1
2025-12-02 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 4d2f876a-3e8b-5209-a82e-cca40cb223f8
2025-12-02 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 4d2f876a-3e8b-5209-a82e-cca40cb223f8
2025-12-02 19:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4d2f876a-3e8b-5209-a82e-cca40cb223f8, identifier: 117672698
2025-12-02 19:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b9cee39f-7c30-52e4-ba1e-f50e0a0c5580 with identifier: 117581526
2025-12-02 19:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b9cee39f-7c30-52e4-ba1e-f50e0a0c5580 with identifier: 117581526
2025-12-02 19:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 149678 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    149678
2025-12-02 19:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: b9cee39f-7c30-52e4-ba1e-f50e0a0c5580 spider: astonbarclay.gb
2025-12-02 19:06:21 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b9cee39f-7c30-52e4-ba1e-f50e0a0c5580 due to rule: high_mileage_for_make.json, error: 149678 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    149678
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'b9cee39f-7c30-52e4-ba1e-f50e0a0c5580',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SM70DWN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117581526',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 93006,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25235,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/b02623c1-e3a5-4b1f-a246-6441d5d51bed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25234,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/1c0faec5-5aa9-42b9-8543-53239a958418_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26154,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dd4fd636-f0b0-49c8-8bea-64329b091021_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26073,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/2263a198-db4f-4f11-9969-d483b2524413_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29517,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/516485e8-b8d3-450c-96f6-5540b3aa3fe1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36267,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/dbf1d95c-f538-4034-abcb-fe9307235024_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41309,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/227f1067-1a94-4f57-a988-212f1817b5f1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44222,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/3a452693-8cf2-456e-9a95-902b6428e222_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40443,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/4dd6b837-5cdf-4b1c-88aa-f208703778c9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9cee39f-7c30-52e4-ba1e-f50e0a0c5580/b9cee39f-7c30-52e4-ba1e-f50e0a0c5580_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46197,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SM70DWN/2025-11-28/image/7961a629-b617-4d75-97d7-322ae1d42814_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Standard Plus 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Standard Plus 4dr Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581526%27 HTTP/1.1" 200 None
2025-12-02 19:06:21 [astonbarclay.gb] INFO: Saving data for 117581526: {'created_time': 1764702381.778936, 'last_price_update_time': 1764702381.778955, 'auction_closing_time': 1764927900.0}
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117581526') HTTP/1.1" 204 0
2025-12-02 19:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4d2f876a-3e8b-5209-a82e-cca40cb223f8 with identifier: 117672698
2025-12-02 19:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4d2f876a-3e8b-5209-a82e-cca40cb223f8 with identifier: 117672698
2025-12-02 19:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4d2f876a-3e8b-5209-a82e-cca40cb223f8 with identifier: 117672698 to the API
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274d2f876a-3e8b-5209-a82e-cca40cb223f8%27 HTTP/1.1" 200 None
2025-12-02 19:06:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4d2f876a-3e8b-5209-a82e-cca40cb223f8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117672698?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4d2f876a-3e8b-5209-a82e-cca40cb223f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AU16RYK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117672698',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': 'Z4 ROADSTER',
 'odometer': 35736,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-01',
 'seller_name': 'MotoNovo Finance',
 'title': 'BMW Z4 ROADSTER 20i sDrive M Sport 2dr',
 'transmission': 'manual',
 'trim': '20i sDrive M Sport 2dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672698%27 HTTP/1.1" 200 None
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Saving data for 117672698: {'created_time': 1764702382.080589, 'last_price_update_time': 1764702382.0806, 'auction_closing_time': 1765274400.0}
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117672698') HTTP/1.1" 204 0
2025-12-02 19:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71FXV/2025-11-28/image/53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590494?view=catalogue)
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Found listing with ID: 117563927
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563927%27 HTTP/1.1" 200 None
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Scrape type for 117563927: 2
2025-12-02 19:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117442253?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b500d0>
2025-12-02 19:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252Fdf2760f0-ca5f-4451-a91a-0817448f0694_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/df2760f0-ca5f-4451-a91a-0817448f0694_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89f3219e-41c9-557e-aed5-2984165bb017
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117661968, 'registration': 'GM65BVX', 'account': 'STA058', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI GT 5dr', 'mileage': 112905, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-17', 'fuel': 'Diesel', 'motExpiry': '2026-06-19', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GM65BVX/2025-12-02/image/cd7e6b39-1436-4d14-a20f-29bd5666ca0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/84c11af9-530c-4970-a4b9-507f775bf5e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ec7ed3dc-a999-40ad-8d8b-5c74bc3417ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/103b275e-a87c-4aae-a050-91637e3c348a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/4e0fcaec-32b0-4d3c-abb5-be14cba9ffeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/b8e2d73d-3a2f-47a1-8176-3303014b8e71_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/f7514041-554a-43b2-aac3-f72638920473_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ad6ce49f-bfff-496f-9bc0-32dc10baa960_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/16-10K 09/17-20K 04/18-30K 11/18-39K 02/19-48K 04/20-59K 12/20-70K  02/22-80K', 'remarks': 'VOSA STATES 39K 54K 70K 80K 90K 102K 111K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ae62cd1a-bd2e-4a42-be98-2723e482292f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117661968, 'registration': 'GM65BVX', 'account': 'STA058', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI GT 5dr', 'mileage': 112905, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-17', 'fuel': 'Diesel', 'motExpiry': '2026-06-19', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GM65BVX/2025-12-02/image/cd7e6b39-1436-4d14-a20f-29bd5666ca0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/84c11af9-530c-4970-a4b9-507f775bf5e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ec7ed3dc-a999-40ad-8d8b-5c74bc3417ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/103b275e-a87c-4aae-a050-91637e3c348a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/4e0fcaec-32b0-4d3c-abb5-be14cba9ffeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/b8e2d73d-3a2f-47a1-8176-3303014b8e71_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/f7514041-554a-43b2-aac3-f72638920473_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ad6ce49f-bfff-496f-9bc0-32dc10baa960_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/16-10K 09/17-20K 04/18-30K 11/18-39K 02/19-48K 04/20-59K 12/20-70K  02/22-80K', 'remarks': 'VOSA STATES 39K 54K 70K 80K 90K 102K 111K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ae62cd1a-bd2e-4a42-be98-2723e482292f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 026a1174-467b-570a-9674-dfc3a4d6842a with identifier: 117661968
2025-12-02 19:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 026a1174-467b-570a-9674-dfc3a4d6842a with scrape type 1
2025-12-02 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 026a1174-467b-570a-9674-dfc3a4d6842a
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252Fcd7e6b39-1436-4d14-a20f-29bd5666ca0f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/cd7e6b39-1436-4d14-a20f-29bd5666ca0f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117600062, 'registration': 'LJ19SJM', 'account': 'WIL004', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi ISG GT-Line 5dr DCT Auto [AWD]', 'mileage': 59630, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-07-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-07', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117600062, 'registration': 'LJ19SJM', 'account': 'WIL004', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi ISG GT-Line 5dr DCT Auto [AWD]', 'mileage': 59630, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-07-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-07', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7186e83e-0b4c-5d64-8264-eacc3c753a8e with identifier: 117600062
2025-12-02 19:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7186e83e-0b4c-5d64-8264-eacc3c753a8e with scrape type 1
2025-12-02 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7186e83e-0b4c-5d64-8264-eacc3c753a8e
2025-12-02 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7186e83e-0b4c-5d64-8264-eacc3c753a8e
2025-12-02 19:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7186e83e-0b4c-5d64-8264-eacc3c753a8e, identifier: 117600062
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117638370, 'registration': 'WM65NFL', 'account': 'WBA003', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium 5dr Powershift', 'mileage': 111808, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-01-29', 'fuel': 'Diesel', 'motExpiry': '2026-01-28', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WM65NFL/2025-12-01/image/b29ba2d9-5cb9-46fd-9600-0f8005abb06d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/e0a74c21-41e5-4ee6-9d3a-c19a287d16bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/99baec5d-3d0f-4887-b275-75305120f659_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/82bdc247-4e48-4f4f-b881-d2d364700ca5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/90174c2c-176e-4233-9083-b49fc86221ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/49e2ba5e-3361-4707-91a2-fd86aba16894_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/cb1377ee-50e8-4c26-b3df-c625d437a5c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/4cd35509-48c9-402a-add6-77196dc6cfe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/faba0797-2bf4-434a-9bcc-9cb6ac36d761_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/29f2f161-cc7f-494e-be66-5c5f7a1fdc3f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/20-50k,  03/23-70k,  02/24-79k,', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES 98k 79k 69k 60k', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ae92260-fd20-45d0-9790-89c03a89d22c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117638370, 'registration': 'WM65NFL', 'account': 'WBA003', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium 5dr Powershift', 'mileage': 111808, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-01-29', 'fuel': 'Diesel', 'motExpiry': '2026-01-28', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WM65NFL/2025-12-01/image/b29ba2d9-5cb9-46fd-9600-0f8005abb06d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/e0a74c21-41e5-4ee6-9d3a-c19a287d16bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/99baec5d-3d0f-4887-b275-75305120f659_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/82bdc247-4e48-4f4f-b881-d2d364700ca5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/90174c2c-176e-4233-9083-b49fc86221ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/49e2ba5e-3361-4707-91a2-fd86aba16894_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/cb1377ee-50e8-4c26-b3df-c625d437a5c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/4cd35509-48c9-402a-add6-77196dc6cfe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/faba0797-2bf4-434a-9bcc-9cb6ac36d761_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/29f2f161-cc7f-494e-be66-5c5f7a1fdc3f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/20-50k,  03/23-70k,  02/24-79k,', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES 98k 79k 69k 60k', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ae92260-fd20-45d0-9790-89c03a89d22c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8860decc-d092-5183-b3ca-b40ba3560e46 with identifier: 117638370
2025-12-02 19:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8860decc-d092-5183-b3ca-b40ba3560e46 with scrape type 2
2025-12-02 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8860decc-d092-5183-b3ca-b40ba3560e46 with scrape type 2
2025-12-02 19:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8860decc-d092-5183-b3ca-b40ba3560e46, identifier: 117638370
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117099385, 'registration': 'NMN170X', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 Sport 5dr', 'mileage': 24960, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-11-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NMN170X/2025-11-11/image/cc4aa83c-ec05-4c40-b921-5acf5a4d607e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/d25140bf-37eb-452a-8d00-218d72db8d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/1d5bc75a-2ae4-42c1-aa24-990f771ada9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/024c4b16-7aa6-4e47-8df8-be8725f063f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/ac81bfcd-8c79-4074-bf0b-4c6326c92761_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/45ced919-696c-4e83-88ba-f21bb72ca49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/ba0ea8d0-8420-479f-9ce9-c7383af8f69c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/b4dd87c0-4f27-4d5f-830d-54edde2109fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/59610efb-1fa3-4ff1-a171-2348499bc6e1_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/21- 5k, 02/22- 9k, 04/23- 13k, 07/24- 18k', 'remarks': 'spare key IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present,', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0ca0638b-47ba-400c-aa65-4128d944098e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117099385, 'registration': 'NMN170X', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 Sport 5dr', 'mileage': 24960, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-11-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NMN170X/2025-11-11/image/cc4aa83c-ec05-4c40-b921-5acf5a4d607e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/d25140bf-37eb-452a-8d00-218d72db8d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/1d5bc75a-2ae4-42c1-aa24-990f771ada9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/024c4b16-7aa6-4e47-8df8-be8725f063f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/ac81bfcd-8c79-4074-bf0b-4c6326c92761_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/45ced919-696c-4e83-88ba-f21bb72ca49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/ba0ea8d0-8420-479f-9ce9-c7383af8f69c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/b4dd87c0-4f27-4d5f-830d-54edde2109fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/59610efb-1fa3-4ff1-a171-2348499bc6e1_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/21- 5k, 02/22- 9k, 04/23- 13k, 07/24- 18k', 'remarks': 'spare key IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present,', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0ca0638b-47ba-400c-aa65-4128d944098e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: affd00f4-2832-5372-b512-dce5abdf7275 with identifier: 117099385
2025-12-02 19:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item affd00f4-2832-5372-b512-dce5abdf7275 with scrape type 2
2025-12-02 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item affd00f4-2832-5372-b512-dce5abdf7275 with scrape type 2
2025-12-02 19:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: affd00f4-2832-5372-b512-dce5abdf7275, identifier: 117099385
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Found listing with ID: 117672666
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672666%27 HTTP/1.1" 200 None
2025-12-02 19:06:22 [astonbarclay.gb] INFO: Scrape type for 117672666: 1
2025-12-02 19:06:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117598232?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7186e83e-0b4c-5d64-8264-eacc3c753a8e with identifier: 117600062
2025-12-02 19:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7186e83e-0b4c-5d64-8264-eacc3c753a8e with identifier: 117600062
2025-12-02 19:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7186e83e-0b4c-5d64-8264-eacc3c753a8e with identifier: 117600062 to the API
2025-12-02 19:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277186e83e-0b4c-5d64-8264-eacc3c753a8e%27 HTTP/1.1" 200 None
2025-12-02 19:06:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7186e83e-0b4c-5d64-8264-eacc3c753a8e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117600062?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '7186e83e-0b4c-5d64-8264-eacc3c753a8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LJ19SJM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600062',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 59630,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-27',
 'seller_name': 'Wilsons',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi ISG GT-Line 5dr DCT Auto [AWD]',
 'transmission': 'automatic',
 'trim': '1.6T GDi ISG GT-Line 5dr DCT Auto [AWD]',
 'vin': None,
 'year': 2019}
2025-12-02 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600062%27 HTTP/1.1" 200 None
2025-12-02 19:06:23 [astonbarclay.gb] INFO: Saving data for 117600062: {'created_time': 1764702383.69214, 'last_price_update_time': 1764702383.692151, 'auction_closing_time': 1765274400.0}
2025-12-02 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117600062') HTTP/1.1" 204 0
2025-12-02 19:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8860decc-d092-5183-b3ca-b40ba3560e46 with identifier: 117638370
2025-12-02 19:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8860decc-d092-5183-b3ca-b40ba3560e46 with identifier: 117638370
2025-12-02 19:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 179937 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179937
2025-12-02 19:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8860decc-d092-5183-b3ca-b40ba3560e46 spider: astonbarclay.gb
2025-12-02 19:06:23 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8860decc-d092-5183-b3ca-b40ba3560e46 due to rule: high_mileage_for_country.json, error: 179937 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179937
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '8860decc-d092-5183-b3ca-b40ba3560e46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WM65NFL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638370',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'S-MAX DIESEL ESTATE',
 'odometer': 111808,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-29',
 'seller_name': 'UKCGR - Select',
 'title': 'FORD S-MAX DIESEL ESTATE 2.0 TDCi 180 Titanium 5dr Powershift',
 'transmission': 'automatic',
 'trim': '2.0 TDCi 180 Titanium 5dr Powershift',
 'vin': None,
 'year': 2016}
2025-12-02 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638370%27 HTTP/1.1" 200 None
2025-12-02 19:06:23 [astonbarclay.gb] INFO: Saving data for 117638370: {'created_time': 1764615776.882185, 'last_price_update_time': 1764702383.898863, 'auction_closing_time': 1765215000.0}
2025-12-02 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117638370') HTTP/1.1" 204 0
2025-12-02 19:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: affd00f4-2832-5372-b512-dce5abdf7275 with identifier: 117099385
2025-12-02 19:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: affd00f4-2832-5372-b512-dce5abdf7275 with identifier: 117099385
2025-12-02 19:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'

Failed validating 'type' in schema['properties']['color']:
    {'minLength': 1, 'type': 'string'}

On instance['color']:
    None
2025-12-02 19:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: affd00f4-2832-5372-b512-dce5abdf7275 spider: astonbarclay.gb
2025-12-02 19:06:24 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: affd00f4-2832-5372-b512-dce5abdf7275 due to rule: missing_color.json, error: None is not of type 'string'

Failed validating 'type' in schema['properties']['color']:
    {'minLength': 1, 'type': 'string'}

On instance['color']:
    None
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': None,
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': None,
 'engine': '',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'affd00f4-2832-5372-b512-dce5abdf7275',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NMN170X',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099385',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 24960,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-12',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A180 Sport 5dr',
 'transmission': 'manual',
 'trim': 'A180 Sport 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099385%27 HTTP/1.1" 200 None
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Saving data for 117099385: {'auction_closing_time': 1765275300.0, 'created_time': 1764615714.768508, 'last_price_update_time': 1764702384.122292}
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117099385') HTTP/1.1" 204 0
2025-12-02 19:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/dc90d459-73a8-4afe-bd2c-bfc65f5081a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117410407?view=catalogue)
2025-12-02 19:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO70YEC/2025-11-27/image/db31c692-139c-4873-ade5-932ac328f731_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116859206?view=catalogue)
2025-12-02 19:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252F84c11af9-530c-4970-a4b9-507f775bf5e0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/84c11af9-530c-4970-a4b9-507f775bf5e0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Found listing with ID: 117491120
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491120%27 HTTP/1.1" 200 None
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Scrape type for 117491120: 0
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Found listing with ID: 117361961
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117361961%27 HTTP/1.1" 200 None
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Scrape type for 117361961: 1
2025-12-02 19:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117179358?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252Fec7ed3dc-a999-40ad-8d8b-5c74bc3417ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ec7ed3dc-a999-40ad-8d8b-5c74bc3417ad_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Found listing with ID: 116997754
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997754%27 HTTP/1.1" 200 None
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Scrape type for 116997754: 2
2025-12-02 19:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09ce0d0>
2025-12-02 19:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be9d4895-6ef7-5e03-84b2-90915f3aff98
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117442253, 'registration': 'RV72YYL', 'account': 'DAY005', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 26266, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-09', 'fuel': 'Diesel', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV72YYL/2025-12-02/image/4ee948aa-1b5e-4df6-8580-4ccda2a05b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/e69ee2ab-e809-4652-85ed-4d8bb57a78a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/8db2b512-cbb2-43d8-a80d-65d131608bae_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/a837281d-25c6-4390-bf16-33c14156bcba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/9d0cea0c-2bea-404d-8541-50e672a321b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/3acfbec4-aaca-4f5b-9440-f95475cd3ce5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/c610b5bc-c55f-4a22-9904-f33343f11d91_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/b0ffecf9-c4b0-4b82-bfe9-0c4dec40b7fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/177d05a5-ef5a-426f-8d38-38d1155f938c_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 24K,', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/afe73f44-df6f-41f8-b617-f0f6ccb2d31c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117442253, 'registration': 'RV72YYL', 'account': 'DAY005', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 26266, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-09', 'fuel': 'Diesel', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV72YYL/2025-12-02/image/4ee948aa-1b5e-4df6-8580-4ccda2a05b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/e69ee2ab-e809-4652-85ed-4d8bb57a78a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/8db2b512-cbb2-43d8-a80d-65d131608bae_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/a837281d-25c6-4390-bf16-33c14156bcba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/9d0cea0c-2bea-404d-8541-50e672a321b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/3acfbec4-aaca-4f5b-9440-f95475cd3ce5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/c610b5bc-c55f-4a22-9904-f33343f11d91_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/b0ffecf9-c4b0-4b82-bfe9-0c4dec40b7fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYL/2025-12-02/image/177d05a5-ef5a-426f-8d38-38d1155f938c_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 24K,', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/afe73f44-df6f-41f8-b617-f0f6ccb2d31c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ce7ea9-061c-5609-b3b6-0e974d7e3938 with identifier: 117442253
2025-12-02 19:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ce7ea9-061c-5609-b3b6-0e974d7e3938 with scrape type 2
2025-12-02 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ce7ea9-061c-5609-b3b6-0e974d7e3938 with scrape type 2
2025-12-02 19:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 20ce7ea9-061c-5609-b3b6-0e974d7e3938, identifier: 117442253
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117598232, 'registration': 'YB68VNU', 'account': 'MAN037', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav/Servotronic]', 'mileage': 103756, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-11-01', 'fuel': 'Petrol', 'motExpiry': '2026-12-04', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB68VNU/2025-11-28/image/7e734e0e-2c18-481e-98b7-7d5ff01f4d77_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/c3d5de69-21c7-4e37-a2a2-b270f1ccc613_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/3a7077b1-7279-4489-812a-a18d400e8414_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/8ff03f81-f0fa-44b5-b815-3dc006b44509_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/07d69115-19df-4560-b5e4-63e5a29298dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/3a5a652b-4804-46ef-a083-7f8bdb011194_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/8b0d7051-caf3-4ec6-9f90-22d0f13bbfa6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/4e723cd7-b65f-4818-ba1b-e36331563300_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/4321b3bf-1cf4-4281-887e-3f63aca91970_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 09/20 18K - 07/22 47K', 'remarks': 'NO V5 HPI SHOWING 1 FORMER KEEPER - VOSA STATES 49K 66K- 87K - 103K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/351a350c-a0a2-4881-a01f-0f684503025d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117598232, 'registration': 'YB68VNU', 'account': 'MAN037', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav/Servotronic]', 'mileage': 103756, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-11-01', 'fuel': 'Petrol', 'motExpiry': '2026-12-04', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB68VNU/2025-11-28/image/7e734e0e-2c18-481e-98b7-7d5ff01f4d77_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/c3d5de69-21c7-4e37-a2a2-b270f1ccc613_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/3a7077b1-7279-4489-812a-a18d400e8414_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/8ff03f81-f0fa-44b5-b815-3dc006b44509_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/07d69115-19df-4560-b5e4-63e5a29298dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/3a5a652b-4804-46ef-a083-7f8bdb011194_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/8b0d7051-caf3-4ec6-9f90-22d0f13bbfa6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/4e723cd7-b65f-4818-ba1b-e36331563300_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68VNU/2025-11-28/image/4321b3bf-1cf4-4281-887e-3f63aca91970_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 09/20 18K - 07/22 47K', 'remarks': 'NO V5 HPI SHOWING 1 FORMER KEEPER - VOSA STATES 49K 66K- 87K - 103K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/351a350c-a0a2-4881-a01f-0f684503025d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0de0806a-b822-53d1-ad1b-842e7e3b547b with identifier: 117598232
2025-12-02 19:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0de0806a-b822-53d1-ad1b-842e7e3b547b with scrape type 2
2025-12-02 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0de0806a-b822-53d1-ad1b-842e7e3b547b with scrape type 2
2025-12-02 19:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0de0806a-b822-53d1-ad1b-842e7e3b547b, identifier: 117598232
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252F103b275e-a87c-4aae-a050-91637e3c348a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/103b275e-a87c-4aae-a050-91637e3c348a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 20ce7ea9-061c-5609-b3b6-0e974d7e3938 with identifier: 117442253
2025-12-02 19:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 20ce7ea9-061c-5609-b3b6-0e974d7e3938 with identifier: 117442253
2025-12-02 19:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 20ce7ea9-061c-5609-b3b6-0e974d7e3938 with identifier: 117442253 to the API
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2720ce7ea9-061c-5609-b3b6-0e974d7e3938%27 HTTP/1.1" 200 None
2025-12-02 19:06:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 20ce7ea9-061c-5609-b3b6-0e974d7e3938: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117442253?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '20ce7ea9-061c-5609-b3b6-0e974d7e3938',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RV72YYL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117442253',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 26266,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-09',
 'seller_name': 'Days Fleet',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442253%27 HTTP/1.1" 200 None
2025-12-02 19:06:24 [astonbarclay.gb] INFO: Saving data for 117442253: {'auction_closing_time': 1764927900.0, 'created_time': 1764615693.772266, 'last_price_update_time': 1764702384.897874}
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117442253') HTTP/1.1" 204 0
2025-12-02 19:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0de0806a-b822-53d1-ad1b-842e7e3b547b with identifier: 117598232
2025-12-02 19:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0de0806a-b822-53d1-ad1b-842e7e3b547b with identifier: 117598232
2025-12-02 19:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166978 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166978
2025-12-02 19:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0de0806a-b822-53d1-ad1b-842e7e3b547b spider: astonbarclay.gb
2025-12-02 19:06:25 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0de0806a-b822-53d1-ad1b-842e7e3b547b due to rule: high_mileage_for_country.json, error: 166978 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166978
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '0de0806a-b822-53d1-ad1b-842e7e3b547b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YB68VNU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117598232',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 103756,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-01',
 'seller_name': 'Manamanx Ltd',
 'title': 'BMW 1 SERIES HATCHBACK 118i [1.5] Sport 5dr [Nav/Servotronic]',
 'transmission': 'manual',
 'trim': '118i [1.5] Sport 5dr [Nav/Servotronic]',
 'vin': None,
 'year': 2018}
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598232%27 HTTP/1.1" 200 None
2025-12-02 19:06:25 [astonbarclay.gb] INFO: Saving data for 117598232: {'auction_closing_time': 1765215000.0, 'created_time': 1764356796.883265, 'last_price_update_time': 1764702385.201157}
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117598232') HTTP/1.1" 204 0
2025-12-02 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GM65BVX/2025-12-02/image/cd7e6b39-1436-4d14-a20f-29bd5666ca0f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661968?view=catalogue)
2025-12-02 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT70SXH/2025-12-02/image/ce6be574-abe7-4865-956c-fb968740663b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117029988?view=catalogue)
2025-12-02 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/b77f7ba9-a36f-43e2-8d1e-738fc7bcb25d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:06:25 [astonbarclay.gb] INFO: Found listing with ID: 117603564
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117603564%27 HTTP/1.1" 200 None
2025-12-02 19:06:25 [astonbarclay.gb] INFO: Scrape type for 117603564: 2
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252F4e0fcaec-32b0-4d3c-abb5-be14cba9ffeb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/4e0fcaec-32b0-4d3c-abb5-be14cba9ffeb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117345378?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117638131?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117664913?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117509758?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08708d0>
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252Fdc90d459-73a8-4afe-bd2c-bfc65f5081a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/dc90d459-73a8-4afe-bd2c-bfc65f5081a9_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf046a0d0>
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252Fdb31c692-139c-4873-ade5-932ac328f731_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/db31c692-139c-4873-ade5-932ac328f731_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c05dfe48-04df-50d0-bcd0-70853b464265
2025-12-02 19:06:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117179358, 'registration': 'SA68GAX', 'account': 'MAN027', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL GRAND SPORT', 'derivative': '2.0 Turbo D Elite Nav 5dr Auto', 'mileage': 96954, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-13', 'fuel': 'Diesel', 'motExpiry': '2026-04-16', 'doors': 5, 'engineSize': 1956, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SA68GAX/2025-11-13/image/f0916d7d-84ed-467a-9445-b5feb0d30ae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/4c6b1ca6-8f02-4afc-8ad7-38a9d0735c5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/dcab9941-97c1-4809-8adf-57fcdc208605_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/83703abb-569f-4515-8034-c8803628b511_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/cb366431-40f3-4f41-a187-f785d25663ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/e5e1edac-3c6d-4b08-b029-4086dd097df7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/15d22927-801b-479c-baf6-c3a5f5a90fa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/34d752fb-33fa-43ad-bd20-814b28b6dc53_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/8edbfc1c-d745-4e61-a7bd-1602ec81c2b8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1688** VOSA STATES 32K, 47K, 53K, 69K, 87K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4bb4d0aa-41c9-41c8-bb84-9759f0395dbd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117179358, 'registration': 'SA68GAX', 'account': 'MAN027', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL GRAND SPORT', 'derivative': '2.0 Turbo D Elite Nav 5dr Auto', 'mileage': 96954, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-13', 'fuel': 'Diesel', 'motExpiry': '2026-04-16', 'doors': 5, 'engineSize': 1956, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SA68GAX/2025-11-13/image/f0916d7d-84ed-467a-9445-b5feb0d30ae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/4c6b1ca6-8f02-4afc-8ad7-38a9d0735c5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/dcab9941-97c1-4809-8adf-57fcdc208605_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/83703abb-569f-4515-8034-c8803628b511_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/cb366431-40f3-4f41-a187-f785d25663ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/e5e1edac-3c6d-4b08-b029-4086dd097df7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/15d22927-801b-479c-baf6-c3a5f5a90fa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/34d752fb-33fa-43ad-bd20-814b28b6dc53_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA68GAX/2025-11-13/image/8edbfc1c-d745-4e61-a7bd-1602ec81c2b8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1688** VOSA STATES 32K, 47K, 53K, 69K, 87K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4bb4d0aa-41c9-41c8-bb84-9759f0395dbd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3a3e6d7-f01b-5c87-8a7c-a20b2d42ee2a with identifier: 117179358
2025-12-02 19:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3a3e6d7-f01b-5c87-8a7c-a20b2d42ee2a with scrape type 2
2025-12-02 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3a3e6d7-f01b-5c87-8a7c-a20b2d42ee2a with scrape type 2
2025-12-02 19:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c3a3e6d7-f01b-5c87-8a7c-a20b2d42ee2a, identifier: 117179358
2025-12-02 19:06:25 [astonbarclay.gb] INFO: Found listing with ID: 117471399
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117471399%27 HTTP/1.1" 200 None
2025-12-02 19:06:25 [astonbarclay.gb] INFO: Scrape type for 117471399: 0
2025-12-02 19:06:25 [astonbarclay.gb] INFO: Found listing with ID: 117587813
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117587813%27 HTTP/1.1" 200 None
2025-12-02 19:06:25 [astonbarclay.gb] INFO: Scrape type for 117587813: 2
2025-12-02 19:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c3a3e6d7-f01b-5c87-8a7c-a20b2d42ee2a with identifier: 117179358
2025-12-02 19:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c3a3e6d7-f01b-5c87-8a7c-a20b2d42ee2a with identifier: 117179358
2025-12-02 19:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156031 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156031
2025-12-02 19:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c3a3e6d7-f01b-5c87-8a7c-a20b2d42ee2a spider: astonbarclay.gb
2025-12-02 19:06:26 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c3a3e6d7-f01b-5c87-8a7c-a20b2d42ee2a due to rule: high_mileage_for_country.json, error: 156031 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156031
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'c3a3e6d7-f01b-5c87-8a7c-a20b2d42ee2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SA68GAX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117179358',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA DIESEL GRAND SPORT',
 'odometer': 96954,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-13',
 'seller_name': 'Mann Island Finance',
 'title': 'VAUXHALL INSIGNIA DIESEL GRAND SPORT 2.0 Turbo D Elite Nav 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 Turbo D Elite Nav 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117179358%27 HTTP/1.1" 200 None
2025-12-02 19:06:26 [astonbarclay.gb] INFO: Saving data for 117179358: {'auction_closing_time': 1764927900.0, 'created_time': 1764234083.804868, 'last_price_update_time': 1764702386.176413}
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117179358') HTTP/1.1" 204 0
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252Fb8e2d73d-3a2f-47a1-8176-3303014b8e71_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/b8e2d73d-3a2f-47a1-8176-3303014b8e71_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02e7810>
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252Fcd7e6b39-1436-4d14-a20f-29bd5666ca0f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/cd7e6b39-1436-4d14-a20f-29bd5666ca0f_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 026a1174-467b-570a-9674-dfc3a4d6842a
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf051dbd0>
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT70SXH%252F2025-12-02%252Fimage%252Fce6be574-abe7-4865-956c-fb968740663b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT70SXH/2025-12-02/image/ce6be574-abe7-4865-956c-fb968740663b_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0df80b6a-6c89-5fb4-8531-6651333b469d
2025-12-02 19:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0df80b6a-6c89-5fb4-8531-6651333b469d, skipping ID generation
2025-12-02 19:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0df80b6a-6c89-5fb4-8531-6651333b469d with scrape type 1
2025-12-02 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0df80b6a-6c89-5fb4-8531-6651333b469d from tracking dictionaries
2025-12-02 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0df80b6a-6c89-5fb4-8531-6651333b469d sending to next pipeline
2025-12-02 19:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0df80b6a-6c89-5fb4-8531-6651333b469d, identifier: 117029988
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf051e650>
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252Fb77f7ba9-a36f-43e2-8d1e-738fc7bcb25d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/b77f7ba9-a36f-43e2-8d1e-738fc7bcb25d_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:06:26 [astonbarclay.gb] INFO: Found listing with ID: 117610912
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610912%27 HTTP/1.1" 200 None
2025-12-02 19:06:26 [astonbarclay.gb] INFO: Scrape type for 117610912: 2
2025-12-02 19:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0df80b6a-6c89-5fb4-8531-6651333b469d with identifier: 117029988
2025-12-02 19:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0df80b6a-6c89-5fb4-8531-6651333b469d with identifier: 117029988
2025-12-02 19:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0df80b6a-6c89-5fb4-8531-6651333b469d with identifier: 117029988 to the API
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BT70SXH/2025-12-02/image/ce6be574-abe7-4865-956c-fb968740663b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '0df80b6a-6c89-5fb4-8531-6651333b469d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BT70SXH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117029988',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 50677,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23472,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/38023e97-8d65-47a8-8cbe-7f29a7d71287_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25405,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/ce6be574-abe7-4865-956c-fb968740663b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23775,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/4070dd86-218e-40f0-b558-af7f716f3cfa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25396,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/74e4b84f-d268-4f78-9e2c-06f50c8747bb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45280,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/a0bdd61a-2454-44f0-8657-d8c4db753874_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52741,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/9c6e4765-7f21-4593-92b9-78a0bd612e5d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49672,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/5ef265e1-a0ed-4775-a404-09cb28a8597b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51047,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/1a06f0a2-c655-4eba-a158-18a3d0e962ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df80b6a-6c89-5fb4-8531-6651333b469d/0df80b6a-6c89-5fb4-8531-6651333b469d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49632,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT70SXH/2025-12-02/image/c715e370-046f-4a1e-8be0-ed42422fab81_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117029988%27 HTTP/1.1" 200 None
2025-12-02 19:06:27 [astonbarclay.gb] INFO: Saving data for 117029988: {'created_time': 1764702387.276951, 'last_price_update_time': 1764702387.276961, 'auction_closing_time': 1764927900.0}
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117029988') HTTP/1.1" 204 0
2025-12-02 19:06:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117345378, 'registration': 'MW24CHK', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Trophy 5dr', 'mileage': 3485, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2024-04-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MW24CHK/2025-11-28/image/7799dae4-0ee1-4d28-98b2-1eb28afe1103_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/642c8740-0c39-4d7b-9241-b0935f4e4c14_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/0fdfad2d-4395-416f-b7af-a27782d5d35e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/75670e0f-3715-43bb-9bdc-fced98a7f7ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/bc5994af-9a91-4790-8355-f0584ea802ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/c2b44896-0431-4b4d-9a76-c50db6bd30fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/146eaecd-0672-4496-abe8-c1a11248e0ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/55908de5-6573-4466-b435-49c7979dc924_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/d36a376c-845e-4b6c-9831-6f86bcbc9309_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/2ccf01af-31cc-46fe-9d41-694c09822b1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/70d0f4c2-f045-44de-af57-20299f4a1033_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/ef06486a-5083-4117-a715-94d643f48e3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/b254db76-ba5a-4fd4-96a3-67dd378b8d8a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/25- 2k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/867a46f1-8cc1-4ed7-bc39-471a5a73b1d1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117345378, 'registration': 'MW24CHK', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Trophy 5dr', 'mileage': 3485, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2024-04-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MW24CHK/2025-11-28/image/7799dae4-0ee1-4d28-98b2-1eb28afe1103_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/642c8740-0c39-4d7b-9241-b0935f4e4c14_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/0fdfad2d-4395-416f-b7af-a27782d5d35e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/75670e0f-3715-43bb-9bdc-fced98a7f7ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/bc5994af-9a91-4790-8355-f0584ea802ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/c2b44896-0431-4b4d-9a76-c50db6bd30fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/146eaecd-0672-4496-abe8-c1a11248e0ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/55908de5-6573-4466-b435-49c7979dc924_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/d36a376c-845e-4b6c-9831-6f86bcbc9309_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/2ccf01af-31cc-46fe-9d41-694c09822b1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/70d0f4c2-f045-44de-af57-20299f4a1033_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/ef06486a-5083-4117-a715-94d643f48e3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW24CHK/2025-11-28/image/b254db76-ba5a-4fd4-96a3-67dd378b8d8a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/25- 2k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/867a46f1-8cc1-4ed7-bc39-471a5a73b1d1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 516ae46a-479e-5a05-b750-cf741220c704 with identifier: 117345378
2025-12-02 19:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 516ae46a-479e-5a05-b750-cf741220c704 with scrape type 2
2025-12-02 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 516ae46a-479e-5a05-b750-cf741220c704 with scrape type 2
2025-12-02 19:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 516ae46a-479e-5a05-b750-cf741220c704, identifier: 117345378
2025-12-02 19:06:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117638131, 'registration': 'MD74ZCX', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'SCENIC E-TECH ELECTRIC ESTATE', 'derivative': '160kW Esprit Alpine 87kWh Long Range 5dr Auto', 'mileage': 15869, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-12-23', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/95dac279-d7d1-4f7b-b38a-8196e37f74b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/54dbb979-865d-4882-8a06-e6c0e475a443_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/8a590afe-31e6-4b0e-aee3-9d6f2384e8a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/de1d71c6-68b4-4e12-8817-50d71c329ca0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/bbb71ae6-47de-4484-af0c-de34bc0a8810_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/d104b527-733b-449e-acf1-5c911b9a5449_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/fe79d3d2-9672-4151-b12c-cf3f0df51f99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/d2a92560-c1a2-4967-8620-afd5e0926191_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/03b39d61-0648-4b5e-bb11-f4db883f34ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/316e4d12-c6e9-45be-b00f-6fa488b39359_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/59302949-16d1-4f56-9726-5df63b29939c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/c9c9c48d-10b9-468d-b0fe-f08b17786c08_removebg.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e8412181-cf2b-433f-b98f-8443c2d510bd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117638131, 'registration': 'MD74ZCX', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'SCENIC E-TECH ELECTRIC ESTATE', 'derivative': '160kW Esprit Alpine 87kWh Long Range 5dr Auto', 'mileage': 15869, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-12-23', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/95dac279-d7d1-4f7b-b38a-8196e37f74b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/54dbb979-865d-4882-8a06-e6c0e475a443_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/8a590afe-31e6-4b0e-aee3-9d6f2384e8a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/de1d71c6-68b4-4e12-8817-50d71c329ca0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/bbb71ae6-47de-4484-af0c-de34bc0a8810_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/d104b527-733b-449e-acf1-5c911b9a5449_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/fe79d3d2-9672-4151-b12c-cf3f0df51f99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/d2a92560-c1a2-4967-8620-afd5e0926191_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/03b39d61-0648-4b5e-bb11-f4db883f34ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/316e4d12-c6e9-45be-b00f-6fa488b39359_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/59302949-16d1-4f56-9726-5df63b29939c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD74ZCX/2025-12-02/image/c9c9c48d-10b9-468d-b0fe-f08b17786c08_removebg.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e8412181-cf2b-433f-b98f-8443c2d510bd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd with identifier: 117638131
2025-12-02 19:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd with scrape type 2
2025-12-02 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd with scrape type 2
2025-12-02 19:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd, identifier: 117638131
2025-12-02 19:06:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117664913, 'registration': 'SV21ZPT', 'account': 'MOT070', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '35 TFSI Sport 5dr', 'mileage': 58100, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 05/23-13k 07/24-25k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117664913, 'registration': 'SV21ZPT', 'account': 'MOT070', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '35 TFSI Sport 5dr', 'mileage': 58100, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 05/23-13k 07/24-25k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9ccf9f-021d-50a8-b43f-36c439d0551e with identifier: 117664913
2025-12-02 19:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a9ccf9f-021d-50a8-b43f-36c439d0551e with scrape type 1
2025-12-02 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 9a9ccf9f-021d-50a8-b43f-36c439d0551e
2025-12-02 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 9a9ccf9f-021d-50a8-b43f-36c439d0551e
2025-12-02 19:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9a9ccf9f-021d-50a8-b43f-36c439d0551e, identifier: 117664913
2025-12-02 19:06:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117509758, 'registration': 'SK70RMY', 'account': 'ZEN002', 'make': 'TOYOTA', 'model': 'PRIUS+ ESTATE', 'derivative': '1.8 VVTi Icon TSS 5dr CVT Auto', 'mileage': 14342, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-10-16', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-11-16', 'doors': 5, 'engineSize': 1797, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SK70RMY/2025-12-02/image/3ea191d4-648a-47c1-a48d-8dfc98512c74_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/79d47c9d-22fc-45dc-89b2-feddc7cff6ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cac6b749-177a-4dde-9b96-db3642025459_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cd5b9f1f-02a9-48ae-abf5-4665540117f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/955549cb-7f07-4edc-b6ab-f977374bed18_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/f9bbc807-2329-4bb5-993f-15c530fd5624_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/52ad17cd-0630-4e7c-a3e1-f510b84a1eb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/eb65c259-2375-4c08-87e2-299a2ea1e42d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/9151f589-da48-4417-bcf2-faef49c25ebd_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/21 - 1K, 12/23 - 8K, 04/25 - 13K', 'remarks': '**725** VOSA STATES 8K, 12K, 14K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/96329bf1-0445-46c0-88d6-3f2957df2a30.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:06:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117509758, 'registration': 'SK70RMY', 'account': 'ZEN002', 'make': 'TOYOTA', 'model': 'PRIUS+ ESTATE', 'derivative': '1.8 VVTi Icon TSS 5dr CVT Auto', 'mileage': 14342, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-10-16', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-11-16', 'doors': 5, 'engineSize': 1797, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SK70RMY/2025-12-02/image/3ea191d4-648a-47c1-a48d-8dfc98512c74_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/79d47c9d-22fc-45dc-89b2-feddc7cff6ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cac6b749-177a-4dde-9b96-db3642025459_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cd5b9f1f-02a9-48ae-abf5-4665540117f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/955549cb-7f07-4edc-b6ab-f977374bed18_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/f9bbc807-2329-4bb5-993f-15c530fd5624_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/52ad17cd-0630-4e7c-a3e1-f510b84a1eb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/eb65c259-2375-4c08-87e2-299a2ea1e42d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/9151f589-da48-4417-bcf2-faef49c25ebd_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/21 - 1K, 12/23 - 8K, 04/25 - 13K', 'remarks': '**725** VOSA STATES 8K, 12K, 14K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/96329bf1-0445-46c0-88d6-3f2957df2a30.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24cd7134-4180-54ac-9e26-d55d082add85 with identifier: 117509758
2025-12-02 19:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24cd7134-4180-54ac-9e26-d55d082add85 with scrape type 1
2025-12-02 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 24cd7134-4180-54ac-9e26-d55d082add85
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252F3ea191d4-648a-47c1-a48d-8dfc98512c74_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/3ea191d4-648a-47c1-a48d-8dfc98512c74_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GM65BVX/2025-12-02/image/103b275e-a87c-4aae-a050-91637e3c348a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661968?view=catalogue)
2025-12-02 19:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ec7ed3dc-a999-40ad-8d8b-5c74bc3417ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661968?view=catalogue)
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252Ff7514041-554a-43b2-aac3-f72638920473_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/f7514041-554a-43b2-aac3-f72638920473_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 516ae46a-479e-5a05-b750-cf741220c704 with identifier: 117345378
2025-12-02 19:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 516ae46a-479e-5a05-b750-cf741220c704 with identifier: 117345378
2025-12-02 19:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 516ae46a-479e-5a05-b750-cf741220c704 with identifier: 117345378 to the API
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27516ae46a-479e-5a05-b750-cf741220c704%27 HTTP/1.1" 200 None
2025-12-02 19:06:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 516ae46a-479e-5a05-b750-cf741220c704: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:27 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117345378?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '516ae46a-479e-5a05-b750-cf741220c704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MW24CHK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117345378',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 3485,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-12',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Trophy 5dr',
 'transmission': 'manual',
 'trim': '1.5 T-GDI Trophy 5dr',
 'vin': None,
 'year': 2024}
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117345378%27 HTTP/1.1" 200 None
2025-12-02 19:06:27 [astonbarclay.gb] INFO: Saving data for 117345378: {'auction_closing_time': 1765275300.0, 'created_time': 1763578923.319693, 'last_price_update_time': 1764702387.927834}
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117345378') HTTP/1.1" 204 0
2025-12-02 19:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd with identifier: 117638131
2025-12-02 19:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:06:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY%2FBLACK HTTP/1.1" 200 None
2025-12-02 19:06:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd with identifier: 117638131
2025-12-02 19:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'renault scenic e-tech electric estate 160kw esprit alpine 87kwh long range 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'scenic e-tech electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15869, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638131', 'expiration_date': '2025-12-09t10:15:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '160kw esprit alpine 87kwh long range 5dr auto', 'license_plate': 'md74zcx', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'renault scenic e-tech electric estate', 'sanitized_make': 'renault', 'odometer_in_km': 25538} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:15:00z',
     'fuel_type': 'electric',
     'id': 'ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'md74zcx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638131',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'renault',
     'make_model': 'renault scenic e-tech electric estate',
     'model': 'scenic e-tech electric estate',
     'odometer': 15869,
     'odometer_in_km': 25538,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-23',
     'sanitized_make': 'renault',
     'seller_name': 'motability operations',
     'title': 'renault scenic e-tech electric estate 160kw esprit alpine '
              '87kwh long range 5dr auto',
     'transmission': 'automatic',
     'trim': '160kw esprit alpine 87kwh long range 5dr auto',
     'vin': None,
     'year': 2024}
2025-12-02 19:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd spider: astonbarclay.gb
2025-12-02 19:06:28 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'renault scenic e-tech electric estate 160kw esprit alpine 87kwh long range 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'scenic e-tech electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15869, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638131', 'expiration_date': '2025-12-09t10:15:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '160kw esprit alpine 87kwh long range 5dr auto', 'license_plate': 'md74zcx', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'renault scenic e-tech electric estate', 'sanitized_make': 'renault', 'odometer_in_km': 25538} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:15:00z',
     'fuel_type': 'electric',
     'id': 'ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'md74zcx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638131',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'renault',
     'make_model': 'renault scenic e-tech electric estate',
     'model': 'scenic e-tech electric estate',
     'odometer': 15869,
     'odometer_in_km': 25538,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-23',
     'sanitized_make': 'renault',
     'seller_name': 'motability operations',
     'title': 'renault scenic e-tech electric estate 160kw esprit alpine '
              '87kwh long range 5dr auto',
     'transmission': 'automatic',
     'trim': '160kw esprit alpine 87kwh long range 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Electric',
 'id': 'ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MD74ZCX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638131',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'RENAULT',
 'model': 'SCENIC E-TECH ELECTRIC ESTATE',
 'odometer': 15869,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-23',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT SCENIC E-TECH ELECTRIC ESTATE 160kW Esprit Alpine 87kWh '
          'Long Range 5dr Auto',
 'transmission': 'automatic',
 'trim': '160kW Esprit Alpine 87kWh Long Range 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638131%27 HTTP/1.1" 200 None
2025-12-02 19:06:28 [astonbarclay.gb] INFO: Saving data for 117638131: {'auction_closing_time': 1765275300.0, 'created_time': 1764615696.276207, 'last_price_update_time': 1764702388.359411}
2025-12-02 19:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117638131') HTTP/1.1" 204 0
2025-12-02 19:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9a9ccf9f-021d-50a8-b43f-36c439d0551e with identifier: 117664913
2025-12-02 19:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9a9ccf9f-021d-50a8-b43f-36c439d0551e with identifier: 117664913
2025-12-02 19:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9a9ccf9f-021d-50a8-b43f-36c439d0551e with identifier: 117664913 to the API
2025-12-02 19:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279a9ccf9f-021d-50a8-b43f-36c439d0551e%27 HTTP/1.1" 200 None
2025-12-02 19:06:29 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9a9ccf9f-021d-50a8-b43f-36c439d0551e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:29 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117664913?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '9a9ccf9f-021d-50a8-b43f-36c439d0551e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SV21ZPT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117664913',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 58100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': 'Motability Operations',
 'title': 'AUDI A3 SPORTBACK 35 TFSI Sport 5dr',
 'transmission': 'manual',
 'trim': '35 TFSI Sport 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117664913%27 HTTP/1.1" 200 None
2025-12-02 19:06:29 [astonbarclay.gb] INFO: Saving data for 117664913: {'created_time': 1764702389.648608, 'last_price_update_time': 1764702389.648619, 'auction_closing_time': 1765275300.0}
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117664913') HTTP/1.1" 204 0
2025-12-02 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GM65BVX/2025-12-02/image/84c11af9-530c-4970-a4b9-507f775bf5e0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661968?view=catalogue)
2025-12-02 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71FXV/2025-11-28/image/14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590494?view=catalogue)
2025-12-02 19:06:29 [astonbarclay.gb] INFO: Found listing with ID: 117585151
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585151%27 HTTP/1.1" 200 None
2025-12-02 19:06:29 [astonbarclay.gb] INFO: Scrape type for 117585151: 2
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252F79d47c9d-22fc-45dc-89b2-feddc7cff6ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/79d47c9d-22fc-45dc-89b2-feddc7cff6ee_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252Fad6ce49f-bfff-496f-9bc0-32dc10baa960_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ad6ce49f-bfff-496f-9bc0-32dc10baa960_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:29 [astonbarclay.gb] INFO: Found listing with ID: 117585035
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585035%27 HTTP/1.1" 200 None
2025-12-02 19:06:29 [astonbarclay.gb] INFO: Scrape type for 117585035: 2
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252Fcac6b749-177a-4dde-9b96-db3642025459_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cac6b749-177a-4dde-9b96-db3642025459_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117272082?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf37e3150>
2025-12-02 19:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252F103b275e-a87c-4aae-a050-91637e3c348a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/103b275e-a87c-4aae-a050-91637e3c348a_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 026a1174-467b-570a-9674-dfc3a4d6842a
2025-12-02 19:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf067bb50>
2025-12-02 19:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252Fec7ed3dc-a999-40ad-8d8b-5c74bc3417ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ec7ed3dc-a999-40ad-8d8b-5c74bc3417ad_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 026a1174-467b-570a-9674-dfc3a4d6842a
2025-12-02 19:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SK70RMY/2025-12-02/image/3ea191d4-648a-47c1-a48d-8dfc98512c74_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509758?view=catalogue)
2025-12-02 19:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GM65BVX/2025-12-02/image/b8e2d73d-3a2f-47a1-8176-3303014b8e71_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661968?view=catalogue)
2025-12-02 19:06:30 [astonbarclay.gb] INFO: Found listing with ID: 117600618
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600618%27 HTTP/1.1" 200 None
2025-12-02 19:06:30 [astonbarclay.gb] INFO: Scrape type for 117600618: 2
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252Fcd5b9f1f-02a9-48ae-abf5-4665540117f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cd5b9f1f-02a9-48ae-abf5-4665540117f2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c6db50>
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252F84c11af9-530c-4970-a4b9-507f775bf5e0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/84c11af9-530c-4970-a4b9-507f775bf5e0_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 026a1174-467b-570a-9674-dfc3a4d6842a
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf038f5d0>
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252F14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be9d4895-6ef7-5e03-84b2-90915f3aff98
2025-12-02 19:06:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117272082, 'registration': 'WF67UXT', 'account': 'MAN037', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A160 AMG Line 5dr', 'mileage': 101464, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-11-16', 'fuel': 'Petrol', 'motExpiry': '2026-09-23', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WF67UXT/2025-11-17/image/9f946b4c-c208-485f-b38b-197056272200_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/a011d2d1-41ae-452f-b468-fce5073e7588_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/41ac318f-3fb7-440c-99b7-73d186c3f289_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/56a94336-2c92-4dfd-bfc7-3592020ce960_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/4fc4e5b8-fdc2-450d-9fbd-48008629c051_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/893378b6-899a-4977-a44a-c7044a48b99e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/a6459a71-8a30-45ae-9ddd-ffbd410b12f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/a317b7ed-c641-4376-96c4-111ff890c981_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/e1855ac4-899d-4167-8b5d-55adc626462c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 11/18 2K - 07/24 73K', 'remarks': 'VOSA STATES 39K- 53K - 77K- 101K -', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9247daea-8830-49ed-afbd-38cd8a34bdaf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117272082, 'registration': 'WF67UXT', 'account': 'MAN037', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A160 AMG Line 5dr', 'mileage': 101464, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-11-16', 'fuel': 'Petrol', 'motExpiry': '2026-09-23', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WF67UXT/2025-11-17/image/9f946b4c-c208-485f-b38b-197056272200_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/a011d2d1-41ae-452f-b468-fce5073e7588_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/41ac318f-3fb7-440c-99b7-73d186c3f289_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/56a94336-2c92-4dfd-bfc7-3592020ce960_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/4fc4e5b8-fdc2-450d-9fbd-48008629c051_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/893378b6-899a-4977-a44a-c7044a48b99e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/a6459a71-8a30-45ae-9ddd-ffbd410b12f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/a317b7ed-c641-4376-96c4-111ff890c981_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF67UXT/2025-11-17/image/e1855ac4-899d-4167-8b5d-55adc626462c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 11/18 2K - 07/24 73K', 'remarks': 'VOSA STATES 39K- 53K - 77K- 101K -', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9247daea-8830-49ed-afbd-38cd8a34bdaf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b814a328-d44e-566a-83fe-2a3f4571e43a with identifier: 117272082
2025-12-02 19:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b814a328-d44e-566a-83fe-2a3f4571e43a with scrape type 2
2025-12-02 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b814a328-d44e-566a-83fe-2a3f4571e43a with scrape type 2
2025-12-02 19:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b814a328-d44e-566a-83fe-2a3f4571e43a, identifier: 117272082
2025-12-02 19:06:30 [astonbarclay.gb] INFO: Found listing with ID: 117585347
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585347%27 HTTP/1.1" 200 None
2025-12-02 19:06:30 [astonbarclay.gb] INFO: Scrape type for 117585347: 2
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252F955549cb-7f07-4edc-b6ab-f977374bed18_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/955549cb-7f07-4edc-b6ab-f977374bed18_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b814a328-d44e-566a-83fe-2a3f4571e43a with identifier: 117272082
2025-12-02 19:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b814a328-d44e-566a-83fe-2a3f4571e43a with identifier: 117272082
2025-12-02 19:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163290 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163290
2025-12-02 19:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b814a328-d44e-566a-83fe-2a3f4571e43a spider: astonbarclay.gb
2025-12-02 19:06:31 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b814a328-d44e-566a-83fe-2a3f4571e43a due to rule: high_mileage_for_country.json, error: 163290 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163290
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'b814a328-d44e-566a-83fe-2a3f4571e43a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WF67UXT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117272082',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 101464,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-16',
 'seller_name': 'Manamanx Ltd',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A160 AMG Line 5dr',
 'transmission': 'manual',
 'trim': 'A160 AMG Line 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272082%27 HTTP/1.1" 200 None
2025-12-02 19:06:31 [astonbarclay.gb] INFO: Saving data for 117272082: {'auction_closing_time': 1765215000.0, 'created_time': 1763406273.973008, 'last_price_update_time': 1764702391.399856}
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117272082') HTTP/1.1" 204 0
2025-12-02 19:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ad6ce49f-bfff-496f-9bc0-32dc10baa960_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661968?view=catalogue)
2025-12-02 19:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cac6b749-177a-4dde-9b96-db3642025459_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509758?view=catalogue)
2025-12-02 19:06:31 [astonbarclay.gb] INFO: Found listing with ID: 117600700
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600700%27 HTTP/1.1" 200 None
2025-12-02 19:06:31 [astonbarclay.gb] INFO: Scrape type for 117600700: 2
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252Ff9bbc807-2329-4bb5-993f-15c530fd5624_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/f9bbc807-2329-4bb5-993f-15c530fd5624_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117056567?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117606946?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117563927?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117666809?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117672175?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf072cc50>
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252F3ea191d4-648a-47c1-a48d-8dfc98512c74_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/3ea191d4-648a-47c1-a48d-8dfc98512c74_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24cd7134-4180-54ac-9e26-d55d082add85
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0907990>
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252Fb8e2d73d-3a2f-47a1-8176-3303014b8e71_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/b8e2d73d-3a2f-47a1-8176-3303014b8e71_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 026a1174-467b-570a-9674-dfc3a4d6842a
2025-12-02 19:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117599696?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:31 [astonbarclay.gb] INFO: Found listing with ID: 117661902
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661902%27 HTTP/1.1" 200 None
2025-12-02 19:06:31 [astonbarclay.gb] INFO: Scrape type for 117661902: 1
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252F52ad17cd-0630-4e7c-a3e1-f510b84a1eb7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/52ad17cd-0630-4e7c-a3e1-f510b84a1eb7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf3706e50>
2025-12-02 19:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252Fad6ce49f-bfff-496f-9bc0-32dc10baa960_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ad6ce49f-bfff-496f-9bc0-32dc10baa960_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 026a1174-467b-570a-9674-dfc3a4d6842a
2025-12-02 19:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08f69d0>
2025-12-02 19:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252Fcac6b749-177a-4dde-9b96-db3642025459_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cac6b749-177a-4dde-9b96-db3642025459_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24cd7134-4180-54ac-9e26-d55d082add85
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117056567, 'registration': 'MF71EUC', 'account': 'ZEN009', 'make': 'CITROEN', 'model': 'C4 HATCHBACK', 'derivative': '1.2 PureTech [130] Sense Plus 5dr', 'mileage': 31461, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MF71EUC/2025-12-02/image/f2ffcd16-e17c-4564-95d3-4a2f45b365a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/3c160e68-5dcd-4aba-b4af-7ae20c068e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/828438a4-aa79-4e52-9e51-6f3324a8512e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4198b1f2-00de-46a0-9429-413126326dbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/ab5bee90-b926-41dd-b0cf-e39d8575dd71_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/de6b3f57-9edc-43ac-91cb-e65a5565223b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/5fb8de11-3135-4de3-8b9e-04c190a82a67_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4f6990fa-e74f-4889-888e-675e3ecf6753_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4630e4b4-bde8-4b29-a17e-eaa775fc7d3d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 12/22 - 8K, 10/25 - 30K', 'remarks': '**780** VOSA STATES 20K, 30K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cfc5db9f-4fc6-4051-b52a-51d57067568d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117056567, 'registration': 'MF71EUC', 'account': 'ZEN009', 'make': 'CITROEN', 'model': 'C4 HATCHBACK', 'derivative': '1.2 PureTech [130] Sense Plus 5dr', 'mileage': 31461, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MF71EUC/2025-12-02/image/f2ffcd16-e17c-4564-95d3-4a2f45b365a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/3c160e68-5dcd-4aba-b4af-7ae20c068e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/828438a4-aa79-4e52-9e51-6f3324a8512e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4198b1f2-00de-46a0-9429-413126326dbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/ab5bee90-b926-41dd-b0cf-e39d8575dd71_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/de6b3f57-9edc-43ac-91cb-e65a5565223b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/5fb8de11-3135-4de3-8b9e-04c190a82a67_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4f6990fa-e74f-4889-888e-675e3ecf6753_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4630e4b4-bde8-4b29-a17e-eaa775fc7d3d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 12/22 - 8K, 10/25 - 30K', 'remarks': '**780** VOSA STATES 20K, 30K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cfc5db9f-4fc6-4051-b52a-51d57067568d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8a00263-de51-5a58-b8c9-a7d4db7fe8df with identifier: 117056567
2025-12-02 19:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df with scrape type 1
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252Ff2ffcd16-e17c-4564-95d3-4a2f45b365a3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/f2ffcd16-e17c-4564-95d3-4a2f45b365a3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117606946, 'registration': 'RO72XDL', 'account': 'MOT070', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV 125 Titanium 5dr Auto', 'mileage': 26497, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/24-16k', 'remarks': 'vosa - 25k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117606946, 'registration': 'RO72XDL', 'account': 'MOT070', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV 125 Titanium 5dr Auto', 'mileage': 26497, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/24-16k', 'remarks': 'vosa - 25k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87919d18-9711-5e78-bdef-f64758f3159f with identifier: 117606946
2025-12-02 19:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87919d18-9711-5e78-bdef-f64758f3159f with scrape type 2
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87919d18-9711-5e78-bdef-f64758f3159f with scrape type 2
2025-12-02 19:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 87919d18-9711-5e78-bdef-f64758f3159f, identifier: 117606946
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117563927, 'registration': 'RXZ5279', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Elite Edition 5dr', 'mileage': 27371, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-06-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RXZ5279/2025-12-02/image/da358aec-863e-4be8-84ad-ab1f1bc6abb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/97aeb98d-20e4-44e9-a4c1-e0d99fa71918_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/3a2a5c2c-212f-4aee-9dbc-4d4e8ca9a1a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/b8edffd8-a91b-439e-8c4f-0f60fde1a3f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/c22cfc78-6cf9-46bb-a055-ec99fed23419_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/dd9ace58-a958-441c-b5da-f80a839e16d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/9eef526b-56e7-4dcc-9937-d530df0d8238_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/b8f2ec2c-4994-4e7e-90ed-e3315b67eac0_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23-8K 10/24-18K', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/845e2644-7709-42c3-878e-e1ab7ba88621.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117563927, 'registration': 'RXZ5279', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Elite Edition 5dr', 'mileage': 27371, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-06-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RXZ5279/2025-12-02/image/da358aec-863e-4be8-84ad-ab1f1bc6abb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/97aeb98d-20e4-44e9-a4c1-e0d99fa71918_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/3a2a5c2c-212f-4aee-9dbc-4d4e8ca9a1a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/b8edffd8-a91b-439e-8c4f-0f60fde1a3f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/c22cfc78-6cf9-46bb-a055-ec99fed23419_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/dd9ace58-a958-441c-b5da-f80a839e16d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/9eef526b-56e7-4dcc-9937-d530df0d8238_removebg.jpg?w=600', 'https://abimg003.imgix.net/RXZ5279/2025-12-02/image/b8f2ec2c-4994-4e7e-90ed-e3315b67eac0_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23-8K 10/24-18K', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/845e2644-7709-42c3-878e-e1ab7ba88621.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c21c868-0535-53b7-8968-e21a79b42702 with identifier: 117563927
2025-12-02 19:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c21c868-0535-53b7-8968-e21a79b42702 with scrape type 2
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c21c868-0535-53b7-8968-e21a79b42702 with scrape type 2
2025-12-02 19:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7c21c868-0535-53b7-8968-e21a79b42702, identifier: 117563927
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117666809, 'registration': 'GJ72OPA', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 IG-T 92 Tekna 5dr CVT', 'mileage': 22749, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-09-10', 'fuel': 'Petrol', 'motExpiry': '2026-09-09', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 09/23-5k 08/24-12k', 'remarks': 'vosa @ 21k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117666809, 'registration': 'GJ72OPA', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 IG-T 92 Tekna 5dr CVT', 'mileage': 22749, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-09-10', 'fuel': 'Petrol', 'motExpiry': '2026-09-09', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 09/23-5k 08/24-12k', 'remarks': 'vosa @ 21k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec12fb53-3be6-54fc-b38d-29612160238e with identifier: 117666809
2025-12-02 19:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec12fb53-3be6-54fc-b38d-29612160238e with scrape type 1
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ec12fb53-3be6-54fc-b38d-29612160238e
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ec12fb53-3be6-54fc-b38d-29612160238e
2025-12-02 19:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec12fb53-3be6-54fc-b38d-29612160238e, identifier: 117666809
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117672175, 'registration': 'DY21UMX', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'COMBO LIFE DIESEL ESTATE', 'derivative': '1.5 Turbo D SE 5dr [7 seat]', 'mileage': 45061, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-03-12', 'fuel': 'Diesel', 'motExpiry': '2026-03-11', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 04/22-10k 05/23-23k 09/24-33k', 'remarks': 'vosa @ 29k 37k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117672175, 'registration': 'DY21UMX', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'COMBO LIFE DIESEL ESTATE', 'derivative': '1.5 Turbo D SE 5dr [7 seat]', 'mileage': 45061, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-03-12', 'fuel': 'Diesel', 'motExpiry': '2026-03-11', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 04/22-10k 05/23-23k 09/24-33k', 'remarks': 'vosa @ 29k 37k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d244227-6899-50ac-bdb4-3c3b6e5446e7 with identifier: 117672175
2025-12-02 19:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d244227-6899-50ac-bdb4-3c3b6e5446e7 with scrape type 1
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 5d244227-6899-50ac-bdb4-3c3b6e5446e7
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 5d244227-6899-50ac-bdb4-3c3b6e5446e7
2025-12-02 19:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5d244227-6899-50ac-bdb4-3c3b6e5446e7, identifier: 117672175
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117631028, 'registration': 'WM74SKU', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'KONA ELECTRIC HATCHBACK', 'derivative': '115kW Advance 48kWh 5dr Auto', 'mileage': 3924, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-12-23', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117631028, 'registration': 'WM74SKU', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'KONA ELECTRIC HATCHBACK', 'derivative': '115kW Advance 48kWh 5dr Auto', 'mileage': 3924, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-12-23', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7fd25af-1c0c-5745-a7fa-634525bcac68 with identifier: 117631028
2025-12-02 19:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fd25af-1c0c-5745-a7fa-634525bcac68 with scrape type 2
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7fd25af-1c0c-5745-a7fa-634525bcac68 with scrape type 2
2025-12-02 19:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a7fd25af-1c0c-5745-a7fa-634525bcac68, identifier: 117631028
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Found listing with ID: 117584960
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584960%27 HTTP/1.1" 200 None
2025-12-02 19:06:32 [astonbarclay.gb] INFO: Scrape type for 117584960: 2
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252Feb65c259-2375-4c08-87e2-299a2ea1e42d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/eb65c259-2375-4c08-87e2-299a2ea1e42d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 87919d18-9711-5e78-bdef-f64758f3159f with identifier: 117606946
2025-12-02 19:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 87919d18-9711-5e78-bdef-f64758f3159f with identifier: 117606946
2025-12-02 19:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 87919d18-9711-5e78-bdef-f64758f3159f with identifier: 117606946 to the API
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2787919d18-9711-5e78-bdef-f64758f3159f%27 HTTP/1.1" 200 None
2025-12-02 19:06:33 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 87919d18-9711-5e78-bdef-f64758f3159f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117606946?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '87919d18-9711-5e78-bdef-f64758f3159f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RO72XDL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117606946',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 26497,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Motability Operations',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost Hybrid mHEV 125 Titanium 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '1.0 EcoBoost Hybrid mHEV 125 Titanium 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117606946%27 HTTP/1.1" 200 None
2025-12-02 19:06:33 [astonbarclay.gb] INFO: Saving data for 117606946: {'auction_closing_time': 1765275300.0, 'created_time': 1764356635.63876, 'last_price_update_time': 1764702393.250801}
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117606946') HTTP/1.1" 204 0
2025-12-02 19:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7c21c868-0535-53b7-8968-e21a79b42702 with identifier: 117563927
2025-12-02 19:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7c21c868-0535-53b7-8968-e21a79b42702 with identifier: 117563927
2025-12-02 19:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7c21c868-0535-53b7-8968-e21a79b42702 with identifier: 117563927 to the API
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277c21c868-0535-53b7-8968-e21a79b42702%27 HTTP/1.1" 200 None
2025-12-02 19:06:33 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7c21c868-0535-53b7-8968-e21a79b42702: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117563927?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '7c21c868-0535-53b7-8968-e21a79b42702',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RXZ5279',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117563927',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND HATCHBACK',
 'odometer': 27371,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL CROSSLAND HATCHBACK 1.2 Elite Edition 5dr',
 'transmission': 'manual',
 'trim': '1.2 Elite Edition 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563927%27 HTTP/1.1" 200 None
2025-12-02 19:06:33 [astonbarclay.gb] INFO: Saving data for 117563927: {'auction_closing_time': 1765275300.0, 'created_time': 1764615685.572276, 'last_price_update_time': 1764702393.643299}
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117563927') HTTP/1.1" 204 0
2025-12-02 19:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec12fb53-3be6-54fc-b38d-29612160238e with identifier: 117666809
2025-12-02 19:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec12fb53-3be6-54fc-b38d-29612160238e with identifier: 117666809
2025-12-02 19:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ec12fb53-3be6-54fc-b38d-29612160238e with identifier: 117666809 to the API
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ec12fb53-3be6-54fc-b38d-29612160238e%27 HTTP/1.1" 200 None
2025-12-02 19:06:33 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ec12fb53-3be6-54fc-b38d-29612160238e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117666809?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'ec12fb53-3be6-54fc-b38d-29612160238e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GJ72OPA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117666809',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'NISSAN',
 'model': 'MICRA HATCHBACK',
 'odometer': 22749,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-10',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN MICRA HATCHBACK 1.0 IG-T 92 Tekna 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.0 IG-T 92 Tekna 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117666809%27 HTTP/1.1" 200 None
2025-12-02 19:06:33 [astonbarclay.gb] INFO: Saving data for 117666809: {'created_time': 1764702393.951255, 'last_price_update_time': 1764702393.951265, 'auction_closing_time': 1765275300.0}
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117666809') HTTP/1.1" 204 0
2025-12-02 19:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5d244227-6899-50ac-bdb4-3c3b6e5446e7 with identifier: 117672175
2025-12-02 19:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5d244227-6899-50ac-bdb4-3c3b6e5446e7 with identifier: 117672175
2025-12-02 19:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'vauxhall' containing 'vauxhall' and model 'combo life diesel estate' containing 'combo'
2025-12-02 19:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5d244227-6899-50ac-bdb4-3c3b6e5446e7 spider: astonbarclay.gb
2025-12-02 19:06:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5d244227-6899-50ac-bdb4-3c3b6e5446e7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'vauxhall' containing 'vauxhall' and model 'combo life diesel estate' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Diesel',
 'id': '5d244227-6899-50ac-bdb4-3c3b6e5446e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DY21UMX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117672175',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'COMBO LIFE DIESEL ESTATE',
 'odometer': 45061,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-12',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL COMBO LIFE DIESEL ESTATE 1.5 Turbo D SE 5dr [7 seat]',
 'transmission': 'manual',
 'trim': '1.5 Turbo D SE 5dr [7 seat]',
 'vin': None,
 'year': 2021}
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672175%27 HTTP/1.1" 200 None
2025-12-02 19:06:34 [astonbarclay.gb] INFO: Saving data for 117672175: {'created_time': 1764702394.210053, 'last_price_update_time': 1764702394.210065, 'auction_closing_time': 1765275300.0}
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117672175') HTTP/1.1" 204 0
2025-12-02 19:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a7fd25af-1c0c-5745-a7fa-634525bcac68 with identifier: 117631028
2025-12-02 19:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a7fd25af-1c0c-5745-a7fa-634525bcac68 with identifier: 117631028
2025-12-02 19:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'hyundai kona electric hatchback 115kw advance 48kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3924, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631028', 'expiration_date': '2025-12-09t10:15:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '115kw advance 48kwh 5dr auto', 'license_plate': 'wm74sku', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'a7fd25af-1c0c-5745-a7fa-634525bcac68', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'hyundai kona electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 6315} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:15:00z',
     'fuel_type': 'electric',
     'id': 'a7fd25af-1c0c-5745-a7fa-634525bcac68',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'wm74sku',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631028',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'hyundai',
     'make_model': 'hyundai kona electric hatchback',
     'model': 'kona electric hatchback',
     'odometer': 3924,
     'odometer_in_km': 6315,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-23',
     'sanitized_make': 'hyundai',
     'seller_name': 'motability operations',
     'title': 'hyundai kona electric hatchback 115kw advance 48kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '115kw advance 48kwh 5dr auto',
     'vin': None,
     'year': 2024}
2025-12-02 19:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: a7fd25af-1c0c-5745-a7fa-634525bcac68 spider: astonbarclay.gb
2025-12-02 19:06:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a7fd25af-1c0c-5745-a7fa-634525bcac68 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'hyundai kona electric hatchback 115kw advance 48kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3924, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631028', 'expiration_date': '2025-12-09t10:15:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '115kw advance 48kwh 5dr auto', 'license_plate': 'wm74sku', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'a7fd25af-1c0c-5745-a7fa-634525bcac68', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'hyundai kona electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 6315} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:15:00z',
     'fuel_type': 'electric',
     'id': 'a7fd25af-1c0c-5745-a7fa-634525bcac68',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'wm74sku',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631028',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'hyundai',
     'make_model': 'hyundai kona electric hatchback',
     'model': 'kona electric hatchback',
     'odometer': 3924,
     'odometer_in_km': 6315,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-23',
     'sanitized_make': 'hyundai',
     'seller_name': 'motability operations',
     'title': 'hyundai kona electric hatchback 115kw advance 48kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '115kw advance 48kwh 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Electric',
 'id': 'a7fd25af-1c0c-5745-a7fa-634525bcac68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WM74SKU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631028',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HYUNDAI',
 'model': 'KONA ELECTRIC HATCHBACK',
 'odometer': 3924,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-23',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI KONA ELECTRIC HATCHBACK 115kW Advance 48kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '115kW Advance 48kWh 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631028%27 HTTP/1.1" 200 None
2025-12-02 19:06:34 [astonbarclay.gb] INFO: Saving data for 117631028: {'auction_closing_time': 1765275300.0, 'created_time': 1764615788.432351, 'last_price_update_time': 1764702394.43036}
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117631028') HTTP/1.1" 204 0
2025-12-02 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cd5b9f1f-02a9-48ae-abf5-4665540117f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509758?view=catalogue)
2025-12-02 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GM65BVX/2025-12-02/image/f7514041-554a-43b2-aac3-f72638920473_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661968?view=catalogue)
2025-12-02 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GM65BVX/2025-12-02/image/4e0fcaec-32b0-4d3c-abb5-be14cba9ffeb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661968?view=catalogue)
2025-12-02 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SK70RMY/2025-12-02/image/955549cb-7f07-4edc-b6ab-f977374bed18_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509758?view=catalogue)
2025-12-02 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SK70RMY/2025-12-02/image/79d47c9d-22fc-45dc-89b2-feddc7cff6ee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509758?view=catalogue)
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F3c160e68-5dcd-4aba-b4af-7ae20c068e03_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/3c160e68-5dcd-4aba-b4af-7ae20c068e03_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SK70RMY/2025-12-02/image/f9bbc807-2329-4bb5-993f-15c530fd5624_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509758?view=catalogue)
2025-12-02 19:06:34 [astonbarclay.gb] INFO: Found listing with ID: 117599947
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599947%27 HTTP/1.1" 200 None
2025-12-02 19:06:34 [astonbarclay.gb] INFO: Scrape type for 117599947: 2
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252F9151f589-da48-4417-bcf2-faef49c25ebd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/9151f589-da48-4417-bcf2-faef49c25ebd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117361961?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F828438a4-aa79-4e52-9e51-6f3324a8512e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/828438a4-aa79-4e52-9e51-6f3324a8512e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117599696, 'registration': 'SRZ9221', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '5008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi GT 5dr EAT8', 'mileage': 40866, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-09-20', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SRZ9221/2025-12-01/image/6aee46ad-6772-4faa-b9cb-5ba0bbf45a8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/bc20d71d-00f2-434f-823e-d2a7a3d47241_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/eb55efb0-ac65-4b4a-92b5-c8053ce4685d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/45a32d49-bfca-46a4-85d6-0f268495fb68_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/2128ba5b-208c-4ffe-941a-a39ec815aa66_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/a29be0f0-d7cc-484f-8820-55459094dfa4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/eef21276-7db7-4506-9c44-bb4b3d499237_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/e45285ba-1f51-460b-bf6e-9ee52803aa11_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/7827b76b-d9df-4d89-bd7c-988738bff329_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/986d8b87-01c7-44de-86ba-7ebcd55e6214_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/f4539294-4407-491d-97fe-1ae19ae5eb22_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/23-10k 05/24-37k 04/25-52k', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a80f8d5-21cb-40fc-b101-147df6e03d29.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117599696, 'registration': 'SRZ9221', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '5008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi GT 5dr EAT8', 'mileage': 40866, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-09-20', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SRZ9221/2025-12-01/image/6aee46ad-6772-4faa-b9cb-5ba0bbf45a8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/bc20d71d-00f2-434f-823e-d2a7a3d47241_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/eb55efb0-ac65-4b4a-92b5-c8053ce4685d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/45a32d49-bfca-46a4-85d6-0f268495fb68_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/2128ba5b-208c-4ffe-941a-a39ec815aa66_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/a29be0f0-d7cc-484f-8820-55459094dfa4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/eef21276-7db7-4506-9c44-bb4b3d499237_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/e45285ba-1f51-460b-bf6e-9ee52803aa11_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/7827b76b-d9df-4d89-bd7c-988738bff329_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/986d8b87-01c7-44de-86ba-7ebcd55e6214_removebg.jpg?w=600', 'https://abimg003.imgix.net/SRZ9221/2025-12-01/image/f4539294-4407-491d-97fe-1ae19ae5eb22_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/23-10k 05/24-37k 04/25-52k', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a80f8d5-21cb-40fc-b101-147df6e03d29.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1503766-37b6-5744-94a1-c8c11a248661 with identifier: 117599696
2025-12-02 19:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1503766-37b6-5744-94a1-c8c11a248661 with scrape type 2
2025-12-02 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1503766-37b6-5744-94a1-c8c11a248661 with scrape type 2
2025-12-02 19:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a1503766-37b6-5744-94a1-c8c11a248661, identifier: 117599696
2025-12-02 19:06:34 [astonbarclay.gb] INFO: Found listing with ID: 117584969
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584969%27 HTTP/1.1" 200 None
2025-12-02 19:06:34 [astonbarclay.gb] INFO: Scrape type for 117584969: 2
2025-12-02 19:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a1503766-37b6-5744-94a1-c8c11a248661 with identifier: 117599696
2025-12-02 19:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a1503766-37b6-5744-94a1-c8c11a248661 with identifier: 117599696
2025-12-02 19:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a1503766-37b6-5744-94a1-c8c11a248661 with identifier: 117599696 to the API
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a1503766-37b6-5744-94a1-c8c11a248661%27 HTTP/1.1" 200 None
2025-12-02 19:06:34 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a1503766-37b6-5744-94a1-c8c11a248661: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117599696?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Diesel',
 'id': 'a1503766-37b6-5744-94a1-c8c11a248661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SRZ9221',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599696',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'PEUGEOT',
 'model': '5008 DIESEL ESTATE',
 'odometer': 40866,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 5008 DIESEL ESTATE 1.5 BlueHDi GT 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi GT 5dr EAT8',
 'vin': None,
 'year': 2021}
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599696%27 HTTP/1.1" 200 None
2025-12-02 19:06:34 [astonbarclay.gb] INFO: Saving data for 117599696: {'auction_closing_time': 1765275300.0, 'created_time': 1764356649.105436, 'last_price_update_time': 1764702394.915389}
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117599696') HTTP/1.1" 204 0
2025-12-02 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71EUC/2025-12-02/image/f2ffcd16-e17c-4564-95d3-4a2f45b365a3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056567?view=catalogue)
2025-12-02 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/57ab575b-2b38-4e96-95d3-1ccf8a93df15_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117410407?view=catalogue)
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F4198b1f2-00de-46a0-9429-413126326dbf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4198b1f2-00de-46a0-9429-413126326dbf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SK70RMY/2025-12-02/image/52ad17cd-0630-4e7c-a3e1-f510b84a1eb7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509758?view=catalogue)
2025-12-02 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SK70RMY/2025-12-02/image/eb65c259-2375-4c08-87e2-299a2ea1e42d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509758?view=catalogue)
2025-12-02 19:06:34 [astonbarclay.gb] INFO: Found listing with ID: 117610728
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610728%27 HTTP/1.1" 200 None
2025-12-02 19:06:35 [astonbarclay.gb] INFO: Scrape type for 117610728: 2
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf202ab90>
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252Fcd5b9f1f-02a9-48ae-abf5-4665540117f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cd5b9f1f-02a9-48ae-abf5-4665540117f2_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24cd7134-4180-54ac-9e26-d55d082add85
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf067af10>
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252Ff7514041-554a-43b2-aac3-f72638920473_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/f7514041-554a-43b2-aac3-f72638920473_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 026a1174-467b-570a-9674-dfc3a4d6842a
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066b3d0>
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGM65BVX%252F2025-12-02%252Fimage%252F4e0fcaec-32b0-4d3c-abb5-be14cba9ffeb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GM65BVX/2025-12-02/image/4e0fcaec-32b0-4d3c-abb5-be14cba9ffeb_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 026a1174-467b-570a-9674-dfc3a4d6842a
2025-12-02 19:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 026a1174-467b-570a-9674-dfc3a4d6842a, skipping ID generation
2025-12-02 19:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 026a1174-467b-570a-9674-dfc3a4d6842a with scrape type 1
2025-12-02 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 026a1174-467b-570a-9674-dfc3a4d6842a from tracking dictionaries
2025-12-02 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 026a1174-467b-570a-9674-dfc3a4d6842a sending to next pipeline
2025-12-02 19:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 026a1174-467b-570a-9674-dfc3a4d6842a, identifier: 117661968
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf050b7d0>
2025-12-02 19:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252F955549cb-7f07-4edc-b6ab-f977374bed18_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/955549cb-7f07-4edc-b6ab-f977374bed18_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24cd7134-4180-54ac-9e26-d55d082add85
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0722e50>
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252F79d47c9d-22fc-45dc-89b2-feddc7cff6ee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/79d47c9d-22fc-45dc-89b2-feddc7cff6ee_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24cd7134-4180-54ac-9e26-d55d082add85
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06425d0>
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252Ff9bbc807-2329-4bb5-993f-15c530fd5624_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/f9bbc807-2329-4bb5-993f-15c530fd5624_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24cd7134-4180-54ac-9e26-d55d082add85
2025-12-02 19:06:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117361961, 'registration': 'FE21KFA', 'account': 'LDF003', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 75975, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-07-01', 'fuel': 'Electric', 'motExpiry': '2026-11-08', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Direct from Asset Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117361961, 'registration': 'FE21KFA', 'account': 'LDF003', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 75975, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-07-01', 'fuel': 'Electric', 'motExpiry': '2026-11-08', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Direct from Asset Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db3630fa-b3f2-5369-94ce-22539f2041fd with identifier: 117361961
2025-12-02 19:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db3630fa-b3f2-5369-94ce-22539f2041fd with scrape type 1
2025-12-02 19:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item db3630fa-b3f2-5369-94ce-22539f2041fd
2025-12-02 19:06:36 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item db3630fa-b3f2-5369-94ce-22539f2041fd
2025-12-02 19:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: db3630fa-b3f2-5369-94ce-22539f2041fd, identifier: 117361961
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252Fab5bee90-b926-41dd-b0cf-e39d8575dd71_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/ab5bee90-b926-41dd-b0cf-e39d8575dd71_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 026a1174-467b-570a-9674-dfc3a4d6842a with identifier: 117661968
2025-12-02 19:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 026a1174-467b-570a-9674-dfc3a4d6842a with identifier: 117661968
2025-12-02 19:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181702 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181702
2025-12-02 19:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 026a1174-467b-570a-9674-dfc3a4d6842a spider: astonbarclay.gb
2025-12-02 19:06:36 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 026a1174-467b-570a-9674-dfc3a4d6842a due to rule: high_mileage_for_country.json, error: 181702 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181702
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '026a1174-467b-570a-9674-dfc3a4d6842a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GM65BVX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117661968',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 112905,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25025,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/cd7e6b39-1436-4d14-a20f-29bd5666ca0f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26091,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/84c11af9-530c-4970-a4b9-507f775bf5e0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24451,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ec7ed3dc-a999-40ad-8d8b-5c74bc3417ad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23447,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/103b275e-a87c-4aae-a050-91637e3c348a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45952,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/4e0fcaec-32b0-4d3c-abb5-be14cba9ffeb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40057,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/b8e2d73d-3a2f-47a1-8176-3303014b8e71_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50315,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/f7514041-554a-43b2-aac3-f72638920473_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1174-467b-570a-9674-dfc3a4d6842a/026a1174-467b-570a-9674-dfc3a4d6842a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39897,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GM65BVX/2025-12-02/image/ad6ce49f-bfff-496f-9bc0-32dc10baa960_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI GT 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI GT 5dr',
 'vin': None,
 'year': 2015}
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661968%27 HTTP/1.1" 200 None
2025-12-02 19:06:36 [astonbarclay.gb] INFO: Saving data for 117661968: {'created_time': 1764702396.816348, 'last_price_update_time': 1764702396.816358, 'auction_closing_time': 1765274400.0}
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117661968') HTTP/1.1" 204 0
2025-12-02 19:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: db3630fa-b3f2-5369-94ce-22539f2041fd with identifier: 117361961
2025-12-02 19:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: db3630fa-b3f2-5369-94ce-22539f2041fd with identifier: 117361961
2025-12-02 19:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 122269 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    122269
2025-12-02 19:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: db3630fa-b3f2-5369-94ce-22539f2041fd spider: astonbarclay.gb
2025-12-02 19:06:37 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: db3630fa-b3f2-5369-94ce-22539f2041fd due to rule: high_mileage_for_make.json, error: 122269 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    122269
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Electric',
 'id': 'db3630fa-b3f2-5369-94ce-22539f2041fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FE21KFA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117361961',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 75975,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-01',
 'seller_name': 'Direct from Asset Finance',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117361961%27 HTTP/1.1" 200 None
2025-12-02 19:06:37 [astonbarclay.gb] INFO: Saving data for 117361961: {'created_time': 1764702397.024866, 'last_price_update_time': 1764702397.024875, 'auction_closing_time': 1765275300.0}
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117361961') HTTP/1.1" 204 0
2025-12-02 19:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71EUC/2025-12-02/image/3c160e68-5dcd-4aba-b4af-7ae20c068e03_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056567?view=catalogue)
2025-12-02 19:06:37 [astonbarclay.gb] INFO: Found listing with ID: 117699534
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117699534%27 HTTP/1.1" 200 None
2025-12-02 19:06:37 [astonbarclay.gb] INFO: Scrape type for 117699534: 1
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252Fde6b3f57-9edc-43ac-91cb-e65a5565223b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/de6b3f57-9edc-43ac-91cb-e65a5565223b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117603564?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116997754?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117610912?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117672666?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0564150>
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252Ff2ffcd16-e17c-4564-95d3-4a2f45b365a3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/f2ffcd16-e17c-4564-95d3-4a2f45b365a3_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05645d0>
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252F57ab575b-2b38-4e96-95d3-1ccf8a93df15_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/57ab575b-2b38-4e96-95d3-1ccf8a93df15_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0341750>
2025-12-02 19:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252F52ad17cd-0630-4e7c-a3e1-f510b84a1eb7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/52ad17cd-0630-4e7c-a3e1-f510b84a1eb7_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24cd7134-4180-54ac-9e26-d55d082add85
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0866710>
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252Feb65c259-2375-4c08-87e2-299a2ea1e42d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/eb65c259-2375-4c08-87e2-299a2ea1e42d_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24cd7134-4180-54ac-9e26-d55d082add85
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Found listing with ID: 117599975
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599975%27 HTTP/1.1" 200 None
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Scrape type for 117599975: 1
2025-12-02 19:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71EUC/2025-12-02/image/828438a4-aa79-4e52-9e51-6f3324a8512e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056567?view=catalogue)
2025-12-02 19:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SK70RMY/2025-12-02/image/9151f589-da48-4417-bcf2-faef49c25ebd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509758?view=catalogue)
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F5fb8de11-3135-4de3-8b9e-04c190a82a67_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/5fb8de11-3135-4de3-8b9e-04c190a82a67_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Found listing with ID: 117585132
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585132%27 HTTP/1.1" 200 None
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Scrape type for 117585132: 2
2025-12-02 19:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585347?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F4f6990fa-e74f-4889-888e-675e3ecf6753_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4f6990fa-e74f-4889-888e-675e3ecf6753_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Found listing with ID: 117661933
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661933%27 HTTP/1.1" 200 None
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Scrape type for 117661933: 1
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf050cd10>
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F3c160e68-5dcd-4aba-b4af-7ae20c068e03_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/3c160e68-5dcd-4aba-b4af-7ae20c068e03_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117603564, 'registration': 'VU70BVH', 'account': 'MOT070', 'make': 'DACIA', 'model': 'LOGAN MCV ESTATE', 'derivative': '1.0 SCe Access 5dr', 'mileage': 13782, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-09-09', 'fuel': 'Petrol', 'motExpiry': '2026-07-31', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VU70BVH/2025-12-01/image/b4b26df7-5d0d-4839-bfee-b83e23d8ef2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/919af151-9fce-41a4-96b1-ec786142fada_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/19b0ba54-b2cf-4b35-8116-087c50dbe418_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/6e3e6a07-bc9b-4a91-baab-fd5ebb3d796f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/b9eb5cbd-9a4d-4cab-a469-8dbf18640ca0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/8bbe26f7-7eb3-4393-99b1-2b3143893e7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/4864375d-8f99-49cd-85fc-cb303fbe1bc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/92e86b0a-d59c-48c6-8c5b-d04e39b01578_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/92b899e4-860e-4e1f-b50c-8981c0c50c62_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/d3c89bc9-a545-4688-91e3-501453f618b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/03edeabf-80f5-494a-877c-f8de66f58cac_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/3506209c-7644-4971-99f4-bc521da56435_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/dac83438-da1c-4547-9e2a-24c9ca51e5b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/8858da0d-3fd8-4e87-b1f6-c3903e3dc57e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/87572739-abb6-4e86-877b-9808ab730bcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/e492f980-2838-420c-ac14-1ebbbfbece27_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/22386654-6efe-4a02-a5af-4e6985f4827e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/6199436b-4a85-4793-9170-c7a263acf820_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/c0e28dda-2b2c-4d92-9acc-42efc172e49c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/85bacec7-1933-4671-ac25-142ad111b67f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/7ffd5855-cdc6-48a9-9dba-e8187e7cae7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/bf67a3e0-1a51-4ad4-9f3a-cb1a482a7386_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/21-1k 09/22-4k 08/23-7k 08/24-11k', 'remarks': 'vosa - 7k, 11k, 13k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7361e86d-40dd-4846-b415-db2b5cb00a38.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117603564, 'registration': 'VU70BVH', 'account': 'MOT070', 'make': 'DACIA', 'model': 'LOGAN MCV ESTATE', 'derivative': '1.0 SCe Access 5dr', 'mileage': 13782, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-09-09', 'fuel': 'Petrol', 'motExpiry': '2026-07-31', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VU70BVH/2025-12-01/image/b4b26df7-5d0d-4839-bfee-b83e23d8ef2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/919af151-9fce-41a4-96b1-ec786142fada_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/19b0ba54-b2cf-4b35-8116-087c50dbe418_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/6e3e6a07-bc9b-4a91-baab-fd5ebb3d796f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/b9eb5cbd-9a4d-4cab-a469-8dbf18640ca0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/8bbe26f7-7eb3-4393-99b1-2b3143893e7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/4864375d-8f99-49cd-85fc-cb303fbe1bc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/92e86b0a-d59c-48c6-8c5b-d04e39b01578_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/92b899e4-860e-4e1f-b50c-8981c0c50c62_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/d3c89bc9-a545-4688-91e3-501453f618b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/03edeabf-80f5-494a-877c-f8de66f58cac_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/3506209c-7644-4971-99f4-bc521da56435_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/dac83438-da1c-4547-9e2a-24c9ca51e5b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/8858da0d-3fd8-4e87-b1f6-c3903e3dc57e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/87572739-abb6-4e86-877b-9808ab730bcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/e492f980-2838-420c-ac14-1ebbbfbece27_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/22386654-6efe-4a02-a5af-4e6985f4827e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/6199436b-4a85-4793-9170-c7a263acf820_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/c0e28dda-2b2c-4d92-9acc-42efc172e49c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/85bacec7-1933-4671-ac25-142ad111b67f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/7ffd5855-cdc6-48a9-9dba-e8187e7cae7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU70BVH/2025-12-01/image/bf67a3e0-1a51-4ad4-9f3a-cb1a482a7386_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/21-1k 09/22-4k 08/23-7k 08/24-11k', 'remarks': 'vosa - 7k, 11k, 13k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7361e86d-40dd-4846-b415-db2b5cb00a38.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 234b433b-361f-54f0-a92a-fdeb69ef5004 with identifier: 117603564
2025-12-02 19:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 234b433b-361f-54f0-a92a-fdeb69ef5004 with scrape type 2
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 234b433b-361f-54f0-a92a-fdeb69ef5004 with scrape type 2
2025-12-02 19:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 234b433b-361f-54f0-a92a-fdeb69ef5004, identifier: 117603564
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116997754, 'registration': 'PMN202V', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.3 TCE 140 Iconic Edition 5dr', 'mileage': 32634, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-04-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PMN202V/2025-11-06/image/f97d2254-1b9f-4735-a8ee-c695253d65f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/1e4e2a67-6936-45b0-a38f-82b2eaf5e37a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/8ea2c304-2809-49ac-9e6a-855eb478d2e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/519d201f-a070-4799-bd55-5138dac9854e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/c1878dca-49cf-4c27-84b6-6563db073c4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/2d168458-ec89-4e83-9133-176e41a70955_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/f5ad9c39-1cc5-491c-b845-ab2e80e9b6f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/f977f8b0-f990-496a-8c97-91797d37ffc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/d7bb92e4-8f27-4797-a918-51ff41be9dd3_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 03/23- 8k, 03/24- 17k, 03/25-26k', 'remarks': 'spare key in office IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present,', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c1d835e-e55c-4494-959f-41b96dcf72ef.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116997754, 'registration': 'PMN202V', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.3 TCE 140 Iconic Edition 5dr', 'mileage': 32634, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-04-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PMN202V/2025-11-06/image/f97d2254-1b9f-4735-a8ee-c695253d65f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/1e4e2a67-6936-45b0-a38f-82b2eaf5e37a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/8ea2c304-2809-49ac-9e6a-855eb478d2e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/519d201f-a070-4799-bd55-5138dac9854e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/c1878dca-49cf-4c27-84b6-6563db073c4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/2d168458-ec89-4e83-9133-176e41a70955_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/f5ad9c39-1cc5-491c-b845-ab2e80e9b6f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/f977f8b0-f990-496a-8c97-91797d37ffc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/d7bb92e4-8f27-4797-a918-51ff41be9dd3_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 03/23- 8k, 03/24- 17k, 03/25-26k', 'remarks': 'spare key in office IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present,', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c1d835e-e55c-4494-959f-41b96dcf72ef.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498a6fee-1e22-5c90-919f-b3db8c1a1fee with identifier: 116997754
2025-12-02 19:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee with scrape type 2
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee with scrape type 2
2025-12-02 19:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 498a6fee-1e22-5c90-919f-b3db8c1a1fee, identifier: 116997754
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117610912, 'registration': 'BK20DKO', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'PRIUS+ ESTATE', 'derivative': '1.8 VVTi Excel TSS 5dr CVT Auto', 'mileage': 91326, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-07-17', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-07-24', 'doors': 5, 'engineSize': 1797, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BK20DKO/2025-12-01/image/daecef9d-0dcf-413a-b354-d9663e563fc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/46ca0ecc-ebf4-4bcb-87f3-509dae7a330b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/f2a5ef26-50ad-4e7c-b603-697c24d62c62_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/21ca6f43-9e3c-401a-ba3d-dc86ac1dbc6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/633a4d15-9ed7-4d56-8546-e50f1b56f465_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/f7ed621c-71d0-4310-8ea7-47a9c1fa9ed2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/af5e6169-732c-4f23-b6af-461121b10ff2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/e37288d8-4743-4d90-8ea2-83b7fddfae54_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/34bb7c9a-df45-4197-a247-790eda653ace_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/5d876a59-4416-4cb6-a6f7-d7044b93f5d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/7a2b5616-a6bb-472b-8c35-e24f466a83c8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 08/21-20K', 'remarks': 'vosa - 55k, 65k, 85k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d5e96bc8-7da5-477d-8469-eb8455704203.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117610912, 'registration': 'BK20DKO', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'PRIUS+ ESTATE', 'derivative': '1.8 VVTi Excel TSS 5dr CVT Auto', 'mileage': 91326, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-07-17', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-07-24', 'doors': 5, 'engineSize': 1797, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BK20DKO/2025-12-01/image/daecef9d-0dcf-413a-b354-d9663e563fc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/46ca0ecc-ebf4-4bcb-87f3-509dae7a330b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/f2a5ef26-50ad-4e7c-b603-697c24d62c62_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/21ca6f43-9e3c-401a-ba3d-dc86ac1dbc6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/633a4d15-9ed7-4d56-8546-e50f1b56f465_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/f7ed621c-71d0-4310-8ea7-47a9c1fa9ed2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/af5e6169-732c-4f23-b6af-461121b10ff2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/e37288d8-4743-4d90-8ea2-83b7fddfae54_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/34bb7c9a-df45-4197-a247-790eda653ace_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/5d876a59-4416-4cb6-a6f7-d7044b93f5d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK20DKO/2025-12-01/image/7a2b5616-a6bb-472b-8c35-e24f466a83c8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 08/21-20K', 'remarks': 'vosa - 55k, 65k, 85k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d5e96bc8-7da5-477d-8469-eb8455704203.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a296c99-836a-5a25-a851-0b2276658736 with identifier: 117610912
2025-12-02 19:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a296c99-836a-5a25-a851-0b2276658736 with scrape type 2
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a296c99-836a-5a25-a851-0b2276658736 with scrape type 2
2025-12-02 19:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8a296c99-836a-5a25-a851-0b2276658736, identifier: 117610912
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117672666, 'registration': 'MW22YWR', 'account': 'MOT070', 'make': 'SUZUKI', 'model': 'SWACE ESTATE', 'derivative': '1.8 Hybrid SZ5 5dr CVT', 'mileage': 27775, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-06-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-06-28', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 06/23-8k 05/24-18-18k 06/25-27k', 'remarks': 'vosa @ 27k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117672666, 'registration': 'MW22YWR', 'account': 'MOT070', 'make': 'SUZUKI', 'model': 'SWACE ESTATE', 'derivative': '1.8 Hybrid SZ5 5dr CVT', 'mileage': 27775, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-06-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-06-28', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 06/23-8k 05/24-18-18k 06/25-27k', 'remarks': 'vosa @ 27k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41962dee-12e6-56a8-ad4d-85fcf4591c12 with identifier: 117672666
2025-12-02 19:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41962dee-12e6-56a8-ad4d-85fcf4591c12 with scrape type 1
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 41962dee-12e6-56a8-ad4d-85fcf4591c12
2025-12-02 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 41962dee-12e6-56a8-ad4d-85fcf4591c12
2025-12-02 19:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 41962dee-12e6-56a8-ad4d-85fcf4591c12, identifier: 117672666
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F4630e4b4-bde8-4b29-a17e-eaa775fc7d3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4630e4b4-bde8-4b29-a17e-eaa775fc7d3d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 234b433b-361f-54f0-a92a-fdeb69ef5004 with identifier: 117603564
2025-12-02 19:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 234b433b-361f-54f0-a92a-fdeb69ef5004 with identifier: 117603564
2025-12-02 19:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 234b433b-361f-54f0-a92a-fdeb69ef5004 with identifier: 117603564 to the API
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27234b433b-361f-54f0-a92a-fdeb69ef5004%27 HTTP/1.1" 200 None
2025-12-02 19:06:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 234b433b-361f-54f0-a92a-fdeb69ef5004: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117603564?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '234b433b-361f-54f0-a92a-fdeb69ef5004',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VU70BVH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117603564',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'DACIA',
 'model': 'LOGAN MCV ESTATE',
 'odometer': 13782,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seller_name': 'Motability Operations',
 'title': 'DACIA LOGAN MCV ESTATE 1.0 SCe Access 5dr',
 'transmission': 'manual',
 'trim': '1.0 SCe Access 5dr',
 'vin': None,
 'year': 2020}
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117603564%27 HTTP/1.1" 200 None
2025-12-02 19:06:39 [astonbarclay.gb] INFO: Saving data for 117603564: {'auction_closing_time': 1765275300.0, 'created_time': 1764356630.75814, 'last_price_update_time': 1764702399.305984}
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117603564') HTTP/1.1" 204 0
2025-12-02 19:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 498a6fee-1e22-5c90-919f-b3db8c1a1fee with identifier: 116997754
2025-12-02 19:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 498a6fee-1e22-5c90-919f-b3db8c1a1fee with identifier: 116997754
2025-12-02 19:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'

Failed validating 'type' in schema['properties']['color']:
    {'minLength': 1, 'type': 'string'}

On instance['color']:
    None
2025-12-02 19:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 498a6fee-1e22-5c90-919f-b3db8c1a1fee spider: astonbarclay.gb
2025-12-02 19:06:39 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 498a6fee-1e22-5c90-919f-b3db8c1a1fee due to rule: missing_color.json, error: None is not of type 'string'

Failed validating 'type' in schema['properties']['color']:
    {'minLength': 1, 'type': 'string'}

On instance['color']:
    None
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': None,
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': None,
 'engine': '',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '498a6fee-1e22-5c90-919f-b3db8c1a1fee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PMN202V',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116997754',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 32634,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-19',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT CAPTUR HATCHBACK 1.3 TCE 140 Iconic Edition 5dr',
 'transmission': 'manual',
 'trim': '1.3 TCE 140 Iconic Edition 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997754%27 HTTP/1.1" 200 None
2025-12-02 19:06:39 [astonbarclay.gb] INFO: Saving data for 116997754: {'auction_closing_time': 1765275300.0, 'created_time': 1764615715.082647, 'last_price_update_time': 1764702399.570273}
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116997754') HTTP/1.1" 204 0
2025-12-02 19:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8a296c99-836a-5a25-a851-0b2276658736 with identifier: 117610912
2025-12-02 19:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8a296c99-836a-5a25-a851-0b2276658736 with identifier: 117610912
2025-12-02 19:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8a296c99-836a-5a25-a851-0b2276658736 with identifier: 117610912 to the API
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%278a296c99-836a-5a25-a851-0b2276658736%27 HTTP/1.1" 200 None
2025-12-02 19:06:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 8a296c99-836a-5a25-a851-0b2276658736: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117610912?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '8a296c99-836a-5a25-a851-0b2276658736',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BK20DKO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117610912',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'TOYOTA',
 'model': 'PRIUS+ ESTATE',
 'odometer': 91326,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-17',
 'seller_name': 'Motability Operations',
 'title': 'TOYOTA PRIUS+ ESTATE 1.8 VVTi Excel TSS 5dr CVT Auto',
 'transmission': 'automatic',
 'trim': '1.8 VVTi Excel TSS 5dr CVT Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610912%27 HTTP/1.1" 200 None
2025-12-02 19:06:39 [astonbarclay.gb] INFO: Saving data for 117610912: {'auction_closing_time': 1765275300.0, 'created_time': 1764356636.199822, 'last_price_update_time': 1764702399.858059}
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117610912') HTTP/1.1" 204 0
2025-12-02 19:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 41962dee-12e6-56a8-ad4d-85fcf4591c12 with identifier: 117672666
2025-12-02 19:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 41962dee-12e6-56a8-ad4d-85fcf4591c12 with identifier: 117672666
2025-12-02 19:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 41962dee-12e6-56a8-ad4d-85fcf4591c12 with identifier: 117672666 to the API
2025-12-02 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2741962dee-12e6-56a8-ad4d-85fcf4591c12%27 HTTP/1.1" 200 None
2025-12-02 19:06:40 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 41962dee-12e6-56a8-ad4d-85fcf4591c12: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117672666?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '41962dee-12e6-56a8-ad4d-85fcf4591c12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MW22YWR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117672666',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'SUZUKI',
 'model': 'SWACE ESTATE',
 'odometer': 27775,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': 'Motability Operations',
 'title': 'SUZUKI SWACE ESTATE 1.8 Hybrid SZ5 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.8 Hybrid SZ5 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672666%27 HTTP/1.1" 200 None
2025-12-02 19:06:40 [astonbarclay.gb] INFO: Saving data for 117672666: {'created_time': 1764702400.141529, 'last_price_update_time': 1764702400.141541, 'auction_closing_time': 1765275300.0}
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117672666') HTTP/1.1" 204 0
2025-12-02 19:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO70YEC/2025-11-27/image/ec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116859206?view=catalogue)
2025-12-02 19:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71EUC/2025-12-02/image/ab5bee90-b926-41dd-b0cf-e39d8575dd71_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056567?view=catalogue)
2025-12-02 19:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71EUC/2025-12-02/image/de6b3f57-9edc-43ac-91cb-e65a5565223b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056567?view=catalogue)
2025-12-02 19:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4198b1f2-00de-46a0-9429-413126326dbf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056567?view=catalogue)
2025-12-02 19:06:40 [astonbarclay.gb] INFO: Found listing with ID: 117639048
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639048%27 HTTP/1.1" 200 None
2025-12-02 19:06:40 [astonbarclay.gb] INFO: Scrape type for 117639048: 1
2025-12-02 19:06:40 [astonbarclay.gb] INFO: Found listing with ID: 117616509
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616509%27 HTTP/1.1" 200 None
2025-12-02 19:06:40 [astonbarclay.gb] INFO: Scrape type for 117616509: 2
2025-12-02 19:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0956bd0>
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F828438a4-aa79-4e52-9e51-6f3324a8512e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/828438a4-aa79-4e52-9e51-6f3324a8512e_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0906210>
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSK70RMY%252F2025-12-02%252Fimage%252F9151f589-da48-4417-bcf2-faef49c25ebd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SK70RMY/2025-12-02/image/9151f589-da48-4417-bcf2-faef49c25ebd_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24cd7134-4180-54ac-9e26-d55d082add85
2025-12-02 19:06:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24cd7134-4180-54ac-9e26-d55d082add85, skipping ID generation
2025-12-02 19:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24cd7134-4180-54ac-9e26-d55d082add85 with scrape type 1
2025-12-02 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 24cd7134-4180-54ac-9e26-d55d082add85 from tracking dictionaries
2025-12-02 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24cd7134-4180-54ac-9e26-d55d082add85 sending to next pipeline
2025-12-02 19:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 24cd7134-4180-54ac-9e26-d55d082add85, identifier: 117509758
2025-12-02 19:06:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117585347, 'registration': 'PY69KZO', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR DIESEL ESTATE', 'derivative': '2.0 D180 R-Dynamic S 5dr Auto', 'mileage': 71345, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-01-31', 'fuel': 'Diesel', 'motExpiry': '2026-02-09', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 12/21- 24K, 07/23- 54K, 07/25- 69K', 'remarks': '**54**VOSA STATES 46K, 59K, 66K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117585347, 'registration': 'PY69KZO', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR DIESEL ESTATE', 'derivative': '2.0 D180 R-Dynamic S 5dr Auto', 'mileage': 71345, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-01-31', 'fuel': 'Diesel', 'motExpiry': '2026-02-09', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 12/21- 24K, 07/23- 54K, 07/25- 69K', 'remarks': '**54**VOSA STATES 46K, 59K, 66K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed32b839-a772-5538-bdd7-e3c0c3ec3c58 with identifier: 117585347
2025-12-02 19:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed32b839-a772-5538-bdd7-e3c0c3ec3c58 with scrape type 2
2025-12-02 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed32b839-a772-5538-bdd7-e3c0c3ec3c58 with scrape type 2
2025-12-02 19:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ed32b839-a772-5538-bdd7-e3c0c3ec3c58, identifier: 117585347
2025-12-02 19:06:40 [astonbarclay.gb] INFO: Found listing with ID: 117272128
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272128%27 HTTP/1.1" 200 None
2025-12-02 19:06:40 [astonbarclay.gb] INFO: Scrape type for 117272128: 0
2025-12-02 19:06:40 [astonbarclay.gb] INFO: Found listing with ID: 60238390
2025-12-02 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2760238390%27 HTTP/1.1" 200 None
2025-12-02 19:06:41 [astonbarclay.gb] INFO: Scrape type for 60238390: 2
2025-12-02 19:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 24cd7134-4180-54ac-9e26-d55d082add85 with identifier: 117509758
2025-12-02 19:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 24cd7134-4180-54ac-9e26-d55d082add85 with identifier: 117509758
2025-12-02 19:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 24cd7134-4180-54ac-9e26-d55d082add85 with identifier: 117509758 to the API
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SK70RMY/2025-12-02/image/9151f589-da48-4417-bcf2-faef49c25ebd_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '24cd7134-4180-54ac-9e26-d55d082add85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SK70RMY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117509758',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TOYOTA',
 'model': 'PRIUS+ ESTATE',
 'odometer': 14342,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26598,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/3ea191d4-648a-47c1-a48d-8dfc98512c74_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25452,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/79d47c9d-22fc-45dc-89b2-feddc7cff6ee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28061,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cac6b749-177a-4dde-9b96-db3642025459_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26782,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/cd5b9f1f-02a9-48ae-abf5-4665540117f2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30226,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/955549cb-7f07-4edc-b6ab-f977374bed18_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58133,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/f9bbc807-2329-4bb5-993f-15c530fd5624_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51381,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/52ad17cd-0630-4e7c-a3e1-f510b84a1eb7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47344,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/eb65c259-2375-4c08-87e2-299a2ea1e42d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24cd7134-4180-54ac-9e26-d55d082add85/24cd7134-4180-54ac-9e26-d55d082add85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48646,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SK70RMY/2025-12-02/image/9151f589-da48-4417-bcf2-faef49c25ebd_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-16',
 'seller_name': 'Zenith',
 'title': 'TOYOTA PRIUS+ ESTATE 1.8 VVTi Icon TSS 5dr CVT Auto',
 'transmission': 'automatic',
 'trim': '1.8 VVTi Icon TSS 5dr CVT Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509758%27 HTTP/1.1" 200 None
2025-12-02 19:06:41 [astonbarclay.gb] INFO: Saving data for 117509758: {'created_time': 1764702401.368768, 'last_price_update_time': 1764702401.368777, 'auction_closing_time': 1764927900.0}
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117509758') HTTP/1.1" 204 0
2025-12-02 19:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ed32b839-a772-5538-bdd7-e3c0c3ec3c58 with identifier: 117585347
2025-12-02 19:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ed32b839-a772-5538-bdd7-e3c0c3ec3c58 with identifier: 117585347
2025-12-02 19:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ed32b839-a772-5538-bdd7-e3c0c3ec3c58 with identifier: 117585347 to the API
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ed32b839-a772-5538-bdd7-e3c0c3ec3c58%27 HTTP/1.1" 200 None
2025-12-02 19:06:41 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ed32b839-a772-5538-bdd7-e3c0c3ec3c58: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:41 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117585347?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ed32b839-a772-5538-bdd7-e3c0c3ec3c58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PY69KZO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585347',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR DIESEL ESTATE',
 'odometer': 71345,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-31',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER RANGE ROVER VELAR DIESEL ESTATE 2.0 D180 R-Dynamic S 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '2.0 D180 R-Dynamic S 5dr Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585347%27 HTTP/1.1" 200 None
2025-12-02 19:06:41 [astonbarclay.gb] INFO: Saving data for 117585347: {'auction_closing_time': 1765285200.0, 'created_time': 1764356657.896936, 'last_price_update_time': 1764702401.744417}
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585347') HTTP/1.1" 204 0
2025-12-02 19:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4f6990fa-e74f-4889-888e-675e3ecf6753_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056567?view=catalogue)
2025-12-02 19:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71EUC/2025-12-02/image/5fb8de11-3135-4de3-8b9e-04c190a82a67_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056567?view=catalogue)
2025-12-02 19:06:41 [astonbarclay.gb] INFO: Found listing with ID: 117366549
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366549%27 HTTP/1.1" 200 None
2025-12-02 19:06:41 [astonbarclay.gb] INFO: Scrape type for 117366549: 2
2025-12-02 19:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04649d0>
2025-12-02 19:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252Fec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/ec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c05dfe48-04df-50d0-bcd0-70853b464265
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0465250>
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252Fab5bee90-b926-41dd-b0cf-e39d8575dd71_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/ab5bee90-b926-41dd-b0cf-e39d8575dd71_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e5dd0>
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252Fde6b3f57-9edc-43ac-91cb-e65a5565223b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/de6b3f57-9edc-43ac-91cb-e65a5565223b_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0350f10>
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F4198b1f2-00de-46a0-9429-413126326dbf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4198b1f2-00de-46a0-9429-413126326dbf_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df
2025-12-02 19:06:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117600618, 'registration': 'YY22CCK', 'account': 'HAT002', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '40 TFSI Quattro Vorsprung 5dr S Tronic', 'mileage': 41808, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-04-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-26', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YY22CCK/2025-12-01/image/8653385c-446b-4de1-baa2-5bdd068c24b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/67ca57de-2c4f-4b12-8acb-b40a172efb2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/2712a7e7-aac2-47fd-9b05-722c941c767a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f6ba50cc-03ed-4a91-a78c-c07f0c797423_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/450995cd-724b-48fd-811b-43599eb75cad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/7ab7ca21-31fc-44f4-a6b2-8120750fbf9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/1a7bc335-d7b0-4257-9bfb-3920e9f718ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f581f143-23e8-4bc1-a47b-9ab712f16a2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/9861ece8-b5b0-4add-9f6f-fc36dc70ed67_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**35**VOSA STATES 35K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 177, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/785ebcb1-1c27-40ce-ace3-de70523da8ee.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117600618, 'registration': 'YY22CCK', 'account': 'HAT002', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '40 TFSI Quattro Vorsprung 5dr S Tronic', 'mileage': 41808, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-04-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-26', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YY22CCK/2025-12-01/image/8653385c-446b-4de1-baa2-5bdd068c24b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/67ca57de-2c4f-4b12-8acb-b40a172efb2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/2712a7e7-aac2-47fd-9b05-722c941c767a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f6ba50cc-03ed-4a91-a78c-c07f0c797423_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/450995cd-724b-48fd-811b-43599eb75cad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/7ab7ca21-31fc-44f4-a6b2-8120750fbf9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/1a7bc335-d7b0-4257-9bfb-3920e9f718ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f581f143-23e8-4bc1-a47b-9ab712f16a2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/9861ece8-b5b0-4add-9f6f-fc36dc70ed67_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**35**VOSA STATES 35K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 177, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/785ebcb1-1c27-40ce-ace3-de70523da8ee.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a728f23-a2e4-58e0-9257-1bf0dccb119d with identifier: 117600618
2025-12-02 19:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d with scrape type 2
2025-12-02 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d with scrape type 2
2025-12-02 19:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8a728f23-a2e4-58e0-9257-1bf0dccb119d, identifier: 117600618
2025-12-02 19:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8a728f23-a2e4-58e0-9257-1bf0dccb119d with identifier: 117600618
2025-12-02 19:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8a728f23-a2e4-58e0-9257-1bf0dccb119d with identifier: 117600618
2025-12-02 19:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8a728f23-a2e4-58e0-9257-1bf0dccb119d with identifier: 117600618 to the API
2025-12-02 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8a728f23-a2e4-58e0-9257-1bf0dccb119d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YY22CCK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600618',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 41808,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-27',
 'seller_name': 'Hatfields Group',
 'title': 'AUDI Q2 ESTATE 40 TFSI Quattro Vorsprung 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '40 TFSI Quattro Vorsprung 5dr S Tronic',
 'vin': None,
 'year': 2022}
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600618%27 HTTP/1.1" 200 None
2025-12-02 19:06:43 [astonbarclay.gb] INFO: Saving data for 117600618: {'auction_closing_time': 1765285200.0, 'created_time': 1764615732.188233, 'last_price_update_time': 1764702403.143124}
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117600618') HTTP/1.1" 204 0
2025-12-02 19:06:43 [astonbarclay.gb] INFO: Found listing with ID: 117578188
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117578188%27 HTTP/1.1" 200 None
2025-12-02 19:06:43 [astonbarclay.gb] INFO: Scrape type for 117578188: 2
2025-12-02 19:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4630e4b4-bde8-4b29-a17e-eaa775fc7d3d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056567?view=catalogue)
2025-12-02 19:06:43 [astonbarclay.gb] INFO: Found listing with ID: 116288981
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116288981%27 HTTP/1.1" 200 None
2025-12-02 19:06:43 [astonbarclay.gb] INFO: Scrape type for 116288981: 2
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0833e90>
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F4f6990fa-e74f-4889-888e-675e3ecf6753_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4f6990fa-e74f-4889-888e-675e3ecf6753_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0918290>
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F5fb8de11-3135-4de3-8b9e-04c190a82a67_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/5fb8de11-3135-4de3-8b9e-04c190a82a67_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df
2025-12-02 19:06:43 [astonbarclay.gb] INFO: Found listing with ID: 116896181
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116896181%27 HTTP/1.1" 200 None
2025-12-02 19:06:43 [astonbarclay.gb] INFO: Scrape type for 116896181: 2
2025-12-02 19:06:43 [astonbarclay.gb] INFO: Found listing with ID: 117547822
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547822%27 HTTP/1.1" 200 None
2025-12-02 19:06:43 [astonbarclay.gb] INFO: Scrape type for 117547822: 2
2025-12-02 19:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585035?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0343310>
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71EUC%252F2025-12-02%252Fimage%252F4630e4b4-bde8-4b29-a17e-eaa775fc7d3d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4630e4b4-bde8-4b29-a17e-eaa775fc7d3d_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df
2025-12-02 19:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8a00263-de51-5a58-b8c9-a7d4db7fe8df, skipping ID generation
2025-12-02 19:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df with scrape type 1
2025-12-02 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b8a00263-de51-5a58-b8c9-a7d4db7fe8df from tracking dictionaries
2025-12-02 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8a00263-de51-5a58-b8c9-a7d4db7fe8df sending to next pipeline
2025-12-02 19:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b8a00263-de51-5a58-b8c9-a7d4db7fe8df, identifier: 117056567
2025-12-02 19:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b8a00263-de51-5a58-b8c9-a7d4db7fe8df with identifier: 117056567
2025-12-02 19:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b8a00263-de51-5a58-b8c9-a7d4db7fe8df with identifier: 117056567
2025-12-02 19:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b8a00263-de51-5a58-b8c9-a7d4db7fe8df with identifier: 117056567 to the API
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4630e4b4-bde8-4b29-a17e-eaa775fc7d3d_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'b8a00263-de51-5a58-b8c9-a7d4db7fe8df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MF71EUC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117056567',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'CITROEN',
 'model': 'C4 HATCHBACK',
 'odometer': 31461,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28940,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/f2ffcd16-e17c-4564-95d3-4a2f45b365a3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32637,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/3c160e68-5dcd-4aba-b4af-7ae20c068e03_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29957,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/828438a4-aa79-4e52-9e51-6f3324a8512e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28576,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4198b1f2-00de-46a0-9429-413126326dbf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38285,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/ab5bee90-b926-41dd-b0cf-e39d8575dd71_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59979,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/de6b3f57-9edc-43ac-91cb-e65a5565223b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52397,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/5fb8de11-3135-4de3-8b9e-04c190a82a67_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48648,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4f6990fa-e74f-4889-888e-675e3ecf6753_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a00263-de51-5a58-b8c9-a7d4db7fe8df/b8a00263-de51-5a58-b8c9-a7d4db7fe8df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55957,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71EUC/2025-12-02/image/4630e4b4-bde8-4b29-a17e-eaa775fc7d3d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-31',
 'seller_name': 'Zenith',
 'title': 'CITROEN C4 HATCHBACK 1.2 PureTech [130] Sense Plus 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech [130] Sense Plus 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117056567%27 HTTP/1.1" 200 None
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Saving data for 117056567: {'created_time': 1764702404.444266, 'last_price_update_time': 1764702404.444277, 'auction_closing_time': 1764927900.0}
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117056567') HTTP/1.1" 204 0
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Found listing with ID: 117604369
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117604369%27 HTTP/1.1" 200 None
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Scrape type for 117604369: 2
2025-12-02 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117587813?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585151?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117600700?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117661902?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117599947?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584969?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Found listing with ID: 117547832
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547832%27 HTTP/1.1" 200 None
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Scrape type for 117547832: 2
2025-12-02 19:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117585035, 'registration': 'OV69HFT', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 D240 R-Dynamic HSE 5dr Auto', 'mileage': 52914, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-09-27', 'fuel': 'Diesel', 'motExpiry': '2026-10-06', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 09/21- 16K', 'remarks': '**40**VOSA STATES 23K, 30K, 39K, 50K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117585035, 'registration': 'OV69HFT', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 D240 R-Dynamic HSE 5dr Auto', 'mileage': 52914, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-09-27', 'fuel': 'Diesel', 'motExpiry': '2026-10-06', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 09/21- 16K', 'remarks': '**40**VOSA STATES 23K, 30K, 39K, 50K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee3a23a9-cc41-530c-b915-b3bb5044ff0a with identifier: 117585035
2025-12-02 19:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3a23a9-cc41-530c-b915-b3bb5044ff0a with scrape type 2
2025-12-02 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee3a23a9-cc41-530c-b915-b3bb5044ff0a with scrape type 2
2025-12-02 19:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ee3a23a9-cc41-530c-b915-b3bb5044ff0a, identifier: 117585035
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Found listing with ID: 117604347
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117604347%27 HTTP/1.1" 200 None
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Scrape type for 117604347: 2
2025-12-02 19:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ee3a23a9-cc41-530c-b915-b3bb5044ff0a with identifier: 117585035
2025-12-02 19:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ee3a23a9-cc41-530c-b915-b3bb5044ff0a with identifier: 117585035
2025-12-02 19:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ee3a23a9-cc41-530c-b915-b3bb5044ff0a with identifier: 117585035 to the API
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ee3a23a9-cc41-530c-b915-b3bb5044ff0a%27 HTTP/1.1" 200 None
2025-12-02 19:06:44 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ee3a23a9-cc41-530c-b915-b3bb5044ff0a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:44 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117585035?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ee3a23a9-cc41-530c-b915-b3bb5044ff0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OV69HFT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585035',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL SW',
 'odometer': 52914,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-27',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 D240 R-Dynamic HSE 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '2.0 D240 R-Dynamic HSE 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585035%27 HTTP/1.1" 200 None
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Saving data for 117585035: {'auction_closing_time': 1765285200.0, 'created_time': 1764356636.483437, 'last_price_update_time': 1764702404.881056}
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585035') HTTP/1.1" 204 0
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Found listing with ID: 117627838
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627838%27 HTTP/1.1" 200 None
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Scrape type for 117627838: 2
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117587813, 'registration': 'CA22JZX', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.0T GDi Exclusive 5dr DCT', 'mileage': 19118, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-05-10', 'fuel': 'Petrol', 'motExpiry': '2026-05-09', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CA22JZX/2025-11-28/image/89b9e7e0-8802-43f4-b854-19248ce550ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/a5537fb9-3970-48d1-b379-2d991174c191_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/7c1a4d1d-10d4-4b46-9987-82a584278737_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/9d3ffa21-2b55-470a-b09f-b13879f5ea9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/61b4dbe7-7497-456f-9f22-a39c1c5c2f48_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/c2955912-426f-4433-b224-9c27b0138a30_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/24d41b85-7534-4e48-9cf6-6299e33391fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/c34aa3b8-c5ca-4dfb-a337-73d589a7d53c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 05/23-3k 05/24-7k 09/25-15k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a10637a5-4968-4a6f-ab98-b71f35f55509.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117587813, 'registration': 'CA22JZX', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.0T GDi Exclusive 5dr DCT', 'mileage': 19118, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-05-10', 'fuel': 'Petrol', 'motExpiry': '2026-05-09', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CA22JZX/2025-11-28/image/89b9e7e0-8802-43f4-b854-19248ce550ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/a5537fb9-3970-48d1-b379-2d991174c191_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/7c1a4d1d-10d4-4b46-9987-82a584278737_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/9d3ffa21-2b55-470a-b09f-b13879f5ea9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/61b4dbe7-7497-456f-9f22-a39c1c5c2f48_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/c2955912-426f-4433-b224-9c27b0138a30_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/24d41b85-7534-4e48-9cf6-6299e33391fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/CA22JZX/2025-11-28/image/c34aa3b8-c5ca-4dfb-a337-73d589a7d53c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 05/23-3k 05/24-7k 09/25-15k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a10637a5-4968-4a6f-ab98-b71f35f55509.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ceebb90-fc72-5030-909c-7034cdd3c138 with identifier: 117587813
2025-12-02 19:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ceebb90-fc72-5030-909c-7034cdd3c138 with scrape type 2
2025-12-02 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ceebb90-fc72-5030-909c-7034cdd3c138 with scrape type 2
2025-12-02 19:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3ceebb90-fc72-5030-909c-7034cdd3c138, identifier: 117587813
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117610728, 'registration': 'KP67NPA', 'account': 'VAN040', 'make': 'VOLVO', 'model': 'XC60 DIESEL ESTATE', 'derivative': 'D4 [190] R DESIGN Lux Nav 5dr AWD Geartronic', 'mileage': 53987, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-09-29', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 2400, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KP67NPA/2025-12-02/image/01682462-8486-4abf-a709-cad2a23cddea_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/d5339400-bdec-415c-9404-0bac06c04797_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/dea4c500-3a5e-4c0a-8705-6472807de924_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/a6b19ada-14e6-448d-8cf3-07d7fa192a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/78b0acc1-20ab-42d9-bed6-73969b01ecd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/e30326fb-1ae0-451e-9764-2c4abc96134d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/27221e41-2c05-4de8-96dc-8fa18bc3b516_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/33d7e21a-a79f-4281-9f77-297251c88550_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/63d7a56b-9557-4a29-b218-3b7f880068be_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES  24K, 27K, 34K, 42K,46K, 52K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1425833a-2111-419f-a231-19d3721d45dc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117610728, 'registration': 'KP67NPA', 'account': 'VAN040', 'make': 'VOLVO', 'model': 'XC60 DIESEL ESTATE', 'derivative': 'D4 [190] R DESIGN Lux Nav 5dr AWD Geartronic', 'mileage': 53987, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-09-29', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 2400, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KP67NPA/2025-12-02/image/01682462-8486-4abf-a709-cad2a23cddea_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/d5339400-bdec-415c-9404-0bac06c04797_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/dea4c500-3a5e-4c0a-8705-6472807de924_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/a6b19ada-14e6-448d-8cf3-07d7fa192a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/78b0acc1-20ab-42d9-bed6-73969b01ecd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/e30326fb-1ae0-451e-9764-2c4abc96134d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/27221e41-2c05-4de8-96dc-8fa18bc3b516_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/33d7e21a-a79f-4281-9f77-297251c88550_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP67NPA/2025-12-02/image/63d7a56b-9557-4a29-b218-3b7f880068be_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES  24K, 27K, 34K, 42K,46K, 52K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1425833a-2111-419f-a231-19d3721d45dc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b4471d1-1330-5f18-bc6b-f50165d7cebc with identifier: 117610728
2025-12-02 19:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc with scrape type 2
2025-12-02 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc with scrape type 2
2025-12-02 19:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9b4471d1-1330-5f18-bc6b-f50165d7cebc, identifier: 117610728
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117585151, 'registration': 'OY17UTR', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE Dynamic Lux 5dr Auto', 'mileage': 62731, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-17', 'fuel': 'Diesel', 'motExpiry': '2026-12-02', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/17- 10 MILES', 'remarks': '**17**VOSA STATES 27K, 34K, 41K, 49K, 54K, 62K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117585151, 'registration': 'OY17UTR', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE Dynamic Lux 5dr Auto', 'mileage': 62731, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-17', 'fuel': 'Diesel', 'motExpiry': '2026-12-02', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/17- 10 MILES', 'remarks': '**17**VOSA STATES 27K, 34K, 41K, 49K, 54K, 62K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d849d9b3-540a-5fba-ac27-78fcc3987177 with identifier: 117585151
2025-12-02 19:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d849d9b3-540a-5fba-ac27-78fcc3987177 with scrape type 2
2025-12-02 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d849d9b3-540a-5fba-ac27-78fcc3987177 with scrape type 2
2025-12-02 19:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d849d9b3-540a-5fba-ac27-78fcc3987177, identifier: 117585151
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117600700, 'registration': 'DV18KZS', 'account': 'HAT002', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '2.0d [240] R-Sport 5dr Auto AWD', 'mileage': 66511, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-30', 'fuel': 'Diesel', 'motExpiry': '2026-05-03', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV18KZS/2025-12-02/image/514f60e3-f7ef-469a-bee3-42b1c9c4323e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/4608b184-7d62-42b1-adcd-ca0891b486e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/be334b2e-370f-4eaf-8685-9cca1bd97737_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/86aa490e-ffe9-4150-9efd-d2562a63ac67_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/a95a0504-c383-4b8e-8109-89e89074759e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/8861adf4-fe75-4a1b-b176-ecaeab07a64a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/ffe57657-1a45-4300-8db3-f022ae6d066a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/a05044b6-2a3c-4bcc-82a5-de429610aef4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/9f2674b9-572c-4eb1-88bf-e38bd4f1fc84_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/20 - 16K, 05/23 - 41K, 04/24 - 51K, 04/25 - 61K', 'remarks': '**118**VOSA STATES 20K, 32K, 41K, 51K, 61K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd8682d3-d18c-4d81-a4e2-f6570989d77c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117600700, 'registration': 'DV18KZS', 'account': 'HAT002', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '2.0d [240] R-Sport 5dr Auto AWD', 'mileage': 66511, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-30', 'fuel': 'Diesel', 'motExpiry': '2026-05-03', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV18KZS/2025-12-02/image/514f60e3-f7ef-469a-bee3-42b1c9c4323e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/4608b184-7d62-42b1-adcd-ca0891b486e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/be334b2e-370f-4eaf-8685-9cca1bd97737_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/86aa490e-ffe9-4150-9efd-d2562a63ac67_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/a95a0504-c383-4b8e-8109-89e89074759e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/8861adf4-fe75-4a1b-b176-ecaeab07a64a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/ffe57657-1a45-4300-8db3-f022ae6d066a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/a05044b6-2a3c-4bcc-82a5-de429610aef4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18KZS/2025-12-02/image/9f2674b9-572c-4eb1-88bf-e38bd4f1fc84_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/20 - 16K, 05/23 - 41K, 04/24 - 51K, 04/25 - 61K', 'remarks': '**118**VOSA STATES 20K, 32K, 41K, 51K, 61K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd8682d3-d18c-4d81-a4e2-f6570989d77c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f89c58f-e03d-5c98-965b-ba8f4af08b6e with identifier: 117600700
2025-12-02 19:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f89c58f-e03d-5c98-965b-ba8f4af08b6e with scrape type 2
2025-12-02 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f89c58f-e03d-5c98-965b-ba8f4af08b6e with scrape type 2
2025-12-02 19:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9f89c58f-e03d-5c98-965b-ba8f4af08b6e, identifier: 117600700
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117661902, 'registration': 'OE66YRM', 'account': 'THE109', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': 'S3 TFSI Quattro 5dr S Tronic', 'mileage': 108739, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-02-28', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OE66YRM/2025-12-02/image/5e131098-c1b2-4dde-b3fb-21dbedc3facf_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/83bc3a13-bb7f-43a7-b4ac-fa9c251713d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/6b063875-cb62-45a0-9556-4e4fef4efcbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/2420e951-4909-4a1b-ab5a-e288b31a72c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/9d23a6e6-be1e-4092-9ff8-635f89a6e59b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/ed51126b-ad34-4fcc-a50f-dab0b94dd098_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/bd8a17c3-bae6-4a05-9b4f-6aee388bae72_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/07047dc9-b3c1-4a5a-b79c-50a8abd444b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/cfd7809c-a05b-462d-a58e-94160face48f_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/19 - 8K, 06/21 - 30K, 02/22 - 43K, 11/22 - 58K, 06/23 - 71K, 03/24 - 86K, 11/24 - 95K, 05/25 - 103K', 'remarks': 'STOLEN/RECOVERED - Damage is vandalism and all over **454** VOSA STATES 24K, 28K, 30K, 51K, 71K, 89K, 103K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f56d567c-ecea-474c-86bb-e40a8d1a89e6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117661902, 'registration': 'OE66YRM', 'account': 'THE109', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': 'S3 TFSI Quattro 5dr S Tronic', 'mileage': 108739, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-02-28', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OE66YRM/2025-12-02/image/5e131098-c1b2-4dde-b3fb-21dbedc3facf_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/83bc3a13-bb7f-43a7-b4ac-fa9c251713d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/6b063875-cb62-45a0-9556-4e4fef4efcbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/2420e951-4909-4a1b-ab5a-e288b31a72c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/9d23a6e6-be1e-4092-9ff8-635f89a6e59b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/ed51126b-ad34-4fcc-a50f-dab0b94dd098_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/bd8a17c3-bae6-4a05-9b4f-6aee388bae72_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/07047dc9-b3c1-4a5a-b79c-50a8abd444b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/cfd7809c-a05b-462d-a58e-94160face48f_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/19 - 8K, 06/21 - 30K, 02/22 - 43K, 11/22 - 58K, 06/23 - 71K, 03/24 - 86K, 11/24 - 95K, 05/25 - 103K', 'remarks': 'STOLEN/RECOVERED - Damage is vandalism and all over **454** VOSA STATES 24K, 28K, 30K, 51K, 71K, 89K, 103K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f56d567c-ecea-474c-86bb-e40a8d1a89e6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcbfe262-0cd0-58f8-8272-316c72d4e4a3 with identifier: 117661902
2025-12-02 19:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3 with scrape type 1
2025-12-02 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3
2025-12-02 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F5e131098-c1b2-4dde-b3fb-21dbedc3facf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/5e131098-c1b2-4dde-b3fb-21dbedc3facf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117599947, 'registration': 'BD21FHO', 'account': 'HAT004', 'make': 'BMW', 'model': 'X7 DIESEL ESTATE', 'derivative': 'xDrive M50d 5dr Step Auto', 'mileage': 99082, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-04-30', 'fuel': 'Diesel', 'motExpiry': '2026-05-04', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 55K, 84K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 237, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117599947, 'registration': 'BD21FHO', 'account': 'HAT004', 'make': 'BMW', 'model': 'X7 DIESEL ESTATE', 'derivative': 'xDrive M50d 5dr Step Auto', 'mileage': 99082, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-04-30', 'fuel': 'Diesel', 'motExpiry': '2026-05-04', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 55K, 84K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 237, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3b7a509-ba54-50a7-83df-018d77e5d258 with identifier: 117599947
2025-12-02 19:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3b7a509-ba54-50a7-83df-018d77e5d258 with scrape type 2
2025-12-02 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3b7a509-ba54-50a7-83df-018d77e5d258 with scrape type 2
2025-12-02 19:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b3b7a509-ba54-50a7-83df-018d77e5d258, identifier: 117599947
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584969, 'registration': 'CF70CCX', 'account': 'HAT008', 'make': 'VOLVO', 'model': 'XC90 DIESEL ESTATE', 'derivative': '2.0 B5D [235] R DESIGN 5dr AWD Geartronic', 'mileage': 88430, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-01-08', 'fuel': 'Diesel', 'motExpiry': '2026-04-29', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CF70CCX/2025-12-01/image/cca51058-b18c-4bfa-8aa8-5a9a5bc95a84_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/d1ab2738-70af-48c7-b7d1-9c32010647c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/a6808ea7-22e4-4916-af65-377c5ca3df30_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/ba665fce-853b-4eed-803f-c31f4bf82450_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/2e3cefd0-9cda-4f96-baae-479d6f58d371_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/64b3b86a-af00-4272-8ceb-605292f1c56e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/a26cc7b3-86c0-44e0-9231-5a7cffbd4abb_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/84cd6265-6424-4983-a745-3b9d7ca2346c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/c7a41600-bfdd-40ae-9500-2e759a42c9fc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/21- 18k, 08/22- 36k, 04/23-- 55k,', 'remarks': '**53**VOSA STATES 70K, 79K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 184, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/041f8e85-fa9f-47c8-b35a-324874e74434.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584969, 'registration': 'CF70CCX', 'account': 'HAT008', 'make': 'VOLVO', 'model': 'XC90 DIESEL ESTATE', 'derivative': '2.0 B5D [235] R DESIGN 5dr AWD Geartronic', 'mileage': 88430, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-01-08', 'fuel': 'Diesel', 'motExpiry': '2026-04-29', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CF70CCX/2025-12-01/image/cca51058-b18c-4bfa-8aa8-5a9a5bc95a84_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/d1ab2738-70af-48c7-b7d1-9c32010647c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/a6808ea7-22e4-4916-af65-377c5ca3df30_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/ba665fce-853b-4eed-803f-c31f4bf82450_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/2e3cefd0-9cda-4f96-baae-479d6f58d371_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/64b3b86a-af00-4272-8ceb-605292f1c56e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/a26cc7b3-86c0-44e0-9231-5a7cffbd4abb_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/84cd6265-6424-4983-a745-3b9d7ca2346c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF70CCX/2025-12-01/image/c7a41600-bfdd-40ae-9500-2e759a42c9fc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/21- 18k, 08/22- 36k, 04/23-- 55k,', 'remarks': '**53**VOSA STATES 70K, 79K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 184, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/041f8e85-fa9f-47c8-b35a-324874e74434.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfbfd018-d873-5cda-9596-37216307b4df with identifier: 117584969
2025-12-02 19:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfbfd018-d873-5cda-9596-37216307b4df with scrape type 2
2025-12-02 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfbfd018-d873-5cda-9596-37216307b4df with scrape type 2
2025-12-02 19:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bfbfd018-d873-5cda-9596-37216307b4df, identifier: 117584969
2025-12-02 19:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3ceebb90-fc72-5030-909c-7034cdd3c138 with identifier: 117587813
2025-12-02 19:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3ceebb90-fc72-5030-909c-7034cdd3c138 with identifier: 117587813
2025-12-02 19:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3ceebb90-fc72-5030-909c-7034cdd3c138 with identifier: 117587813 to the API
2025-12-02 19:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117587813?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '3ceebb90-fc72-5030-909c-7034cdd3c138',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CA22JZX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117587813',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MG MOTOR UK',
 'model': 'ZS HATCHBACK',
 'odometer': 19118,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-10',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK ZS HATCHBACK 1.0T GDi Exclusive 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.0T GDi Exclusive 5dr DCT',
 'vin': None,
 'year': 2022}
2025-12-02 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117587813%27 HTTP/1.1" 200 None
2025-12-02 19:06:45 [astonbarclay.gb] INFO: Saving data for 117587813: {'auction_closing_time': 1765275300.0, 'created_time': 1764356651.34296, 'last_price_update_time': 1764702405.755096}
2025-12-02 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117587813') HTTP/1.1" 204 0
2025-12-02 19:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9b4471d1-1330-5f18-bc6b-f50165d7cebc with identifier: 117610728
2025-12-02 19:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9b4471d1-1330-5f18-bc6b-f50165d7cebc with identifier: 117610728
2025-12-02 19:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9b4471d1-1330-5f18-bc6b-f50165d7cebc with identifier: 117610728 to the API
2025-12-02 19:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9b4471d1-1330-5f18-bc6b-f50165d7cebc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KP67NPA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117610728',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLVO',
 'model': 'XC60 DIESEL ESTATE',
 'odometer': 53987,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-29',
 'seller_name': 'Vantage Motor Group',
 'title': 'VOLVO XC60 DIESEL ESTATE D4 [190] R DESIGN Lux Nav 5dr AWD '
          'Geartronic',
 'transmission': 'automatic',
 'trim': 'D4 [190] R DESIGN Lux Nav 5dr AWD Geartronic',
 'vin': None,
 'year': 2017}
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610728%27 HTTP/1.1" 200 None
2025-12-02 19:06:46 [astonbarclay.gb] INFO: Saving data for 117610728: {'auction_closing_time': 1765285200.0, 'created_time': 1764615801.133145, 'last_price_update_time': 1764702406.035048}
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117610728') HTTP/1.1" 204 0
2025-12-02 19:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d849d9b3-540a-5fba-ac27-78fcc3987177 with identifier: 117585151
2025-12-02 19:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d849d9b3-540a-5fba-ac27-78fcc3987177 with identifier: 117585151
2025-12-02 19:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d849d9b3-540a-5fba-ac27-78fcc3987177 with identifier: 117585151 to the API
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d849d9b3-540a-5fba-ac27-78fcc3987177%27 HTTP/1.1" 200 None
2025-12-02 19:06:46 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d849d9b3-540a-5fba-ac27-78fcc3987177: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:46 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117585151?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd849d9b3-540a-5fba-ac27-78fcc3987177',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OY17UTR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585151',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL SW',
 'odometer': 62731,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-17',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 TD4 180 HSE Dynamic Lux '
          '5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 HSE Dynamic Lux 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585151%27 HTTP/1.1" 200 None
2025-12-02 19:06:46 [astonbarclay.gb] INFO: Saving data for 117585151: {'auction_closing_time': 1765285200.0, 'created_time': 1764356630.244273, 'last_price_update_time': 1764702406.325342}
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585151') HTTP/1.1" 204 0
2025-12-02 19:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9f89c58f-e03d-5c98-965b-ba8f4af08b6e with identifier: 117600700
2025-12-02 19:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9f89c58f-e03d-5c98-965b-ba8f4af08b6e with identifier: 117600700
2025-12-02 19:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9f89c58f-e03d-5c98-965b-ba8f4af08b6e with identifier: 117600700 to the API
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279f89c58f-e03d-5c98-965b-ba8f4af08b6e%27 HTTP/1.1" 200 None
2025-12-02 19:06:46 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9f89c58f-e03d-5c98-965b-ba8f4af08b6e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:46 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117600700?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9f89c58f-e03d-5c98-965b-ba8f4af08b6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DV18KZS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600700',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'JAGUAR',
 'model': 'F-PACE DIESEL ESTATE',
 'odometer': 66511,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-30',
 'seller_name': 'Hatfields Group',
 'title': 'JAGUAR F-PACE DIESEL ESTATE 2.0d [240] R-Sport 5dr Auto AWD',
 'transmission': 'automatic',
 'trim': '2.0d [240] R-Sport 5dr Auto AWD',
 'vin': None,
 'year': 2018}
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600700%27 HTTP/1.1" 200 None
2025-12-02 19:06:46 [astonbarclay.gb] INFO: Saving data for 117600700: {'auction_closing_time': 1765285200.0, 'created_time': 1764356656.673513, 'last_price_update_time': 1764702406.634113}
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117600700') HTTP/1.1" 204 0
2025-12-02 19:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b3b7a509-ba54-50a7-83df-018d77e5d258 with identifier: 117599947
2025-12-02 19:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b3b7a509-ba54-50a7-83df-018d77e5d258 with identifier: 117599947
2025-12-02 19:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159456 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159456
2025-12-02 19:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b3b7a509-ba54-50a7-83df-018d77e5d258 spider: astonbarclay.gb
2025-12-02 19:06:46 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b3b7a509-ba54-50a7-83df-018d77e5d258 due to rule: high_mileage_for_country.json, error: 159456 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159456
{'auction_title': '',
 'c_o_2_emission_value': 237,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b3b7a509-ba54-50a7-83df-018d77e5d258',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BD21FHO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599947',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': 'X7 DIESEL ESTATE',
 'odometer': 99082,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-30',
 'seller_name': 'Hatfields Group',
 'title': 'BMW X7 DIESEL ESTATE xDrive M50d 5dr Step Auto',
 'transmission': 'automatic',
 'trim': 'xDrive M50d 5dr Step Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599947%27 HTTP/1.1" 200 None
2025-12-02 19:06:46 [astonbarclay.gb] INFO: Saving data for 117599947: {'auction_closing_time': 1765285200.0, 'created_time': 1764356657.316561, 'last_price_update_time': 1764702406.845244}
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117599947') HTTP/1.1" 204 0
2025-12-02 19:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bfbfd018-d873-5cda-9596-37216307b4df with identifier: 117584969
2025-12-02 19:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bfbfd018-d873-5cda-9596-37216307b4df with identifier: 117584969
2025-12-02 19:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bfbfd018-d873-5cda-9596-37216307b4df with identifier: 117584969 to the API
2025-12-02 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27bfbfd018-d873-5cda-9596-37216307b4df%27 HTTP/1.1" 200 None
2025-12-02 19:06:47 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id bfbfd018-d873-5cda-9596-37216307b4df: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:47 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584969?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'bfbfd018-d873-5cda-9596-37216307b4df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CF70CCX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584969',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLVO',
 'model': 'XC90 DIESEL ESTATE',
 'odometer': 88430,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-08',
 'seller_name': 'Hatfields Group',
 'title': 'VOLVO XC90 DIESEL ESTATE 2.0 B5D [235] R DESIGN 5dr AWD Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 B5D [235] R DESIGN 5dr AWD Geartronic',
 'vin': None,
 'year': 2021}
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584969%27 HTTP/1.1" 200 None
2025-12-02 19:06:47 [astonbarclay.gb] INFO: Saving data for 117584969: {'auction_closing_time': 1765285200.0, 'created_time': 1764356636.763181, 'last_price_update_time': 1764702407.877644}
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584969') HTTP/1.1" 204 0
2025-12-02 19:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF71HVO/2025-12-02/image/c3911f7f-2693-468b-a529-406832ab98ab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508326?view=catalogue)
2025-12-02 19:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71SXU/2025-11-28/image/b5420aac-d50d-4345-b247-03ce6686a267_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117597727?view=catalogue)
2025-12-02 19:06:47 [astonbarclay.gb] INFO: Found listing with ID: 117585166
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585166%27 HTTP/1.1" 200 None
2025-12-02 19:06:47 [astonbarclay.gb] INFO: Scrape type for 117585166: 2
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F83bc3a13-bb7f-43a7-b4ac-fa9c251713d6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/83bc3a13-bb7f-43a7-b4ac-fa9c251713d6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117699534?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:47 [astonbarclay.gb] INFO: Found listing with ID: 117585083
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585083%27 HTTP/1.1" 200 None
2025-12-02 19:06:47 [astonbarclay.gb] INFO: Scrape type for 117585083: 2
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F6b063875-cb62-45a0-9556-4e4fef4efcbd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/6b063875-cb62-45a0-9556-4e4fef4efcbd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:47 [astonbarclay.gb] INFO: Found listing with ID: 117585141
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585141%27 HTTP/1.1" 200 None
2025-12-02 19:06:47 [astonbarclay.gb] INFO: Scrape type for 117585141: 2
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F2420e951-4909-4a1b-ab5a-e288b31a72c1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/2420e951-4909-4a1b-ab5a-e288b31a72c1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE66YRM/2025-12-02/image/5e131098-c1b2-4dde-b3fb-21dbedc3facf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661902?view=catalogue)
2025-12-02 19:06:48 [astonbarclay.gb] INFO: Found listing with ID: 117613099
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613099%27 HTTP/1.1" 200 None
2025-12-02 19:06:48 [astonbarclay.gb] INFO: Scrape type for 117613099: 2
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F9d23a6e6-be1e-4092-9ff8-635f89a6e59b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/9d23a6e6-be1e-4092-9ff8-635f89a6e59b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:48 [astonbarclay.gb] INFO: Found listing with ID: 117584951
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584951%27 HTTP/1.1" 200 None
2025-12-02 19:06:48 [astonbarclay.gb] INFO: Scrape type for 117584951: 2
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252Fed51126b-ad34-4fcc-a50f-dab0b94dd098_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/ed51126b-ad34-4fcc-a50f-dab0b94dd098_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c88b50>
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252Fc3911f7f-2693-468b-a529-406832ab98ab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/c3911f7f-2693-468b-a529-406832ab98ab_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item afc55445-065d-5656-a413-94c60897ffb6
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08e8e50>
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71SXU%252F2025-11-28%252Fimage%252Fb5420aac-d50d-4345-b247-03ce6686a267_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71SXU/2025-11-28/image/b5420aac-d50d-4345-b247-03ce6686a267_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89f3219e-41c9-557e-aed5-2984165bb017
2025-12-02 19:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89f3219e-41c9-557e-aed5-2984165bb017, skipping ID generation
2025-12-02 19:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f3219e-41c9-557e-aed5-2984165bb017 with scrape type 1
2025-12-02 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 89f3219e-41c9-557e-aed5-2984165bb017 from tracking dictionaries
2025-12-02 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89f3219e-41c9-557e-aed5-2984165bb017 sending to next pipeline
2025-12-02 19:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 89f3219e-41c9-557e-aed5-2984165bb017, identifier: 117597727
2025-12-02 19:06:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117699534, 'registration': 'RA14WLV', 'account': 'AST058', 'make': 'BMW', 'model': '', 'derivative': None, 'mileage': 72871, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': None, 'firstRegistration': '2025-06-01', 'fuel': 'Petrol', 'motExpiry': '2026-06-06', 'doors': None, 'engineSize': 2970, 'bodyType': 'Coupe', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**632** VOSA STATES 72K VEHICLE IMPORT REGISTERED KEEPERS UNKNOWN, MODEL AS SEEN  CAP FIGURES FOR GUIDE ONLY', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': True, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117699534, 'registration': 'RA14WLV', 'account': 'AST058', 'make': 'BMW', 'model': '', 'derivative': None, 'mileage': 72871, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': None, 'firstRegistration': '2025-06-01', 'fuel': 'Petrol', 'motExpiry': '2026-06-06', 'doors': None, 'engineSize': 2970, 'bodyType': 'Coupe', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**632** VOSA STATES 72K VEHICLE IMPORT REGISTERED KEEPERS UNKNOWN, MODEL AS SEEN  CAP FIGURES FOR GUIDE ONLY', 'virtual': False, 'seller': 'LDG', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': True, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:48 [astonbarclay.gb] ERROR: Error parsing details: Field transmission is not nullable
2025-12-02 19:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE66YRM/2025-12-02/image/83bc3a13-bb7f-43a7-b4ac-fa9c251713d6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661902?view=catalogue)
2025-12-02 19:06:48 [astonbarclay.gb] INFO: Found listing with ID: 117585190
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585190%27 HTTP/1.1" 200 None
2025-12-02 19:06:48 [astonbarclay.gb] INFO: Scrape type for 117585190: 2
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252Fbd8a17c3-bae6-4a05-9b4f-6aee388bae72_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/bd8a17c3-bae6-4a05-9b4f-6aee388bae72_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 89f3219e-41c9-557e-aed5-2984165bb017 with identifier: 117597727
2025-12-02 19:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 89f3219e-41c9-557e-aed5-2984165bb017 with identifier: 117597727
2025-12-02 19:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 89f3219e-41c9-557e-aed5-2984165bb017 with identifier: 117597727 to the API
2025-12-02 19:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FV71SXU/2025-11-28/image/b5420aac-d50d-4345-b247-03ce6686a267_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '89f3219e-41c9-557e-aed5-2984165bb017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FV71SXU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117597727',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 22874,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35065,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/22f75984-6a42-451d-ae5d-ed2b90b09c52_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34410,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/d0d41c1c-fbb5-4649-ac5e-c4c32b0b4cae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30333,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/b5420aac-d50d-4345-b247-03ce6686a267_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30382,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/3dfcded2-b1ee-416a-bd1d-c85f029b7722_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55616,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/df2760f0-ca5f-4451-a91a-0817448f0694_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39819,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/2c047584-fadf-43b3-805d-13e4ccbba0db_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67311,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/18b777ce-5cd1-4ad4-8ed8-03faec9ec787_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49834,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/c66716c2-934e-45c8-9a32-7734c3817805_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50987,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/f1035b6b-1cd2-47fa-ae7b-fcad68ffbf91_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f3219e-41c9-557e-aed5-2984165bb017/89f3219e-41c9-557e-aed5-2984165bb017_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57621,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71SXU/2025-11-28/image/56e9a1ef-527b-4293-9275-0fac359ae28e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': 'Zenith',
 'title': 'MINI HATCHBACK 1.5 Cooper Sport 5dr [Comfort/Nav Pack]',
 'transmission': 'manual',
 'trim': '1.5 Cooper Sport 5dr [Comfort/Nav Pack]',
 'vin': None,
 'year': 2021}
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597727%27 HTTP/1.1" 200 None
2025-12-02 19:06:50 [astonbarclay.gb] INFO: Saving data for 117597727: {'created_time': 1764702410.057787, 'last_price_update_time': 1764702410.057799, 'auction_closing_time': 1764927900.0}
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117597727') HTTP/1.1" 204 0
2025-12-02 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE66YRM/2025-12-02/image/2420e951-4909-4a1b-ab5a-e288b31a72c1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661902?view=catalogue)
2025-12-02 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117661933?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117639048?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:50 [astonbarclay.gb] INFO: Found listing with ID: 117600202
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600202%27 HTTP/1.1" 200 None
2025-12-02 19:06:50 [astonbarclay.gb] INFO: Scrape type for 117600202: 2
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F07047dc9-b3c1-4a5a-b79c-50a8abd444b8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/07047dc9-b3c1-4a5a-b79c-50a8abd444b8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584960?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117599975?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585132?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117366549?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09cc090>
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F5e131098-c1b2-4dde-b3fb-21dbedc3facf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/5e131098-c1b2-4dde-b3fb-21dbedc3facf_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf096af10>
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F83bc3a13-bb7f-43a7-b4ac-fa9c251713d6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/83bc3a13-bb7f-43a7-b4ac-fa9c251713d6_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3
2025-12-02 19:06:50 [astonbarclay.gb] INFO: Found listing with ID: 117599932
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599932%27 HTTP/1.1" 200 None
2025-12-02 19:06:50 [astonbarclay.gb] INFO: Scrape type for 117599932: 2
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252Fcfd7809c-a05b-462d-a58e-94160face48f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/cfd7809c-a05b-462d-a58e-94160face48f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE66YRM/2025-12-02/image/ed51126b-ad34-4fcc-a50f-dab0b94dd098_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661902?view=catalogue)
2025-12-02 19:06:50 [astonbarclay.gb] INFO: Found listing with ID: 117688221
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117688221%27 HTTP/1.1" 200 None
2025-12-02 19:06:50 [astonbarclay.gb] INFO: Scrape type for 117688221: 1
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf038df90>
2025-12-02 19:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F2420e951-4909-4a1b-ab5a-e288b31a72c1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/2420e951-4909-4a1b-ab5a-e288b31a72c1_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117661933, 'registration': 'BG16UZX', 'account': 'THE109', 'make': 'JAGUAR', 'model': 'XF DIESEL SALOON', 'derivative': '2.0d [180] R-Sport 4dr', 'mileage': 70228, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-07-07', 'fuel': 'Diesel', 'motExpiry': '2026-09-07', 'doors': 4, 'engineSize': 1999, 'bodyType': 'Saloon', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 42K, 48K, 52K, 57K, 61K, 64K, 69K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117661933, 'registration': 'BG16UZX', 'account': 'THE109', 'make': 'JAGUAR', 'model': 'XF DIESEL SALOON', 'derivative': '2.0d [180] R-Sport 4dr', 'mileage': 70228, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-07-07', 'fuel': 'Diesel', 'motExpiry': '2026-09-07', 'doors': 4, 'engineSize': 1999, 'bodyType': 'Saloon', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 42K, 48K, 52K, 57K, 61K, 64K, 69K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 276f7287-82d7-5f59-8eac-b9020760862c with identifier: 117661933
2025-12-02 19:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 276f7287-82d7-5f59-8eac-b9020760862c with scrape type 1
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 276f7287-82d7-5f59-8eac-b9020760862c
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 276f7287-82d7-5f59-8eac-b9020760862c
2025-12-02 19:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 276f7287-82d7-5f59-8eac-b9020760862c, identifier: 117661933
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117639048, 'registration': 'YS16HGG', 'account': 'THE109', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL ESTATE', 'derivative': 'C250d AMG Line 5dr Auto', 'mileage': 96606, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-07-14', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 26K, 33K, 38K, 50K, 66K, 78K, 93K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117639048, 'registration': 'YS16HGG', 'account': 'THE109', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL ESTATE', 'derivative': 'C250d AMG Line 5dr Auto', 'mileage': 96606, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-07-14', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 26K, 33K, 38K, 50K, 66K, 78K, 93K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bfb95ae-d71e-580e-ae84-72b96a4e695d with identifier: 117639048
2025-12-02 19:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bfb95ae-d71e-580e-ae84-72b96a4e695d with scrape type 1
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 0bfb95ae-d71e-580e-ae84-72b96a4e695d
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 0bfb95ae-d71e-580e-ae84-72b96a4e695d
2025-12-02 19:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0bfb95ae-d71e-580e-ae84-72b96a4e695d, identifier: 117639048
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584960, 'registration': 'WJ20CFP', 'account': 'HAT008', 'make': 'AUDI', 'model': 'Q5 DIESEL ESTATE', 'derivative': '40 TDI Quattro Black Edition 5dr S Tronic', 'mileage': 61218, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-03-09', 'fuel': 'Diesel', 'motExpiry': '2026-03-08', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/3efdf2ff-45c8-4181-8cf2-32dcfa1e65d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/2b492e96-6e0a-49db-b483-705235415aad_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/3931fd33-f619-449f-b32b-1293a67cfb80_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/33a8806d-fc40-4f4d-b888-a33f61716f0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/4554cd2c-6cad-451f-8638-228b3abb2da3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/148baf44-b9a2-418d-98dd-ec5c4debf0c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/82bfe520-7117-457b-8b20-325e0d45141e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/cc4b4ec6-765d-4020-8af7-c589efc3fa69_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/80989fe0-8339-4746-beb1-6a98b0e61bd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/c5f88e97-66a9-4730-bfca-26d145d1d785_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/21- 10K, 02/23- 22K, 11/23- 33K, 09/24- 47K, 02/25- 55K', 'remarks': '**47**VOSA STATES 22K, 36K, 55K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd7e07e6-7319-480e-abac-a9906b54a667.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584960, 'registration': 'WJ20CFP', 'account': 'HAT008', 'make': 'AUDI', 'model': 'Q5 DIESEL ESTATE', 'derivative': '40 TDI Quattro Black Edition 5dr S Tronic', 'mileage': 61218, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-03-09', 'fuel': 'Diesel', 'motExpiry': '2026-03-08', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/3efdf2ff-45c8-4181-8cf2-32dcfa1e65d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/2b492e96-6e0a-49db-b483-705235415aad_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/3931fd33-f619-449f-b32b-1293a67cfb80_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/33a8806d-fc40-4f4d-b888-a33f61716f0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/4554cd2c-6cad-451f-8638-228b3abb2da3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/148baf44-b9a2-418d-98dd-ec5c4debf0c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/82bfe520-7117-457b-8b20-325e0d45141e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/cc4b4ec6-765d-4020-8af7-c589efc3fa69_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/80989fe0-8339-4746-beb1-6a98b0e61bd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WJ20CFP/2025-12-01/image/c5f88e97-66a9-4730-bfca-26d145d1d785_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/21- 10K, 02/23- 22K, 11/23- 33K, 09/24- 47K, 02/25- 55K', 'remarks': '**47**VOSA STATES 22K, 36K, 55K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd7e07e6-7319-480e-abac-a9906b54a667.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec0010b-9951-50e3-a000-c1bf6ad52b50 with identifier: 117584960
2025-12-02 19:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec0010b-9951-50e3-a000-c1bf6ad52b50 with scrape type 2
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec0010b-9951-50e3-a000-c1bf6ad52b50 with scrape type 2
2025-12-02 19:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eec0010b-9951-50e3-a000-c1bf6ad52b50, identifier: 117584960
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117599975, 'registration': 'WJ68ATU', 'account': 'HAT004', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE 5dr Auto', 'mileage': 55488, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-09-17', 'fuel': 'Diesel', 'motExpiry': '2026-09-16', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 27K, 34K, 42K, 48K, 54K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 170, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117599975, 'registration': 'WJ68ATU', 'account': 'HAT004', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE 5dr Auto', 'mileage': 55488, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-09-17', 'fuel': 'Diesel', 'motExpiry': '2026-09-16', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 27K, 34K, 42K, 48K, 54K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 170, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d7401b8-fcd4-5c52-96ae-33eadd9fe193 with identifier: 117599975
2025-12-02 19:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d7401b8-fcd4-5c52-96ae-33eadd9fe193 with scrape type 1
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 4d7401b8-fcd4-5c52-96ae-33eadd9fe193
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 4d7401b8-fcd4-5c52-96ae-33eadd9fe193
2025-12-02 19:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4d7401b8-fcd4-5c52-96ae-33eadd9fe193, identifier: 117599975
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117585132, 'registration': 'YC21JHF', 'account': 'HAT007', 'make': 'SKODA', 'model': 'OCTAVIA HATCHBACK', 'derivative': '2.0 TSI vRS 5dr', 'mileage': 11038, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-06-25', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 5K, 9K,', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117585132, 'registration': 'YC21JHF', 'account': 'HAT007', 'make': 'SKODA', 'model': 'OCTAVIA HATCHBACK', 'derivative': '2.0 TSI vRS 5dr', 'mileage': 11038, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-06-25', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 5K, 9K,', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51a2e986-848d-50f8-a2b7-c8a1a2aa270b with identifier: 117585132
2025-12-02 19:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51a2e986-848d-50f8-a2b7-c8a1a2aa270b with scrape type 2
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51a2e986-848d-50f8-a2b7-c8a1a2aa270b with scrape type 2
2025-12-02 19:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 51a2e986-848d-50f8-a2b7-c8a1a2aa270b, identifier: 117585132
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117616509, 'registration': 'HT66VBN', 'account': 'VAN040', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '0.9 TCE 90 Dynamique S Nav 5dr', 'mileage': 62126, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-02-20', 'fuel': 'Petrol', 'motExpiry': '2026-09-13', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HT66VBN/2025-12-02/image/861e5a48-41d4-40d8-a492-33a0f8be4571_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/16598cbb-fef3-4b00-bc66-adba364d5914_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/8f5dbe5a-f739-4214-813a-407ea2f8148b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/1dece3be-0e0b-44fb-916a-67b07b9b1b53_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/a53fd7eb-908e-4291-9fa1-7b61cedebea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/0f550065-8469-464a-b84b-2bbce1d5486f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/372b8bdc-7045-42bb-84b5-17b21b969625_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/fa058ffb-0266-494b-b011-fd99b9a3ff33_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/f7a76110-50a2-46b1-8b98-5b22c229c258_removebg.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 25K, 29K, 29K, 36K, 44K, 51K 59K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7f9b53e5-44de-4c5f-90f2-b793c12e5350.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117616509, 'registration': 'HT66VBN', 'account': 'VAN040', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '0.9 TCE 90 Dynamique S Nav 5dr', 'mileage': 62126, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-02-20', 'fuel': 'Petrol', 'motExpiry': '2026-09-13', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HT66VBN/2025-12-02/image/861e5a48-41d4-40d8-a492-33a0f8be4571_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/16598cbb-fef3-4b00-bc66-adba364d5914_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/8f5dbe5a-f739-4214-813a-407ea2f8148b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/1dece3be-0e0b-44fb-916a-67b07b9b1b53_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/a53fd7eb-908e-4291-9fa1-7b61cedebea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/0f550065-8469-464a-b84b-2bbce1d5486f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/372b8bdc-7045-42bb-84b5-17b21b969625_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/fa058ffb-0266-494b-b011-fd99b9a3ff33_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT66VBN/2025-12-02/image/f7a76110-50a2-46b1-8b98-5b22c229c258_removebg.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 25K, 29K, 29K, 36K, 44K, 51K 59K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7f9b53e5-44de-4c5f-90f2-b793c12e5350.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with identifier: 117616509
2025-12-02 19:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with scrape type 2
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with scrape type 2
2025-12-02 19:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c2baa3a6-d796-5fe7-92d1-862ebf3d40ce, identifier: 117616509
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117366549, 'registration': 'AGZ6324', 'account': 'ZUT001', 'make': 'PEUGEOT', 'model': '308 DIESEL HATCHBACK', 'derivative': '2.0 BlueHDi 180 GT 5dr EAT6', 'mileage': 81197, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-01-29', 'fuel': 'Diesel', 'motExpiry': '2025-11-01', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38c76a2d-bd26-4a20-ae91-47ad52873139_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/82383630-4335-41a7-accc-e663916cc43f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/c4816a9a-bec7-4018-aa0e-12a4af35d00e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/32fb6d3b-f9f0-4692-9be9-cc39a5c3ed36_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/51b98e9a-1ced-4cce-8c82-14bd500e0a3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38e90add-4c25-423d-8f23-4d4c55296da8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/677c4639-db7f-4981-b0cd-1eace3bbaf49_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/1e157848-7440-412b-ba3f-c616f234cca1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/4c4b08ca-f6e7-4fc6-9f40-7f0695d05a60_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 57K,70K, 75K, 77K, 77K, 77K,', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117366549, 'registration': 'AGZ6324', 'account': 'ZUT001', 'make': 'PEUGEOT', 'model': '308 DIESEL HATCHBACK', 'derivative': '2.0 BlueHDi 180 GT 5dr EAT6', 'mileage': 81197, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-01-29', 'fuel': 'Diesel', 'motExpiry': '2025-11-01', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38c76a2d-bd26-4a20-ae91-47ad52873139_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/82383630-4335-41a7-accc-e663916cc43f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/c4816a9a-bec7-4018-aa0e-12a4af35d00e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/32fb6d3b-f9f0-4692-9be9-cc39a5c3ed36_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/51b98e9a-1ced-4cce-8c82-14bd500e0a3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38e90add-4c25-423d-8f23-4d4c55296da8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/677c4639-db7f-4981-b0cd-1eace3bbaf49_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/1e157848-7440-412b-ba3f-c616f234cca1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/4c4b08ca-f6e7-4fc6-9f40-7f0695d05a60_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 57K,70K, 75K, 77K, 77K, 77K,', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1d41c3-9a55-5035-95b3-78f2642f8712 with identifier: 117366549
2025-12-02 19:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1d41c3-9a55-5035-95b3-78f2642f8712 with scrape type 2
2025-12-02 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d1d41c3-9a55-5035-95b3-78f2642f8712 with scrape type 2
2025-12-02 19:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8d1d41c3-9a55-5035-95b3-78f2642f8712, identifier: 117366549
2025-12-02 19:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE66YRM/2025-12-02/image/07047dc9-b3c1-4a5a-b79c-50a8abd444b8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661902?view=catalogue)
2025-12-02 19:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE66YRM/2025-12-02/image/bd8a17c3-bae6-4a05-9b4f-6aee388bae72_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661902?view=catalogue)
2025-12-02 19:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE66YRM/2025-12-02/image/9d23a6e6-be1e-4092-9ff8-635f89a6e59b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661902?view=catalogue)
2025-12-02 19:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 276f7287-82d7-5f59-8eac-b9020760862c with identifier: 117661933
2025-12-02 19:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 276f7287-82d7-5f59-8eac-b9020760862c with identifier: 117661933
2025-12-02 19:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 276f7287-82d7-5f59-8eac-b9020760862c with identifier: 117661933 to the API
2025-12-02 19:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27276f7287-82d7-5f59-8eac-b9020760862c%27 HTTP/1.1" 200 None
2025-12-02 19:06:52 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 276f7287-82d7-5f59-8eac-b9020760862c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:52 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117661933?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '276f7287-82d7-5f59-8eac-b9020760862c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BG16UZX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117661933',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'JAGUAR',
 'model': 'XF DIESEL SALOON',
 'odometer': 70228,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-07',
 'seller_name': 'TCB Group - Prime',
 'title': 'JAGUAR XF DIESEL SALOON 2.0d [180] R-Sport 4dr',
 'transmission': 'manual',
 'trim': '2.0d [180] R-Sport 4dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661933%27 HTTP/1.1" 200 None
2025-12-02 19:06:52 [astonbarclay.gb] INFO: Saving data for 117661933: {'created_time': 1764702412.17521, 'last_price_update_time': 1764702412.175221, 'auction_closing_time': 1765285200.0}
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117661933') HTTP/1.1" 204 0
2025-12-02 19:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0bfb95ae-d71e-580e-ae84-72b96a4e695d with identifier: 117639048
2025-12-02 19:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0bfb95ae-d71e-580e-ae84-72b96a4e695d with identifier: 117639048
2025-12-02 19:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155471 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155471
2025-12-02 19:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0bfb95ae-d71e-580e-ae84-72b96a4e695d spider: astonbarclay.gb
2025-12-02 19:06:52 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0bfb95ae-d71e-580e-ae84-72b96a4e695d due to rule: high_mileage_for_country.json, error: 155471 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155471
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '0bfb95ae-d71e-580e-ae84-72b96a4e695d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YS16HGG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117639048',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS DIESEL ESTATE',
 'odometer': 96606,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': 'TCB Group - Prime',
 'title': 'MERCEDES-BENZ C CLASS DIESEL ESTATE C250d AMG Line 5dr Auto',
 'transmission': 'automatic',
 'trim': 'C250d AMG Line 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639048%27 HTTP/1.1" 200 None
2025-12-02 19:06:52 [astonbarclay.gb] INFO: Saving data for 117639048: {'created_time': 1764702412.570651, 'last_price_update_time': 1764702412.570661, 'auction_closing_time': 1765285200.0}
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117639048') HTTP/1.1" 204 0
2025-12-02 19:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eec0010b-9951-50e3-a000-c1bf6ad52b50 with identifier: 117584960
2025-12-02 19:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eec0010b-9951-50e3-a000-c1bf6ad52b50 with identifier: 117584960
2025-12-02 19:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: eec0010b-9951-50e3-a000-c1bf6ad52b50 with identifier: 117584960 to the API
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27eec0010b-9951-50e3-a000-c1bf6ad52b50%27 HTTP/1.1" 200 None
2025-12-02 19:06:52 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id eec0010b-9951-50e3-a000-c1bf6ad52b50: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:52 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584960?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'eec0010b-9951-50e3-a000-c1bf6ad52b50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WJ20CFP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584960',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q5 DIESEL ESTATE',
 'odometer': 61218,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': 'Hatfields Group',
 'title': 'AUDI Q5 DIESEL ESTATE 40 TDI Quattro Black Edition 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '40 TDI Quattro Black Edition 5dr S Tronic',
 'vin': None,
 'year': 2020}
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584960%27 HTTP/1.1" 200 None
2025-12-02 19:06:52 [astonbarclay.gb] INFO: Saving data for 117584960: {'auction_closing_time': 1765285200.0, 'created_time': 1764356649.740277, 'last_price_update_time': 1764702412.865366}
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584960') HTTP/1.1" 204 0
2025-12-02 19:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4d7401b8-fcd4-5c52-96ae-33eadd9fe193 with identifier: 117599975
2025-12-02 19:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4d7401b8-fcd4-5c52-96ae-33eadd9fe193 with identifier: 117599975
2025-12-02 19:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4d7401b8-fcd4-5c52-96ae-33eadd9fe193 with identifier: 117599975 to the API
2025-12-02 19:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274d7401b8-fcd4-5c52-96ae-33eadd9fe193%27 HTTP/1.1" 200 None
2025-12-02 19:06:53 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4d7401b8-fcd4-5c52-96ae-33eadd9fe193: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:53 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117599975?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '4d7401b8-fcd4-5c52-96ae-33eadd9fe193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WJ68ATU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599975',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL SW',
 'odometer': 55488,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 TD4 180 HSE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 HSE 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599975%27 HTTP/1.1" 200 None
2025-12-02 19:06:53 [astonbarclay.gb] INFO: Saving data for 117599975: {'created_time': 1764702413.159772, 'last_price_update_time': 1764702413.159784, 'auction_closing_time': 1765285200.0}
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117599975') HTTP/1.1" 204 0
2025-12-02 19:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 51a2e986-848d-50f8-a2b7-c8a1a2aa270b with identifier: 117585132
2025-12-02 19:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 51a2e986-848d-50f8-a2b7-c8a1a2aa270b with identifier: 117585132
2025-12-02 19:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 51a2e986-848d-50f8-a2b7-c8a1a2aa270b with identifier: 117585132 to the API
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2751a2e986-848d-50f8-a2b7-c8a1a2aa270b%27 HTTP/1.1" 200 None
2025-12-02 19:06:53 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 51a2e986-848d-50f8-a2b7-c8a1a2aa270b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:53 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117585132?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '51a2e986-848d-50f8-a2b7-c8a1a2aa270b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YC21JHF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585132',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'SKODA',
 'model': 'OCTAVIA HATCHBACK',
 'odometer': 11038,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-25',
 'seller_name': 'Hatfields Group',
 'title': 'SKODA OCTAVIA HATCHBACK 2.0 TSI vRS 5dr',
 'transmission': 'manual',
 'trim': '2.0 TSI vRS 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585132%27 HTTP/1.1" 200 None
2025-12-02 19:06:53 [astonbarclay.gb] INFO: Saving data for 117585132: {'auction_closing_time': 1765285200.0, 'created_time': 1764356650.274295, 'last_price_update_time': 1764702413.428402}
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585132') HTTP/1.1" 204 0
2025-12-02 19:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with identifier: 117616509
2025-12-02 19:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with identifier: 117616509
2025-12-02 19:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with identifier: 117616509 to the API
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c2baa3a6-d796-5fe7-92d1-862ebf3d40ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HT66VBN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117616509',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 62126,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': 'Vantage Motor Group',
 'title': 'RENAULT CAPTUR HATCHBACK 0.9 TCE 90 Dynamique S Nav 5dr',
 'transmission': 'manual',
 'trim': '0.9 TCE 90 Dynamique S Nav 5dr',
 'vin': None,
 'year': 2017}
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616509%27 HTTP/1.1" 200 None
2025-12-02 19:06:53 [astonbarclay.gb] INFO: Saving data for 117616509: {'auction_closing_time': 1765285200.0, 'created_time': 1764615731.809833, 'last_price_update_time': 1764702413.705791}
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117616509') HTTP/1.1" 204 0
2025-12-02 19:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8d1d41c3-9a55-5035-95b3-78f2642f8712 with identifier: 117366549
2025-12-02 19:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8d1d41c3-9a55-5035-95b3-78f2642f8712 with identifier: 117366549
2025-12-02 19:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 130673 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    130673
2025-12-02 19:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 8d1d41c3-9a55-5035-95b3-78f2642f8712 spider: astonbarclay.gb
2025-12-02 19:06:53 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8d1d41c3-9a55-5035-95b3-78f2642f8712 due to rule: high_mileage_for_make.json, error: 130673 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    130673
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '8d1d41c3-9a55-5035-95b3-78f2642f8712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AGZ6324',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117366549',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'PEUGEOT',
 'model': '308 DIESEL HATCHBACK',
 'odometer': 81197,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-29',
 'seller_name': 'Zuto',
 'title': 'PEUGEOT 308 DIESEL HATCHBACK 2.0 BlueHDi 180 GT 5dr EAT6',
 'transmission': 'automatic',
 'trim': '2.0 BlueHDi 180 GT 5dr EAT6',
 'vin': None,
 'year': 2016}
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366549%27 HTTP/1.1" 200 None
2025-12-02 19:06:53 [astonbarclay.gb] INFO: Saving data for 117366549: {'auction_closing_time': 1765285200.0, 'created_time': 1764615791.360269, 'last_price_update_time': 1764702413.922908}
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117366549') HTTP/1.1" 204 0
2025-12-02 19:06:53 [astonbarclay.gb] INFO: Found listing with ID: 117600158
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600158%27 HTTP/1.1" 200 None
2025-12-02 19:06:53 [astonbarclay.gb] INFO: Scrape type for 117600158: 1
2025-12-02 19:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE66YRM/2025-12-02/image/6b063875-cb62-45a0-9556-4e4fef4efcbd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661902?view=catalogue)
2025-12-02 19:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117547822?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aacf90>
2025-12-02 19:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252Fed51126b-ad34-4fcc-a50f-dab0b94dd098_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/ed51126b-ad34-4fcc-a50f-dab0b94dd098_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3
2025-12-02 19:06:54 [astonbarclay.gb] INFO: Found listing with ID: 117600051
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600051%27 HTTP/1.1" 200 None
2025-12-02 19:06:54 [astonbarclay.gb] INFO: Scrape type for 117600051: 1
2025-12-02 19:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE66YRM/2025-12-02/image/cfd7809c-a05b-462d-a58e-94160face48f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117661902?view=catalogue)
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0641150>
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F07047dc9-b3c1-4a5a-b79c-50a8abd444b8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/07047dc9-b3c1-4a5a-b79c-50a8abd444b8_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0342e50>
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252Fbd8a17c3-bae6-4a05-9b4f-6aee388bae72_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/bd8a17c3-bae6-4a05-9b4f-6aee388bae72_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09219d0>
2025-12-02 19:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F9d23a6e6-be1e-4092-9ff8-635f89a6e59b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/9d23a6e6-be1e-4092-9ff8-635f89a6e59b_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3
2025-12-02 19:06:55 [astonbarclay.gb] INFO: Found listing with ID: 117702797
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702797%27 HTTP/1.1" 200 None
2025-12-02 19:06:55 [astonbarclay.gb] INFO: Scrape type for 117702797: 1
2025-12-02 19:06:55 [astonbarclay.gb] INFO: Found listing with ID: 117626788
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117626788%27 HTTP/1.1" 200 None
2025-12-02 19:06:55 [astonbarclay.gb] INFO: Scrape type for 117626788: 1
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09c1c50>
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252F6b063875-cb62-45a0-9556-4e4fef4efcbd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/6b063875-cb62-45a0-9556-4e4fef4efcbd_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3
2025-12-02 19:06:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117547822, 'registration': 'SY18NPD', 'account': 'THE109', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 3dr', 'mileage': 88304, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-23', 'fuel': 'Petrol', 'motExpiry': '2026-03-25', 'doors': 3, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SY18NPD/2025-12-02/image/edf589ed-fd41-4400-b367-2366cd573293_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/50e08d7e-d101-4966-8459-7430537586b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/255c4276-ca97-4a6b-9c0e-2b58bf9a8ef6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/1b4507fc-93bc-4915-a9de-c3d8f09dba4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/6d68b951-2bfd-4336-9b0e-fc4116008405_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/6de2ca6e-5594-42a1-b8b8-eb4152dc6a38_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/5f688784-e4f7-4c59-9806-5ba9f1f85d2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/33219d57-61fb-408b-a48a-a7cfd4811b99_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/04c54bbf-40d2-4ef9-9c31-7e5c68a8d03d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/20 - 20K, 05/21 - 27K, 03/22 - 35K, 06/23 - 52K, 05/24 - 63K', 'remarks': '**421** VOSA STATES 27K, 35K, 49K, 63K, 80K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d28ad9b4-5659-4103-8ed0-909b1317e7d9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117547822, 'registration': 'SY18NPD', 'account': 'THE109', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 3dr', 'mileage': 88304, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-23', 'fuel': 'Petrol', 'motExpiry': '2026-03-25', 'doors': 3, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SY18NPD/2025-12-02/image/edf589ed-fd41-4400-b367-2366cd573293_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/50e08d7e-d101-4966-8459-7430537586b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/255c4276-ca97-4a6b-9c0e-2b58bf9a8ef6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/1b4507fc-93bc-4915-a9de-c3d8f09dba4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/6d68b951-2bfd-4336-9b0e-fc4116008405_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/6de2ca6e-5594-42a1-b8b8-eb4152dc6a38_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/5f688784-e4f7-4c59-9806-5ba9f1f85d2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/33219d57-61fb-408b-a48a-a7cfd4811b99_removebg.jpg?w=600', 'https://abimg003.imgix.net/SY18NPD/2025-12-02/image/04c54bbf-40d2-4ef9-9c31-7e5c68a8d03d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/20 - 20K, 05/21 - 27K, 03/22 - 35K, 06/23 - 52K, 05/24 - 63K', 'remarks': '**421** VOSA STATES 27K, 35K, 49K, 63K, 80K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d28ad9b4-5659-4103-8ed0-909b1317e7d9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36d5976d-aee7-5109-be55-181e24e3bb9e with identifier: 117547822
2025-12-02 19:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d5976d-aee7-5109-be55-181e24e3bb9e with scrape type 2
2025-12-02 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36d5976d-aee7-5109-be55-181e24e3bb9e with scrape type 2
2025-12-02 19:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 36d5976d-aee7-5109-be55-181e24e3bb9e, identifier: 117547822
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1bd3e50>
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE66YRM%252F2025-12-02%252Fimage%252Fcfd7809c-a05b-462d-a58e-94160face48f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE66YRM/2025-12-02/image/cfd7809c-a05b-462d-a58e-94160face48f_removebg.jpg?w=600 saved to cache
2025-12-02 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3
2025-12-02 19:06:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcbfe262-0cd0-58f8-8272-316c72d4e4a3, skipping ID generation
2025-12-02 19:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3 with scrape type 1
2025-12-02 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fcbfe262-0cd0-58f8-8272-316c72d4e4a3 from tracking dictionaries
2025-12-02 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcbfe262-0cd0-58f8-8272-316c72d4e4a3 sending to next pipeline
2025-12-02 19:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fcbfe262-0cd0-58f8-8272-316c72d4e4a3, identifier: 117661902
2025-12-02 19:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 36d5976d-aee7-5109-be55-181e24e3bb9e with identifier: 117547822
2025-12-02 19:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 36d5976d-aee7-5109-be55-181e24e3bb9e with identifier: 117547822
2025-12-02 19:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 36d5976d-aee7-5109-be55-181e24e3bb9e with identifier: 117547822 to the API
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2736d5976d-aee7-5109-be55-181e24e3bb9e%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 36d5976d-aee7-5109-be55-181e24e3bb9e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:55 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117547822?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '36d5976d-aee7-5109-be55-181e24e3bb9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SY18NPD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117547822',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 88304,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-23',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD FIESTA HATCHBACK 1.1 Zetec 3dr',
 'transmission': 'manual',
 'trim': '1.1 Zetec 3dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547822%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Saving data for 117547822: {'auction_closing_time': 1765285200.0, 'created_time': 1764615707.10179, 'last_price_update_time': 1764702416.047842}
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117547822') HTTP/1.1" 204 0
2025-12-02 19:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fcbfe262-0cd0-58f8-8272-316c72d4e4a3 with identifier: 117661902
2025-12-02 19:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fcbfe262-0cd0-58f8-8272-316c72d4e4a3 with identifier: 117661902
2025-12-02 19:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174998 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174998
2025-12-02 19:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fcbfe262-0cd0-58f8-8272-316c72d4e4a3 spider: astonbarclay.gb
2025-12-02 19:06:56 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: fcbfe262-0cd0-58f8-8272-316c72d4e4a3 due to rule: high_mileage_for_country.json, error: 174998 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174998
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'fcbfe262-0cd0-58f8-8272-316c72d4e4a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OE66YRM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117661902',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 108739,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25808,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/5e131098-c1b2-4dde-b3fb-21dbedc3facf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26550,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/83bc3a13-bb7f-43a7-b4ac-fa9c251713d6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26894,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/6b063875-cb62-45a0-9556-4e4fef4efcbd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26449,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/2420e951-4909-4a1b-ab5a-e288b31a72c1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40159,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/9d23a6e6-be1e-4092-9ff8-635f89a6e59b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44127,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/ed51126b-ad34-4fcc-a50f-dab0b94dd098_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42078,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/bd8a17c3-bae6-4a05-9b4f-6aee388bae72_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40333,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/07047dc9-b3c1-4a5a-b79c-50a8abd444b8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbfe262-0cd0-58f8-8272-316c72d4e4a3/fcbfe262-0cd0-58f8-8272-316c72d4e4a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47570,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE66YRM/2025-12-02/image/cfd7809c-a05b-462d-a58e-94160face48f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-28',
 'seller_name': 'TCB Group - Prime',
 'title': 'AUDI A3 SPORTBACK S3 TFSI Quattro 5dr S Tronic',
 'transmission': 'automatic',
 'trim': 'S3 TFSI Quattro 5dr S Tronic',
 'vin': None,
 'year': 2017}
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661902%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Saving data for 117661902: {'created_time': 1764702416.260151, 'last_price_update_time': 1764702416.260161, 'auction_closing_time': 1765285200.0}
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117661902') HTTP/1.1" 204 0
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 116993535
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116993535%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 116993535: 2
2025-12-02 19:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117604369?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117567350
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117567350%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117567350: 0
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117021986
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117021986%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117021986: 2
2025-12-02 19:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117543749
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543749%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117543749: 0
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117119906
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117119906%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117119906: 0
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117242944
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242944%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117242944: 0
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117359464
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117359464%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117359464: 1
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117398180
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117398180%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117398180: 1
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117399206
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399206%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117399206: 1
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117604369, 'registration': 'YY73JVO', 'account': 'HAT006', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 5648, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-10-07', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YY73JVO/2025-12-02/image/97b17cbc-b49d-413e-af47-e36810cb4f66_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/f2660247-3fec-4084-8266-089f3b81663f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/69b2d990-40a8-4729-9866-ddac51ee9f59_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/4a960755-b360-4842-8bf8-e088a9b9c5d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/33311a03-a70c-4d77-9ad1-b65723d1103b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/ad0532f7-65aa-4488-8563-9cacb91c089e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/35efb5e3-79af-425e-b427-b6391941694c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/4b47c45f-b617-419d-b741-d918e7042174_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/da1ac3ee-690f-46b1-8fdd-ed92974a3a2e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24 - 4K, 10/25 - 5K', 'remarks': '**34**', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/075e2c8c-cb1a-4be7-a3fe-d1b204f33ee8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117604369, 'registration': 'YY73JVO', 'account': 'HAT006', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 5648, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-10-07', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YY73JVO/2025-12-02/image/97b17cbc-b49d-413e-af47-e36810cb4f66_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/f2660247-3fec-4084-8266-089f3b81663f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/69b2d990-40a8-4729-9866-ddac51ee9f59_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/4a960755-b360-4842-8bf8-e088a9b9c5d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/33311a03-a70c-4d77-9ad1-b65723d1103b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/ad0532f7-65aa-4488-8563-9cacb91c089e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/35efb5e3-79af-425e-b427-b6391941694c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/4b47c45f-b617-419d-b741-d918e7042174_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY73JVO/2025-12-02/image/da1ac3ee-690f-46b1-8fdd-ed92974a3a2e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24 - 4K, 10/25 - 5K', 'remarks': '**34**', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/075e2c8c-cb1a-4be7-a3fe-d1b204f33ee8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee1177fd-5d9e-5497-a95a-f7259e3e1f8f with identifier: 117604369
2025-12-02 19:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee1177fd-5d9e-5497-a95a-f7259e3e1f8f with scrape type 2
2025-12-02 19:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee1177fd-5d9e-5497-a95a-f7259e3e1f8f with scrape type 2
2025-12-02 19:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ee1177fd-5d9e-5497-a95a-f7259e3e1f8f, identifier: 117604369
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117269658
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269658%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117269658: 1
2025-12-02 19:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ee1177fd-5d9e-5497-a95a-f7259e3e1f8f with identifier: 117604369
2025-12-02 19:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ee1177fd-5d9e-5497-a95a-f7259e3e1f8f with identifier: 117604369
2025-12-02 19:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ee1177fd-5d9e-5497-a95a-f7259e3e1f8f with identifier: 117604369 to the API
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ee1177fd-5d9e-5497-a95a-f7259e3e1f8f%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ee1177fd-5d9e-5497-a95a-f7259e3e1f8f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:56 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117604369?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ee1177fd-5d9e-5497-a95a-f7259e3e1f8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YY73JVO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117604369',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 5648,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-07',
 'seller_name': 'Hatfields Group',
 'title': 'AUDI Q2 ESTATE 35 TFSI S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI S Line 5dr S Tronic',
 'vin': None,
 'year': 2023}
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117604369%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Saving data for 117604369: {'auction_closing_time': 1765285200.0, 'created_time': 1764356649.443289, 'last_price_update_time': 1764702416.822993}
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117604369') HTTP/1.1" 204 0
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117260567
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117260567%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117260567: 1
2025-12-02 19:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117627838?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117411447
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117411447%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117411447: 1
2025-12-02 19:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117271012
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271012%27 HTTP/1.1" 200 None
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Scrape type for 117271012: 0
2025-12-02 19:06:56 [astonbarclay.gb] INFO: Found listing with ID: 117353225
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117353225%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117353225: 1
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117208422
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117208422%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117208422: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117214479
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214479%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117214479: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117194162
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117194162%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117194162: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117178030
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178030%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117178030: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117120682
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120682%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117120682: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117118656
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117118656%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117118656: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117120453
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120453%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117120453: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117444495
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444495%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117444495: 1
2025-12-02 19:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585190?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/60238390?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117399373
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399373%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117399373: 1
2025-12-02 19:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584951?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117578188?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117627838, 'registration': '5BSW', 'account': 'HAT008', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 SD6 HSE Luxury 5dr Auto', 'mileage': 117101, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-09-27', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/20- 6K, 10/21- 19K, 05/22- 35K, 01/23- 51K, 09/23- 68K, 06/24- 85K, 03/25- 102K', 'remarks': '**24** VOSA STATES 44K, 68K, 91K, 112K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 198, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ca8aa8c-7454-4bf9-bdd5-48fd203380b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117627838, 'registration': '5BSW', 'account': 'HAT008', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 SD6 HSE Luxury 5dr Auto', 'mileage': 117101, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-09-27', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/20- 6K, 10/21- 19K, 05/22- 35K, 01/23- 51K, 09/23- 68K, 06/24- 85K, 03/25- 102K', 'remarks': '**24** VOSA STATES 44K, 68K, 91K, 112K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 198, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ca8aa8c-7454-4bf9-bdd5-48fd203380b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8794730-72b1-5d18-a3b5-7236d934a6cc with identifier: 117627838
2025-12-02 19:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8794730-72b1-5d18-a3b5-7236d934a6cc with scrape type 2
2025-12-02 19:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8794730-72b1-5d18-a3b5-7236d934a6cc with scrape type 2
2025-12-02 19:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d8794730-72b1-5d18-a3b5-7236d934a6cc, identifier: 117627838
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117230187
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117230187%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117230187: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117242472
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242472%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117242472: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117219838
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117219838%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117219838: 1
2025-12-02 19:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d8794730-72b1-5d18-a3b5-7236d934a6cc with identifier: 117627838
2025-12-02 19:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d8794730-72b1-5d18-a3b5-7236d934a6cc with identifier: 117627838
2025-12-02 19:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188455 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188455
2025-12-02 19:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d8794730-72b1-5d18-a3b5-7236d934a6cc spider: astonbarclay.gb
2025-12-02 19:06:57 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d8794730-72b1-5d18-a3b5-7236d934a6cc due to rule: high_mileage_for_country.json, error: 188455 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188455
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd8794730-72b1-5d18-a3b5-7236d934a6cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': '5BSW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117627838',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY DIESEL SW',
 'odometer': 117101,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-27',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER DISCOVERY DIESEL SW 3.0 SD6 HSE Luxury 5dr Auto',
 'transmission': 'automatic',
 'trim': '3.0 SD6 HSE Luxury 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627838%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Saving data for 117627838: {'auction_closing_time': 1765285200.0, 'created_time': 1764615701.011682, 'last_price_update_time': 1764702417.539717}
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117627838') HTTP/1.1" 204 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117140269
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140269%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117140269: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117140308
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140308%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117140308: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117372557
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372557%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117372557: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117362589
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362589%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117362589: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117327029
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117327029%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117327029: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117273524
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117273524%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117273524: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117253368
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253368%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117253368: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 114344014
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114344014%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 114344014: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117651285
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117651285%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117651285: 0
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Found listing with ID: 117625956
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625956%27 HTTP/1.1" 200 None
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Scrape type for 117625956: 2
2025-12-02 19:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116896181?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117585190, 'registration': 'DK19UJU', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 Landmark 5dr Auto', 'mileage': 62723, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-27', 'fuel': 'Diesel', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/21- 12K', 'remarks': '**65**VOSA STATES 16K, 29K, 48K, 62K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 170, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117585190, 'registration': 'DK19UJU', 'account': 'HAT007', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 Landmark 5dr Auto', 'mileage': 62723, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-27', 'fuel': 'Diesel', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/21- 12K', 'remarks': '**65**VOSA STATES 16K, 29K, 48K, 62K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 170, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d52d2e7-1c84-5ada-afec-bd47cf42bd80 with identifier: 117585190
2025-12-02 19:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d52d2e7-1c84-5ada-afec-bd47cf42bd80 with scrape type 2
2025-12-02 19:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d52d2e7-1c84-5ada-afec-bd47cf42bd80 with scrape type 2
2025-12-02 19:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7d52d2e7-1c84-5ada-afec-bd47cf42bd80, identifier: 117585190
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 60238390, 'registration': 'YS65KSU', 'account': 'ZUT001', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T SE 5dr', 'mileage': 74810, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-22', 'fuel': 'Petrol', 'motExpiry': '2022-01-16', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS65KSU/2025-10-22/image/41536d8d-3ae9-4a72-ae0b-02c1bce75441_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/66a94ce6-a780-4ea9-af23-346569b3c186_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/e89c3920-3b2e-4169-aae8-b61d86f81059_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/7d6aa15b-22ac-4b3f-9732-fd4b26aea4a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/81c6137c-c0e4-48f6-81b4-438c970c7729_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/702e4ba9-c8c1-4785-8219-825aa82a60b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/36bdecec-d520-4b0c-93a0-29f204ad4f61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/f4608216-bca5-402e-9195-8aa0fec2b3d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/395bda17-874f-40d3-a2c2-ca09cce26ae3_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1405**VOSA STATES 47K, 54K, 61K, 65K,', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 60238390, 'registration': 'YS65KSU', 'account': 'ZUT001', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T SE 5dr', 'mileage': 74810, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-22', 'fuel': 'Petrol', 'motExpiry': '2022-01-16', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS65KSU/2025-10-22/image/41536d8d-3ae9-4a72-ae0b-02c1bce75441_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/66a94ce6-a780-4ea9-af23-346569b3c186_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/e89c3920-3b2e-4169-aae8-b61d86f81059_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/7d6aa15b-22ac-4b3f-9732-fd4b26aea4a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/81c6137c-c0e4-48f6-81b4-438c970c7729_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/702e4ba9-c8c1-4785-8219-825aa82a60b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/36bdecec-d520-4b0c-93a0-29f204ad4f61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/f4608216-bca5-402e-9195-8aa0fec2b3d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/395bda17-874f-40d3-a2c2-ca09cce26ae3_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1405**VOSA STATES 47K, 54K, 61K, 65K,', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ec9234c-0d71-5d07-b7f0-d851996db0b8 with identifier: 60238390
2025-12-02 19:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8 with scrape type 2
2025-12-02 19:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8 with scrape type 2
2025-12-02 19:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8ec9234c-0d71-5d07-b7f0-d851996db0b8, identifier: 60238390
2025-12-02 19:06:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116288981, 'registration': 'GK17LHL', 'account': 'ZUT001', 'make': 'NISSAN', 'model': 'QASHQAI DIESEL HATCHBACK', 'derivative': '1.6 dCi Tekna 5dr Xtronic', 'mileage': 88060, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-11', 'fuel': 'Diesel', 'motExpiry': '2026-04-27', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GK17LHL/2025-10-14/image/681955bc-daf4-499b-869f-a31e01033809_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b0ab792c-80b6-45e4-bf7e-5c2e65c76e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b2522cad-e936-469b-8465-cc454e6e210e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/ccab1513-0561-4d33-86f5-0dc2d1ccc9ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/a110cd1b-3dba-4af0-9264-9bf7688d62ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/9b0f9adc-2807-4720-bdaa-81cf105c406d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/d3df424d-39b1-4909-ad2b-e100b16fd096_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/14bea6ed-7b1f-4dc7-a9f8-447f4375d7a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/27af64a2-00ef-4418-bdfc-297f7617e5fb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 02/18 - 20K, 05/19 - 35K, 03/20 - 41K, 04/21 - 47K, 04/22 - 57K, 03/23 - 66K, 04/25 - 84K', 'remarks': '**1682** VOSA STATES 41K, 47K, 57K, 66K, 75K, 84K SD CARD', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116288981, 'registration': 'GK17LHL', 'account': 'ZUT001', 'make': 'NISSAN', 'model': 'QASHQAI DIESEL HATCHBACK', 'derivative': '1.6 dCi Tekna 5dr Xtronic', 'mileage': 88060, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-11', 'fuel': 'Diesel', 'motExpiry': '2026-04-27', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GK17LHL/2025-10-14/image/681955bc-daf4-499b-869f-a31e01033809_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b0ab792c-80b6-45e4-bf7e-5c2e65c76e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b2522cad-e936-469b-8465-cc454e6e210e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/ccab1513-0561-4d33-86f5-0dc2d1ccc9ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/a110cd1b-3dba-4af0-9264-9bf7688d62ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/9b0f9adc-2807-4720-bdaa-81cf105c406d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/d3df424d-39b1-4909-ad2b-e100b16fd096_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/14bea6ed-7b1f-4dc7-a9f8-447f4375d7a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/27af64a2-00ef-4418-bdfc-297f7617e5fb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 02/18 - 20K, 05/19 - 35K, 03/20 - 41K, 04/21 - 47K, 04/22 - 57K, 03/23 - 66K, 04/25 - 84K', 'remarks': '**1682** VOSA STATES 41K, 47K, 57K, 66K, 75K, 84K SD CARD', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with identifier: 116288981
2025-12-02 19:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with scrape type 2
2025-12-02 19:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with scrape type 2
2025-12-02 19:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2, identifier: 116288981
2025-12-02 19:06:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584951, 'registration': 'YC68WVU', 'account': 'HAT008', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 TD6 HSE 5dr Auto', 'mileage': 45933, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-09-28', 'fuel': 'Diesel', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/YC68WVU/2025-12-01/image/7a0466c5-d974-454b-b8bf-60af24b4264a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/063faeb6-0bfe-4aca-8034-f74f056eba37_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/3bb260fc-e345-4692-bb9f-085542c22276_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/442b5d57-0444-4a64-b71b-447701dc35bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/8037fa7d-bd2e-4c5f-a077-ba70ce23f7dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/e7e70fea-8543-46c0-a9ef-77d0c8a4923e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/96528a81-0cf0-48c3-96e9-4cd368272a49_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/aa694d1e-8f35-4117-be17-89491b74239c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/6050f12b-183e-4039-ab83-251cddfaad00_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/19- 10K, 10/20- 16K, 11/21 - 22K, 01/24- 36K, 01/23 - NO MILEAGE, 01/25 - 41K', 'remarks': '**125** VOSA STATES 17K, 24K, 30K, 36K, 41K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 189, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d3112e5c-c603-424d-a381-912b1c634f94.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584951, 'registration': 'YC68WVU', 'account': 'HAT008', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 TD6 HSE 5dr Auto', 'mileage': 45933, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-09-28', 'fuel': 'Diesel', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/YC68WVU/2025-12-01/image/7a0466c5-d974-454b-b8bf-60af24b4264a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/063faeb6-0bfe-4aca-8034-f74f056eba37_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/3bb260fc-e345-4692-bb9f-085542c22276_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/442b5d57-0444-4a64-b71b-447701dc35bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/8037fa7d-bd2e-4c5f-a077-ba70ce23f7dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/e7e70fea-8543-46c0-a9ef-77d0c8a4923e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/96528a81-0cf0-48c3-96e9-4cd368272a49_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/aa694d1e-8f35-4117-be17-89491b74239c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC68WVU/2025-12-01/image/6050f12b-183e-4039-ab83-251cddfaad00_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/19- 10K, 10/20- 16K, 11/21 - 22K, 01/24- 36K, 01/23 - NO MILEAGE, 01/25 - 41K', 'remarks': '**125** VOSA STATES 17K, 24K, 30K, 36K, 41K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 189, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d3112e5c-c603-424d-a381-912b1c634f94.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e48da36-57ff-5d7f-9b41-ec327adf7b90 with identifier: 117584951
2025-12-02 19:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e48da36-57ff-5d7f-9b41-ec327adf7b90 with scrape type 2
2025-12-02 19:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e48da36-57ff-5d7f-9b41-ec327adf7b90 with scrape type 2
2025-12-02 19:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6e48da36-57ff-5d7f-9b41-ec327adf7b90, identifier: 117584951
2025-12-02 19:06:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117578188, 'registration': 'DV20DTX', 'account': 'THE109', 'make': 'HYUNDAI', 'model': 'I30 DIESEL TOURER', 'derivative': '1.6 CRDi SE Nav 5dr', 'mileage': 94209, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-07-27', 'fuel': 'Diesel', 'motExpiry': '2026-06-06', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV20DTX/2025-12-02/image/94224f10-6b23-4f4e-a19d-4f6ec8aa4125_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/25baeb9e-b9b4-42a0-80d4-e2624ecc056d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/455fd74f-a7d9-4a59-9e43-ab84568ed49f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/be84335a-b855-4951-802d-783cd55d0fe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/7edfb753-6a3e-43c3-ab65-a06bfec396bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/bd1628c8-23c2-4caf-92e8-eb95832541bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/0e79cdfa-981d-4b29-937c-f924edbe1969_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/6997cc3b-2487-4476-a771-46297ec43466_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/06846d33-1756-478a-862a-f4c42a9837c9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 03/21 - 10K, 03/22 - 28K, 02/23 - 43K, 09/23 - 53K, 08/24 - 65K, 03/25 - 72K', 'remarks': '**441** VOSA STATES 50K, 64K, 72K, 73K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f08d032-6d0d-4023-962c-affaec221bac.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117578188, 'registration': 'DV20DTX', 'account': 'THE109', 'make': 'HYUNDAI', 'model': 'I30 DIESEL TOURER', 'derivative': '1.6 CRDi SE Nav 5dr', 'mileage': 94209, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-07-27', 'fuel': 'Diesel', 'motExpiry': '2026-06-06', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV20DTX/2025-12-02/image/94224f10-6b23-4f4e-a19d-4f6ec8aa4125_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/25baeb9e-b9b4-42a0-80d4-e2624ecc056d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/455fd74f-a7d9-4a59-9e43-ab84568ed49f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/be84335a-b855-4951-802d-783cd55d0fe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/7edfb753-6a3e-43c3-ab65-a06bfec396bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/bd1628c8-23c2-4caf-92e8-eb95832541bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/0e79cdfa-981d-4b29-937c-f924edbe1969_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/6997cc3b-2487-4476-a771-46297ec43466_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV20DTX/2025-12-02/image/06846d33-1756-478a-862a-f4c42a9837c9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 03/21 - 10K, 03/22 - 28K, 02/23 - 43K, 09/23 - 53K, 08/24 - 65K, 03/25 - 72K', 'remarks': '**441** VOSA STATES 50K, 64K, 72K, 73K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f08d032-6d0d-4023-962c-affaec221bac.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c89e4dae-3812-5fcf-b511-06a26cbc4118 with identifier: 117578188
2025-12-02 19:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c89e4dae-3812-5fcf-b511-06a26cbc4118 with scrape type 2
2025-12-02 19:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c89e4dae-3812-5fcf-b511-06a26cbc4118 with scrape type 2
2025-12-02 19:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c89e4dae-3812-5fcf-b511-06a26cbc4118, identifier: 117578188
2025-12-02 19:06:58 [astonbarclay.gb] INFO: Found listing with ID: 117416921
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117416921%27 HTTP/1.1" 200 None
2025-12-02 19:06:58 [astonbarclay.gb] INFO: Scrape type for 117416921: 2
2025-12-02 19:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7d52d2e7-1c84-5ada-afec-bd47cf42bd80 with identifier: 117585190
2025-12-02 19:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7d52d2e7-1c84-5ada-afec-bd47cf42bd80 with identifier: 117585190
2025-12-02 19:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7d52d2e7-1c84-5ada-afec-bd47cf42bd80 with identifier: 117585190 to the API
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277d52d2e7-1c84-5ada-afec-bd47cf42bd80%27 HTTP/1.1" 200 None
2025-12-02 19:06:58 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7d52d2e7-1c84-5ada-afec-bd47cf42bd80: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:58 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117585190?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7d52d2e7-1c84-5ada-afec-bd47cf42bd80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DK19UJU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585190',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL SW',
 'odometer': 62723,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-27',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 TD4 180 Landmark 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 Landmark 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585190%27 HTTP/1.1" 200 None
2025-12-02 19:06:58 [astonbarclay.gb] INFO: Saving data for 117585190: {'auction_closing_time': 1765285200.0, 'created_time': 1764356652.003906, 'last_price_update_time': 1764702418.59836}
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585190') HTTP/1.1" 204 0
2025-12-02 19:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8ec9234c-0d71-5d07-b7f0-d851996db0b8 with identifier: 60238390
2025-12-02 19:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8ec9234c-0d71-5d07-b7f0-d851996db0b8 with identifier: 60238390
2025-12-02 19:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-02 19:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 8ec9234c-0d71-5d07-b7f0-d851996db0b8 spider: astonbarclay.gb
2025-12-02 19:06:58 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8ec9234c-0d71-5d07-b7f0-d851996db0b8 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': None,
 'engine': '1.4L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8ec9234c-0d71-5d07-b7f0-d851996db0b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YS65KSU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/60238390',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 74810,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-22',
 'seller_name': 'Zuto',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.4T SE 5dr',
 'transmission': 'manual',
 'trim': '1.4T SE 5dr',
 'vin': None,
 'year': 2015}
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2760238390%27 HTTP/1.1" 200 None
2025-12-02 19:06:58 [astonbarclay.gb] INFO: Saving data for 60238390: {'auction_closing_time': 1765285200.0, 'created_time': 1764615786.393605, 'last_price_update_time': 1764702418.909727}
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='60238390') HTTP/1.1" 204 0
2025-12-02 19:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with identifier: 116288981
2025-12-02 19:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with identifier: 116288981
2025-12-02 19:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with identifier: 116288981 to the API
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GK17LHL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116288981',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'QASHQAI DIESEL HATCHBACK',
 'odometer': 88060,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-11',
 'seller_name': 'Zuto',
 'title': 'NISSAN QASHQAI DIESEL HATCHBACK 1.6 dCi Tekna 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.6 dCi Tekna 5dr Xtronic',
 'vin': None,
 'year': 2017}
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116288981%27 HTTP/1.1" 200 None
2025-12-02 19:06:59 [astonbarclay.gb] INFO: Saving data for 116288981: {'auction_closing_time': 1765285200.0, 'created_time': 1764615734.503164, 'last_price_update_time': 1764702419.275595}
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116288981') HTTP/1.1" 204 0
2025-12-02 19:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6e48da36-57ff-5d7f-9b41-ec327adf7b90 with identifier: 117584951
2025-12-02 19:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6e48da36-57ff-5d7f-9b41-ec327adf7b90 with identifier: 117584951
2025-12-02 19:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6e48da36-57ff-5d7f-9b41-ec327adf7b90 with identifier: 117584951 to the API
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276e48da36-57ff-5d7f-9b41-ec327adf7b90%27 HTTP/1.1" 200 None
2025-12-02 19:06:59 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6e48da36-57ff-5d7f-9b41-ec327adf7b90: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:06:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584951?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6e48da36-57ff-5d7f-9b41-ec327adf7b90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YC68WVU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584951',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY DIESEL SW',
 'odometer': 45933,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-28',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER DISCOVERY DIESEL SW 3.0 TD6 HSE 5dr Auto',
 'transmission': 'automatic',
 'trim': '3.0 TD6 HSE 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584951%27 HTTP/1.1" 200 None
2025-12-02 19:06:59 [astonbarclay.gb] INFO: Saving data for 117584951: {'auction_closing_time': 1765285200.0, 'created_time': 1764356648.817615, 'last_price_update_time': 1764702419.570257}
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584951') HTTP/1.1" 204 0
2025-12-02 19:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c89e4dae-3812-5fcf-b511-06a26cbc4118 with identifier: 117578188
2025-12-02 19:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c89e4dae-3812-5fcf-b511-06a26cbc4118 with identifier: 117578188
2025-12-02 19:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151614 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151614
2025-12-02 19:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c89e4dae-3812-5fcf-b511-06a26cbc4118 spider: astonbarclay.gb
2025-12-02 19:06:59 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c89e4dae-3812-5fcf-b511-06a26cbc4118 due to rule: high_mileage_for_country.json, error: 151614 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151614
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c89e4dae-3812-5fcf-b511-06a26cbc4118',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DV20DTX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117578188',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'HYUNDAI',
 'model': 'I30 DIESEL TOURER',
 'odometer': 94209,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-27',
 'seller_name': 'TCB Group - Prime',
 'title': 'HYUNDAI I30 DIESEL TOURER 1.6 CRDi SE Nav 5dr',
 'transmission': 'manual',
 'trim': '1.6 CRDi SE Nav 5dr',
 'vin': None,
 'year': 2020}
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117578188%27 HTTP/1.1" 200 None
2025-12-02 19:06:59 [astonbarclay.gb] INFO: Saving data for 117578188: {'auction_closing_time': 1765285200.0, 'created_time': 1764615706.786266, 'last_price_update_time': 1764702419.78976}
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117578188') HTTP/1.1" 204 0
2025-12-02 19:06:59 [astonbarclay.gb] INFO: Found listing with ID: 117415829
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415829%27 HTTP/1.1" 200 None
2025-12-02 19:06:59 [astonbarclay.gb] INFO: Scrape type for 117415829: 2
2025-12-02 19:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117613099?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116896181, 'registration': 'YH69SSU', 'account': 'MOT075', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '320i M Sport 4dr Step Auto', 'mileage': 77769, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-25', 'fuel': 'Petrol', 'motExpiry': '2025-09-24', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YH69SSU/2025-11-04/image/fd2edd8b-dd83-46d9-b464-9f0a5c693656_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/65b6d811-35ad-40e6-aea7-31c56c9ceb1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/0fe1740a-82ba-4b2e-ac79-7c195b965e98_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/a6487a49-4772-4dc0-b987-e330222c7783_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/d2cb10cf-df3c-4121-b38a-992cb57e46e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/c80458b0-ef1d-4166-abad-27f40c91ec54_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/5ac82db8-8f2a-47cf-9114-f76306116e4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/4fa116c2-3797-42f9-ae6b-165f25c84975_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/600cdb0b-5ff4-49bc-ab2e-98fe51409907_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/dc68151f-40d7-49ff-a5d7-c2f0e35a80c9_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1854**VOSA STATES 64K, 69K, 75K, OUTSTANDING RECALL', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a5e0543-30a5-4179-93f4-aca81a06534c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116896181, 'registration': 'YH69SSU', 'account': 'MOT075', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '320i M Sport 4dr Step Auto', 'mileage': 77769, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-25', 'fuel': 'Petrol', 'motExpiry': '2025-09-24', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YH69SSU/2025-11-04/image/fd2edd8b-dd83-46d9-b464-9f0a5c693656_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/65b6d811-35ad-40e6-aea7-31c56c9ceb1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/0fe1740a-82ba-4b2e-ac79-7c195b965e98_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/a6487a49-4772-4dc0-b987-e330222c7783_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/d2cb10cf-df3c-4121-b38a-992cb57e46e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/c80458b0-ef1d-4166-abad-27f40c91ec54_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/5ac82db8-8f2a-47cf-9114-f76306116e4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/4fa116c2-3797-42f9-ae6b-165f25c84975_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/600cdb0b-5ff4-49bc-ab2e-98fe51409907_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/dc68151f-40d7-49ff-a5d7-c2f0e35a80c9_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1854**VOSA STATES 64K, 69K, 75K, OUTSTANDING RECALL', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a5e0543-30a5-4179-93f4-aca81a06534c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b1f2c7b-e136-5e43-b530-d9601a71ebf7 with identifier: 116896181
2025-12-02 19:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b1f2c7b-e136-5e43-b530-d9601a71ebf7 with scrape type 2
2025-12-02 19:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b1f2c7b-e136-5e43-b530-d9601a71ebf7 with scrape type 2
2025-12-02 19:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4b1f2c7b-e136-5e43-b530-d9601a71ebf7, identifier: 116896181
2025-12-02 19:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117600202?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4b1f2c7b-e136-5e43-b530-d9601a71ebf7 with identifier: 116896181
2025-12-02 19:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4b1f2c7b-e136-5e43-b530-d9601a71ebf7 with identifier: 116896181
2025-12-02 19:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4b1f2c7b-e136-5e43-b530-d9601a71ebf7 with identifier: 116896181 to the API
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116896181?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4b1f2c7b-e136-5e43-b530-d9601a71ebf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YH69SSU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116896181',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 77769,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': 'MotoNovo Finance',
 'title': 'BMW 3 SERIES SALOON 320i M Sport 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '320i M Sport 4dr Step Auto',
 'vin': None,
 'year': 2019}
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116896181%27 HTTP/1.1" 200 None
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Saving data for 116896181: {'auction_closing_time': 1765285200.0, 'created_time': 1764615709.566441, 'last_price_update_time': 1764702420.231097}
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116896181') HTTP/1.1" 204 0
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Found listing with ID: 117185008
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117185008%27 HTTP/1.1" 200 None
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Scrape type for 117185008: 2
2025-12-02 19:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Found listing with ID: 117599419
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599419%27 HTTP/1.1" 200 None
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Scrape type for 117599419: 2
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117613099, 'registration': 'MT68EBF', 'account': 'VAN044', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '0.9 IG-T N-Connecta 5dr', 'mileage': 40364, 'mileageWarranty': False, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-10', 'fuel': 'Petrol', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MT68EBF/2025-12-02/image/ded9c285-0010-4567-bd24-96a54e727761_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/85505b84-b6b3-4997-829a-533e38487e5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/0405ad9e-a8e0-4d07-b356-088275c4de00_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/954dee4e-e2b8-4d7e-b4a3-6381fc4b1bac_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/9afe48e9-bf57-4712-bccd-7b88fe18cbb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/89e642f2-686a-4f8c-bd45-f6bfb7b5ec90_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/9deae919-1ec2-4291-9350-6e438d856c7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/18a04bc1-57e7-4e89-9ad6-7697404c69b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/80eaa73b-f3c8-46fa-a456-24123f4441c4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 11K, 14K, 19K, 28K, 36K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a58e3f4-02ae-4c3f-a92b-588f54bcf4cb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117613099, 'registration': 'MT68EBF', 'account': 'VAN044', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '0.9 IG-T N-Connecta 5dr', 'mileage': 40364, 'mileageWarranty': False, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-10', 'fuel': 'Petrol', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MT68EBF/2025-12-02/image/ded9c285-0010-4567-bd24-96a54e727761_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/85505b84-b6b3-4997-829a-533e38487e5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/0405ad9e-a8e0-4d07-b356-088275c4de00_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/954dee4e-e2b8-4d7e-b4a3-6381fc4b1bac_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/9afe48e9-bf57-4712-bccd-7b88fe18cbb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/89e642f2-686a-4f8c-bd45-f6bfb7b5ec90_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/9deae919-1ec2-4291-9350-6e438d856c7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/18a04bc1-57e7-4e89-9ad6-7697404c69b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT68EBF/2025-12-02/image/80eaa73b-f3c8-46fa-a456-24123f4441c4_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 11K, 14K, 19K, 28K, 36K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a58e3f4-02ae-4c3f-a92b-588f54bcf4cb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d743ca24-9736-56bb-8379-98c4ba2e7cf2 with identifier: 117613099
2025-12-02 19:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d743ca24-9736-56bb-8379-98c4ba2e7cf2 with scrape type 2
2025-12-02 19:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d743ca24-9736-56bb-8379-98c4ba2e7cf2 with scrape type 2
2025-12-02 19:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d743ca24-9736-56bb-8379-98c4ba2e7cf2, identifier: 117613099
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117600202, 'registration': 'WJ18FUE', 'account': 'HAT004', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 TD6 HSE 5dr Auto', 'mileage': 129117, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-05', 'fuel': 'Diesel', 'motExpiry': '2026-03-14', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 08/18- 13K, 08/19- 38K, 08/20- 57K, 09/21- 75K, 03/23- 90K, 03/24- 105K', 'remarks': '**15**VOSA STATES 79K, 91K, 105K, 117K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 189, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117600202, 'registration': 'WJ18FUE', 'account': 'HAT004', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 TD6 HSE 5dr Auto', 'mileage': 129117, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-05', 'fuel': 'Diesel', 'motExpiry': '2026-03-14', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 08/18- 13K, 08/19- 38K, 08/20- 57K, 09/21- 75K, 03/23- 90K, 03/24- 105K', 'remarks': '**15**VOSA STATES 79K, 91K, 105K, 117K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 189, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 246e6d3a-f3d9-5895-a4bc-160fdfd55b34 with identifier: 117600202
2025-12-02 19:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 246e6d3a-f3d9-5895-a4bc-160fdfd55b34 with scrape type 2
2025-12-02 19:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 246e6d3a-f3d9-5895-a4bc-160fdfd55b34 with scrape type 2
2025-12-02 19:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 246e6d3a-f3d9-5895-a4bc-160fdfd55b34, identifier: 117600202
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Found listing with ID: 117217494
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217494%27 HTTP/1.1" 200 None
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Scrape type for 117217494: 2
2025-12-02 19:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d743ca24-9736-56bb-8379-98c4ba2e7cf2 with identifier: 117613099
2025-12-02 19:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d743ca24-9736-56bb-8379-98c4ba2e7cf2 with identifier: 117613099
2025-12-02 19:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d743ca24-9736-56bb-8379-98c4ba2e7cf2 with identifier: 117613099 to the API
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117613099?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd743ca24-9736-56bb-8379-98c4ba2e7cf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MT68EBF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117613099',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'MICRA HATCHBACK',
 'odometer': 40364,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-10',
 'seller_name': 'Vantage Motor Group',
 'title': 'NISSAN MICRA HATCHBACK 0.9 IG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '0.9 IG-T N-Connecta 5dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613099%27 HTTP/1.1" 200 None
2025-12-02 19:07:00 [astonbarclay.gb] INFO: Saving data for 117613099: {'auction_closing_time': 1765285200.0, 'created_time': 1764615801.479927, 'last_price_update_time': 1764702420.987093}
2025-12-02 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117613099') HTTP/1.1" 204 0
2025-12-02 19:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 246e6d3a-f3d9-5895-a4bc-160fdfd55b34 with identifier: 117600202
2025-12-02 19:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 246e6d3a-f3d9-5895-a4bc-160fdfd55b34 with identifier: 117600202
2025-12-02 19:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'hatfields group', 'price_includes_vat': False, 'title': 'land rover discovery diesel sw 3.0 td6 hse 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'land rover', 'model': 'discovery diesel sw', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 129117, 'odometer_reading_unit': 'mi', 'registration_date': '2018-03-05', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600202', 'expiration_date': '2025-12-09t13:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '3.0 td6 hse 5dr auto', 'license_plate': 'wj18fue', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 189, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '246e6d3a-f3d9-5895-a4bc-160fdfd55b34', 'current_year_diff': 7, 'age_in_months': 92, 'make_model': 'land rover discovery diesel sw', 'sanitized_make': 'landrover', 'odometer_in_km': 207793}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 189,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '3.0l',
     'expiration_date': '2025-12-09t13:00:00z',
     'fuel_type': 'diesel',
     'id': '246e6d3a-f3d9-5895-a4bc-160fdfd55b34',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'wj18fue',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600202',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'land rover',
     'make_model': 'land rover discovery diesel sw',
     'model': 'discovery diesel sw',
     'odometer': 129117,
     'odometer_in_km': 207793,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-03-05',
     'sanitized_make': 'landrover',
     'seller_name': 'hatfields group',
     'title': 'land rover discovery diesel sw 3.0 td6 hse 5dr auto',
     'transmission': 'automatic',
     'trim': '3.0 td6 hse 5dr auto',
     'vin': None,
     'year': 2018}
2025-12-02 19:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 246e6d3a-f3d9-5895-a4bc-160fdfd55b34 spider: astonbarclay.gb
2025-12-02 19:07:01 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 246e6d3a-f3d9-5895-a4bc-160fdfd55b34 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'hatfields group', 'price_includes_vat': False, 'title': 'land rover discovery diesel sw 3.0 td6 hse 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'land rover', 'model': 'discovery diesel sw', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 129117, 'odometer_reading_unit': 'mi', 'registration_date': '2018-03-05', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600202', 'expiration_date': '2025-12-09t13:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '3.0 td6 hse 5dr auto', 'license_plate': 'wj18fue', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 189, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '246e6d3a-f3d9-5895-a4bc-160fdfd55b34', 'current_year_diff': 7, 'age_in_months': 92, 'make_model': 'land rover discovery diesel sw', 'sanitized_make': 'landrover', 'odometer_in_km': 207793}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 189,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '3.0l',
     'expiration_date': '2025-12-09t13:00:00z',
     'fuel_type': 'diesel',
     'id': '246e6d3a-f3d9-5895-a4bc-160fdfd55b34',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'wj18fue',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600202',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'land rover',
     'make_model': 'land rover discovery diesel sw',
     'model': 'discovery diesel sw',
     'odometer': 129117,
     'odometer_in_km': 207793,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-03-05',
     'sanitized_make': 'landrover',
     'seller_name': 'hatfields group',
     'title': 'land rover discovery diesel sw 3.0 td6 hse 5dr auto',
     'transmission': 'automatic',
     'trim': '3.0 td6 hse 5dr auto',
     'vin': None,
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '246e6d3a-f3d9-5895-a4bc-160fdfd55b34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WJ18FUE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600202',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY DIESEL SW',
 'odometer': 129117,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-05',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER DISCOVERY DIESEL SW 3.0 TD6 HSE 5dr Auto',
 'transmission': 'automatic',
 'trim': '3.0 TD6 HSE 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600202%27 HTTP/1.1" 200 None
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Saving data for 117600202: {'auction_closing_time': 1765285200.0, 'created_time': 1764356649.971143, 'last_price_update_time': 1764702421.220696}
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117600202') HTTP/1.1" 204 0
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Found listing with ID: 117087842
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117087842%27 HTTP/1.1" 200 None
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Scrape type for 117087842: 2
2025-12-02 19:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585166?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117599932?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117688221?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585083?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585141?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117600158?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Found listing with ID: 117570357
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570357%27 HTTP/1.1" 200 None
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Scrape type for 117570357: 0
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Found listing with ID: 117537741
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537741%27 HTTP/1.1" 200 None
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Scrape type for 117537741: 2
2025-12-02 19:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Found listing with ID: 117598315
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598315%27 HTTP/1.1" 200 None
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Scrape type for 117598315: 2
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Found listing with ID: 117599669
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599669%27 HTTP/1.1" 200 None
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Scrape type for 117599669: 2
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Found listing with ID: 117601597
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601597%27 HTTP/1.1" 200 None
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Scrape type for 117601597: 2
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Found listing with ID: 115302250
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115302250%27 HTTP/1.1" 200 None
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Scrape type for 115302250: 0
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Found listing with ID: 116378959
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116378959%27 HTTP/1.1" 200 None
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Scrape type for 116378959: 2
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Found listing with ID: 115926008
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115926008%27 HTTP/1.1" 200 None
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Scrape type for 115926008: 2
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117585166, 'registration': 'MT72RRU', 'account': 'HAT007', 'make': 'BMW', 'model': '4 SERIES CONVERTIBLE SPECIAL EDITIONS', 'derivative': '420i M Sport Pro Edition 2dr Step Auto', 'mileage': 23142, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-28', 'doors': 2, 'engineSize': 1998, 'bodyType': 'Convertible', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 22K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 160, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117585166, 'registration': 'MT72RRU', 'account': 'HAT007', 'make': 'BMW', 'model': '4 SERIES CONVERTIBLE SPECIAL EDITIONS', 'derivative': '420i M Sport Pro Edition 2dr Step Auto', 'mileage': 23142, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-28', 'doors': 2, 'engineSize': 1998, 'bodyType': 'Convertible', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 22K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 160, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13bfbe04-dcfb-5c2d-b7f6-fa75b5bed3df with identifier: 117585166
2025-12-02 19:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13bfbe04-dcfb-5c2d-b7f6-fa75b5bed3df with scrape type 2
2025-12-02 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13bfbe04-dcfb-5c2d-b7f6-fa75b5bed3df with scrape type 2
2025-12-02 19:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 13bfbe04-dcfb-5c2d-b7f6-fa75b5bed3df, identifier: 117585166
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117599932, 'registration': 'BT23FHN', 'account': 'HAT004', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': 'M135i xDrive 5dr Step Auto', 'mileage': 23315, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-04-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 171, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117599932, 'registration': 'BT23FHN', 'account': 'HAT004', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': 'M135i xDrive 5dr Step Auto', 'mileage': 23315, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-04-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 171, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92305059-65e0-575a-ba77-0bfffa25c627 with identifier: 117599932
2025-12-02 19:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92305059-65e0-575a-ba77-0bfffa25c627 with scrape type 2
2025-12-02 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92305059-65e0-575a-ba77-0bfffa25c627 with scrape type 2
2025-12-02 19:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 92305059-65e0-575a-ba77-0bfffa25c627, identifier: 117599932
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117688221, 'registration': 'NJ68NTA', 'account': 'MOD010', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6 GDi ISG 2 5dr', 'mileage': 92041, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-09-04', 'fuel': 'Petrol', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Autolend', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d8ed3a2-3293-4221-bce1-eb22cff56dd2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117688221, 'registration': 'NJ68NTA', 'account': 'MOD010', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6 GDi ISG 2 5dr', 'mileage': 92041, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-09-04', 'fuel': 'Petrol', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Autolend', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d8ed3a2-3293-4221-bce1-eb22cff56dd2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a120cba0-c62b-5453-9f08-cf6a7ebad4d8 with identifier: 117688221
2025-12-02 19:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a120cba0-c62b-5453-9f08-cf6a7ebad4d8 with scrape type 1
2025-12-02 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a120cba0-c62b-5453-9f08-cf6a7ebad4d8
2025-12-02 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a120cba0-c62b-5453-9f08-cf6a7ebad4d8
2025-12-02 19:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a120cba0-c62b-5453-9f08-cf6a7ebad4d8, identifier: 117688221
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117585083, 'registration': 'MJ66VJL', 'account': 'HAT007', 'make': 'BMW', 'model': 'X3 DIESEL ESTATE', 'derivative': 'xDrive20d M Sport 5dr Step Auto', 'mileage': 88932, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-10-25', 'fuel': 'Diesel', 'motExpiry': '2026-01-16', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 22K, 28K, 37K, 46K, 57K, 72K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117585083, 'registration': 'MJ66VJL', 'account': 'HAT007', 'make': 'BMW', 'model': 'X3 DIESEL ESTATE', 'derivative': 'xDrive20d M Sport 5dr Step Auto', 'mileage': 88932, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-10-25', 'fuel': 'Diesel', 'motExpiry': '2026-01-16', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 22K, 28K, 37K, 46K, 57K, 72K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e695a7d4-809e-5b0e-9815-03ffc0869c07 with identifier: 117585083
2025-12-02 19:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e695a7d4-809e-5b0e-9815-03ffc0869c07 with scrape type 2
2025-12-02 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e695a7d4-809e-5b0e-9815-03ffc0869c07 with scrape type 2
2025-12-02 19:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e695a7d4-809e-5b0e-9815-03ffc0869c07, identifier: 117585083
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117585141, 'registration': 'NL67RVF', 'account': 'HAT007', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 250d 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 78163, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-11-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-13', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 22K, 31K, 42K, 55K, 62K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117585141, 'registration': 'NL67RVF', 'account': 'HAT007', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 250d 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 78163, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-11-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-13', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 22K, 31K, 42K, 55K, 62K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dce6ebd-e5c8-5339-8c6d-6c7ec0a10758 with identifier: 117585141
2025-12-02 19:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dce6ebd-e5c8-5339-8c6d-6c7ec0a10758 with scrape type 2
2025-12-02 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dce6ebd-e5c8-5339-8c6d-6c7ec0a10758 with scrape type 2
2025-12-02 19:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7dce6ebd-e5c8-5339-8c6d-6c7ec0a10758, identifier: 117585141
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117600158, 'registration': 'GD67TWG', 'account': 'WIL004', 'make': 'FORD', 'model': 'FIESTA TITANIUM TURBO', 'derivative': None, 'mileage': 60370, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-01-24', 'fuel': 'Petrol', 'motExpiry': '2026-01-23', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117600158, 'registration': 'GD67TWG', 'account': 'WIL004', 'make': 'FORD', 'model': 'FIESTA TITANIUM TURBO', 'derivative': None, 'mileage': 60370, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-01-24', 'fuel': 'Petrol', 'motExpiry': '2026-01-23', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e58c0d2-a321-59be-8bfe-0ac121212caa with identifier: 117600158
2025-12-02 19:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e58c0d2-a321-59be-8bfe-0ac121212caa with scrape type 1
2025-12-02 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7e58c0d2-a321-59be-8bfe-0ac121212caa
2025-12-02 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7e58c0d2-a321-59be-8bfe-0ac121212caa
2025-12-02 19:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7e58c0d2-a321-59be-8bfe-0ac121212caa, identifier: 117600158
2025-12-02 19:07:01 [astonbarclay.gb] INFO: Found listing with ID: 116806926
2025-12-02 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116806926%27 HTTP/1.1" 200 None
2025-12-02 19:07:02 [astonbarclay.gb] INFO: Scrape type for 116806926: 2
2025-12-02 19:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 13bfbe04-dcfb-5c2d-b7f6-fa75b5bed3df with identifier: 117585166
2025-12-02 19:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 13bfbe04-dcfb-5c2d-b7f6-fa75b5bed3df with identifier: 117585166
2025-12-02 19:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 13bfbe04-dcfb-5c2d-b7f6-fa75b5bed3df with identifier: 117585166 to the API
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2713bfbe04-dcfb-5c2d-b7f6-fa75b5bed3df%27 HTTP/1.1" 200 None
2025-12-02 19:07:02 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 13bfbe04-dcfb-5c2d-b7f6-fa75b5bed3df: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117585166?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '13bfbe04-dcfb-5c2d-b7f6-fa75b5bed3df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MT72RRU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585166',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '4 SERIES CONVERTIBLE SPECIAL EDITIONS',
 'odometer': 23142,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seller_name': 'Hatfields Group',
 'title': 'BMW 4 SERIES CONVERTIBLE SPECIAL EDITIONS 420i M Sport Pro Edition '
          '2dr Step Auto',
 'transmission': 'automatic',
 'trim': '420i M Sport Pro Edition 2dr Step Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585166%27 HTTP/1.1" 200 None
2025-12-02 19:07:02 [astonbarclay.gb] INFO: Saving data for 117585166: {'auction_closing_time': 1765285200.0, 'created_time': 1764356635.916051, 'last_price_update_time': 1764702422.309052}
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585166') HTTP/1.1" 204 0
2025-12-02 19:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 92305059-65e0-575a-ba77-0bfffa25c627 with identifier: 117599932
2025-12-02 19:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 92305059-65e0-575a-ba77-0bfffa25c627 with identifier: 117599932
2025-12-02 19:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 92305059-65e0-575a-ba77-0bfffa25c627 with identifier: 117599932 to the API
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2792305059-65e0-575a-ba77-0bfffa25c627%27 HTTP/1.1" 200 None
2025-12-02 19:07:02 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 92305059-65e0-575a-ba77-0bfffa25c627: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117599932?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '92305059-65e0-575a-ba77-0bfffa25c627',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BT23FHN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599932',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 23315,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-28',
 'seller_name': 'Hatfields Group',
 'title': 'BMW 1 SERIES HATCHBACK M135i xDrive 5dr Step Auto',
 'transmission': 'automatic',
 'trim': 'M135i xDrive 5dr Step Auto',
 'vin': None,
 'year': 2023}
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599932%27 HTTP/1.1" 200 None
2025-12-02 19:07:02 [astonbarclay.gb] INFO: Saving data for 117599932: {'auction_closing_time': 1765285200.0, 'created_time': 1764356657.599673, 'last_price_update_time': 1764702422.714517}
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117599932') HTTP/1.1" 204 0
2025-12-02 19:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a120cba0-c62b-5453-9f08-cf6a7ebad4d8 with identifier: 117688221
2025-12-02 19:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a120cba0-c62b-5453-9f08-cf6a7ebad4d8 with identifier: 117688221
2025-12-02 19:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a120cba0-c62b-5453-9f08-cf6a7ebad4d8 with identifier: 117688221 to the API
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a120cba0-c62b-5453-9f08-cf6a7ebad4d8%27 HTTP/1.1" 200 None
2025-12-02 19:07:02 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a120cba0-c62b-5453-9f08-cf6a7ebad4d8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117688221?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'a120cba0-c62b-5453-9f08-cf6a7ebad4d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NJ68NTA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117688221',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 92041,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-04',
 'seller_name': 'Autolend',
 'title': 'KIA SPORTAGE ESTATE 1.6 GDi ISG 2 5dr',
 'transmission': 'manual',
 'trim': '1.6 GDi ISG 2 5dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117688221%27 HTTP/1.1" 200 None
2025-12-02 19:07:03 [astonbarclay.gb] INFO: Saving data for 117688221: {'created_time': 1764702423.073984, 'last_price_update_time': 1764702423.073996, 'auction_closing_time': 1765359900.0}
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117688221') HTTP/1.1" 204 0
2025-12-02 19:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e695a7d4-809e-5b0e-9815-03ffc0869c07 with identifier: 117585083
2025-12-02 19:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e695a7d4-809e-5b0e-9815-03ffc0869c07 with identifier: 117585083
2025-12-02 19:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e695a7d4-809e-5b0e-9815-03ffc0869c07 with identifier: 117585083 to the API
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e695a7d4-809e-5b0e-9815-03ffc0869c07%27 HTTP/1.1" 200 None
2025-12-02 19:07:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e695a7d4-809e-5b0e-9815-03ffc0869c07: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:03 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117585083?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e695a7d4-809e-5b0e-9815-03ffc0869c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MJ66VJL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585083',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': 'X3 DIESEL ESTATE',
 'odometer': 88932,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-25',
 'seller_name': 'Hatfields Group',
 'title': 'BMW X3 DIESEL ESTATE xDrive20d M Sport 5dr Step Auto',
 'transmission': 'automatic',
 'trim': 'xDrive20d M Sport 5dr Step Auto',
 'vin': None,
 'year': 2016}
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585083%27 HTTP/1.1" 200 None
2025-12-02 19:07:03 [astonbarclay.gb] INFO: Saving data for 117585083: {'auction_closing_time': 1765285200.0, 'created_time': 1764356635.336437, 'last_price_update_time': 1764702423.367123}
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585083') HTTP/1.1" 204 0
2025-12-02 19:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7dce6ebd-e5c8-5339-8c6d-6c7ec0a10758 with identifier: 117585141
2025-12-02 19:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7dce6ebd-e5c8-5339-8c6d-6c7ec0a10758 with identifier: 117585141
2025-12-02 19:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7dce6ebd-e5c8-5339-8c6d-6c7ec0a10758 with identifier: 117585141 to the API
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277dce6ebd-e5c8-5339-8c6d-6c7ec0a10758%27 HTTP/1.1" 200 None
2025-12-02 19:07:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7dce6ebd-e5c8-5339-8c6d-6c7ec0a10758: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:03 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117585141?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7dce6ebd-e5c8-5339-8c6d-6c7ec0a10758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL67RVF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585141',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'GLC DIESEL ESTATE',
 'odometer': 78163,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seller_name': 'Hatfields Group',
 'title': 'MERCEDES-BENZ GLC DIESEL ESTATE GLC 250d 4Matic AMG Line Premium '
          '5dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLC 250d 4Matic AMG Line Premium 5dr 9G-Tronic',
 'vin': None,
 'year': 2017}
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585141%27 HTTP/1.1" 200 None
2025-12-02 19:07:03 [astonbarclay.gb] INFO: Saving data for 117585141: {'auction_closing_time': 1765285200.0, 'created_time': 1764356638.304672, 'last_price_update_time': 1764702423.676603}
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585141') HTTP/1.1" 204 0
2025-12-02 19:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7e58c0d2-a321-59be-8bfe-0ac121212caa with identifier: 117600158
2025-12-02 19:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7e58c0d2-a321-59be-8bfe-0ac121212caa with identifier: 117600158
2025-12-02 19:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7e58c0d2-a321-59be-8bfe-0ac121212caa with identifier: 117600158 to the API
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7e58c0d2-a321-59be-8bfe-0ac121212caa: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"Trim","ErrorMessage":"car trim can\u0027t be null","ErrorCode":0}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:03 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117600158?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7e58c0d2-a321-59be-8bfe-0ac121212caa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GD67TWG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600158',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'FIESTA TITANIUM TURBO',
 'odometer': 60370,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-24',
 'seller_name': 'Wilsons',
 'title': 'FORD FIESTA TITANIUM TURBO None',
 'transmission': 'manual',
 'trim': None,
 'vin': None,
 'year': 2018}
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600158%27 HTTP/1.1" 200 None
2025-12-02 19:07:03 [astonbarclay.gb] INFO: Saving data for 117600158: {'created_time': 1764702423.989011, 'last_price_update_time': 1764702423.989023, 'auction_closing_time': 1765359900.0}
2025-12-02 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117600158') HTTP/1.1" 204 0
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116888595
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116888595%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116888595: 2
2025-12-02 19:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116993535?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117538127
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117538127%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117538127: 2
2025-12-02 19:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 114698400
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114698400%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 114698400: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 114700069
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114700069%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 114700069: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117642361
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117642361%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117642361: 0
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116759189
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116759189%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116759189: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116752111
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116752111%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116752111: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117591412
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117591412%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117591412: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116993535, 'registration': 'CV70KZR', 'account': 'STE131', 'make': 'CITROEN', 'model': 'C5 AIRCROSS DIESEL HATCHBACK', 'derivative': '1.5 BlueHDi 130 Flair 5dr', 'mileage': 45138, 'mileageWarranty': True, 'type': 'car', 'saleId': 17975, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-09-23', 'fuel': 'Diesel', 'motExpiry': '2025-11-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CV70KZR/2025-11-11/image/790d8409-2871-403f-8ced-c212e8aa6c22_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/c82bbcb0-732e-4842-b23c-d7855a38e95e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/dbbcf756-3365-4716-824d-a65f1e5e1d9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/8930c21f-6a95-4934-bebf-880af9c7fdab_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/ecb0e0dc-9080-4b38-894a-1757cb3bcfb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/8cccd87f-70f8-48e7-aa3a-bd722252fb31_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/cfe05a41-44b4-48b1-8ab8-4d98819b9417_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/40899db7-9ecf-4c71-ad15-ca84e34ba9b8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY VOSA STATES 33K 41K', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bc3a9f8f-94b4-42cb-b492-163eaf6b8f1f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116993535, 'registration': 'CV70KZR', 'account': 'STE131', 'make': 'CITROEN', 'model': 'C5 AIRCROSS DIESEL HATCHBACK', 'derivative': '1.5 BlueHDi 130 Flair 5dr', 'mileage': 45138, 'mileageWarranty': True, 'type': 'car', 'saleId': 17975, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-09-23', 'fuel': 'Diesel', 'motExpiry': '2025-11-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CV70KZR/2025-11-11/image/790d8409-2871-403f-8ced-c212e8aa6c22_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/c82bbcb0-732e-4842-b23c-d7855a38e95e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/dbbcf756-3365-4716-824d-a65f1e5e1d9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/8930c21f-6a95-4934-bebf-880af9c7fdab_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/ecb0e0dc-9080-4b38-894a-1757cb3bcfb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/8cccd87f-70f8-48e7-aa3a-bd722252fb31_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/cfe05a41-44b4-48b1-8ab8-4d98819b9417_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/40899db7-9ecf-4c71-ad15-ca84e34ba9b8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY VOSA STATES 33K 41K', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bc3a9f8f-94b4-42cb-b492-163eaf6b8f1f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f6841b3-4958-5fd8-a833-ab4d3383cdba with identifier: 116993535
2025-12-02 19:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f6841b3-4958-5fd8-a833-ab4d3383cdba with scrape type 2
2025-12-02 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f6841b3-4958-5fd8-a833-ab4d3383cdba with scrape type 2
2025-12-02 19:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6f6841b3-4958-5fd8-a833-ab4d3383cdba, identifier: 116993535
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116798984
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116798984%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116798984: 2
2025-12-02 19:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6f6841b3-4958-5fd8-a833-ab4d3383cdba with identifier: 116993535
2025-12-02 19:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6f6841b3-4958-5fd8-a833-ab4d3383cdba with identifier: 116993535
2025-12-02 19:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6f6841b3-4958-5fd8-a833-ab4d3383cdba with identifier: 116993535 to the API
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116993535?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6f6841b3-4958-5fd8-a833-ab4d3383cdba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CV70KZR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116993535',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'CITROEN',
 'model': 'C5 AIRCROSS DIESEL HATCHBACK',
 'odometer': 45138,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-23',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'CITROEN C5 AIRCROSS DIESEL HATCHBACK 1.5 BlueHDi 130 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 130 Flair 5dr',
 'vin': None,
 'year': 2020}
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116993535%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Saving data for 116993535: {'auction_closing_time': 1765447200.0, 'created_time': 1762801358.374467, 'last_price_update_time': 1764702424.536346}
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116993535') HTTP/1.1" 204 0
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117547683
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547683%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117547683: 0
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116500039
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116500039%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116500039: 0
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116643961
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116643961%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116643961: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 115990741
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115990741%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 115990741: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117580703
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580703%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117580703: 0
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117581450
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581450%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117581450: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116013920
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116013920%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116013920: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116188432
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116188432%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116188432: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116645477
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116645477%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116645477: 0
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116258586
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116258586%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116258586: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116504950
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116504950%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116504950: 0
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117550264
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550264%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117550264: 0
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116420630
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116420630%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116420630: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117460295
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117460295%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117460295: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117492820
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492820%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117492820: 2
2025-12-02 19:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117260567?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117023136
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023136%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117023136: 2
2025-12-02 19:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116557093
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116557093%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116557093: 0
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 116412555
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116412555%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 116412555: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117239774
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117239774%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117239774: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117086159
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117086159%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117086159: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117394487
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394487%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117394487: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117395964
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117395964%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117395964: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117406754
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406754%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117406754: 2
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117260567, 'registration': 'OE22MTZ', 'account': 'KIN032', 'make': 'POLESTAR', 'model': '2 FASTBACK', 'derivative': '170kW 78kWh Long Range Single motor 5dr Auto', 'mileage': 51482, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-06-28', 'fuel': 'Electric', 'motExpiry': '2026-06-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/acb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/ffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/a33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/23 - 17K, 01/24 - 36K, 12/24 - 36K', 'remarks': '**242**VOSA STATES 43K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/599ac752-4514-4c9a-9631-c46b21eb5242.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117260567, 'registration': 'OE22MTZ', 'account': 'KIN032', 'make': 'POLESTAR', 'model': '2 FASTBACK', 'derivative': '170kW 78kWh Long Range Single motor 5dr Auto', 'mileage': 51482, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-06-28', 'fuel': 'Electric', 'motExpiry': '2026-06-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/acb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/ffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/a33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/23 - 17K, 01/24 - 36K, 12/24 - 36K', 'remarks': '**242**VOSA STATES 43K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/599ac752-4514-4c9a-9631-c46b21eb5242.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ecc587c-496b-59ed-8a76-a9db935c478b with identifier: 117260567
2025-12-02 19:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ecc587c-496b-59ed-8a76-a9db935c478b with scrape type 1
2025-12-02 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 0ecc587c-496b-59ed-8a76-a9db935c478b
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252F62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117360572
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117360572%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117360572: 2
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252F4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117080670
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117080670%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117080670: 2
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252Ff55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117691830
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117691830%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Scrape type for 117691830: 1
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252Facb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/acb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:04 [astonbarclay.gb] INFO: Found listing with ID: 117122763
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117122763%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117122763: 0
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 116872991
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116872991%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 116872991: 0
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117268826
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117268826%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117268826: 2
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252F1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117563859
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563859%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117563859: 1
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252F569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117316150
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316150%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117316150: 0
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 116265155
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116265155%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 116265155: 0
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117550785
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550785%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117550785: 0
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117316133
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316133%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117316133: 0
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117681164
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681164%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117681164: 1
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252Ff91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117359649
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117359649%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117359649: 1
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252Fffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/ffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117651744
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117651744%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117651744: 1
2025-12-02 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117269658?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252Fa33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/a33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117399593
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399593%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117399593: 2
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117106625
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117106625%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117106625: 0
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117474004
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117474004%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117474004: 2
2025-12-02 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117399373?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117411447?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117690352
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117690352%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117690352: 1
2025-12-02 19:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117444495?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117269311
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269311%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117269311: 0
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117684407
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117684407%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117684407: 1
2025-12-02 19:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117269658, 'registration': 'NA72FRF', 'account': 'KIN032', 'make': 'CITROEN', 'model': 'C5 AIRCROSS HATCHBACK', 'derivative': '1.2 PureTech Shine 5dr', 'mileage': 54616, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-10-21', 'fuel': 'Petrol', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e35211e4-be2a-4e74-af6d-98ee75025880_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e5fefdae-8b84-465e-83ca-195217d36c66_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/907974b8-7b19-4e11-b46d-ae94021a5ef8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/ec45f676-783b-4be5-9adb-2a7c5f2e9bb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/08a8bec3-62d4-4870-8572-e5f0c8c52677_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/9efff528-a4c0-4ec7-84db-76531497d6b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/7b9d87b6-1f22-4a3e-922c-7b22c6c6d2b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/0d3b5bf5-80f3-430b-917f-968c7a79b84b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/a42776ef-40bb-4ee9-8095-f6f0241c84c3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23 - 13K, 09/24 - 31K, 04/25 - 44K', 'remarks': '*322**VOSA STATES 52K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f1f41fb8-d69f-485a-9d3a-699077e95a8f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117269658, 'registration': 'NA72FRF', 'account': 'KIN032', 'make': 'CITROEN', 'model': 'C5 AIRCROSS HATCHBACK', 'derivative': '1.2 PureTech Shine 5dr', 'mileage': 54616, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-10-21', 'fuel': 'Petrol', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e35211e4-be2a-4e74-af6d-98ee75025880_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e5fefdae-8b84-465e-83ca-195217d36c66_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/907974b8-7b19-4e11-b46d-ae94021a5ef8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/ec45f676-783b-4be5-9adb-2a7c5f2e9bb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/08a8bec3-62d4-4870-8572-e5f0c8c52677_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/9efff528-a4c0-4ec7-84db-76531497d6b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/7b9d87b6-1f22-4a3e-922c-7b22c6c6d2b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/0d3b5bf5-80f3-430b-917f-968c7a79b84b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/a42776ef-40bb-4ee9-8095-f6f0241c84c3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23 - 13K, 09/24 - 31K, 04/25 - 44K', 'remarks': '*322**VOSA STATES 52K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f1f41fb8-d69f-485a-9d3a-699077e95a8f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8 with identifier: 117269658
2025-12-02 19:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8 with scrape type 1
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252Fe35211e4-be2a-4e74-af6d-98ee75025880_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e35211e4-be2a-4e74-af6d-98ee75025880_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117407792
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407792%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117407792: 0
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117660985
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660985%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117660985: 1
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252Fe5fefdae-8b84-465e-83ca-195217d36c66_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e5fefdae-8b84-465e-83ca-195217d36c66_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117605936
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605936%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117605936: 2
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252F907974b8-7b19-4e11-b46d-ae94021a5ef8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/907974b8-7b19-4e11-b46d-ae94021a5ef8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117399373, 'registration': 'NA72EBD', 'account': 'KIN032', 'make': 'KIA', 'model': 'SPORTAGE DIESEL ESTATE', 'derivative': '1.6 CRDi ISG 2 5dr', 'mileage': 19581, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-11-21', 'fuel': 'Diesel', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NA72EBD/2025-11-21/image/35d595a4-5675-4676-b10c-1c450d858a9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/14515f80-1e86-40c8-aa3f-a148c0b61deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/4774feed-21ec-4786-a3f1-a071dd14ae18_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/c31ede82-299e-400d-9fdd-8a80603eceda_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/f398c86a-ab30-47c1-bb49-e16fcc122718_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/a82e789a-6329-4bc9-b8b4-9f9d677c0037_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/183bfcfb-a202-4831-9ebe-441139da6047_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/74a86661-99c2-4297-968b-35685fd1cd59_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/6da92dc0-bc69-40b6-a629-f01c196dca2d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 12/23- 6K, 11/24- 13K, 10/25- 18K', 'remarks': '**243**VOSA STATES 18K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c50bd4eb-f060-4642-8369-4e03c6544d28.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117399373, 'registration': 'NA72EBD', 'account': 'KIN032', 'make': 'KIA', 'model': 'SPORTAGE DIESEL ESTATE', 'derivative': '1.6 CRDi ISG 2 5dr', 'mileage': 19581, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-11-21', 'fuel': 'Diesel', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NA72EBD/2025-11-21/image/35d595a4-5675-4676-b10c-1c450d858a9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/14515f80-1e86-40c8-aa3f-a148c0b61deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/4774feed-21ec-4786-a3f1-a071dd14ae18_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/c31ede82-299e-400d-9fdd-8a80603eceda_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/f398c86a-ab30-47c1-bb49-e16fcc122718_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/a82e789a-6329-4bc9-b8b4-9f9d677c0037_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/183bfcfb-a202-4831-9ebe-441139da6047_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/74a86661-99c2-4297-968b-35685fd1cd59_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/6da92dc0-bc69-40b6-a629-f01c196dca2d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 12/23- 6K, 11/24- 13K, 10/25- 18K', 'remarks': '**243**VOSA STATES 18K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c50bd4eb-f060-4642-8369-4e03c6544d28.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e184f423-723a-544a-aee9-25b0e9972bbb with identifier: 117399373
2025-12-02 19:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e184f423-723a-544a-aee9-25b0e9972bbb with scrape type 1
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item e184f423-723a-544a-aee9-25b0e9972bbb
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F35d595a4-5675-4676-b10c-1c450d858a9b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/35d595a4-5675-4676-b10c-1c450d858a9b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117411447, 'registration': 'FE73ZHL', 'account': 'KIN032', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.6 Plug-in Hybrid GS 5dr Auto', 'mileage': 21241, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-10-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/c1a8bf9b-8ee1-4a5a-b9fc-65b63fbf2e26_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/3f2f2fb1-b658-44ae-9b03-4275cc3c3cd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/66c5940b-c32b-487f-9425-c7eed27eec44_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/2002f4b1-4db4-41d7-966a-f036248b3964_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ae71e3a6-3041-418b-9761-c4f710a64c2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/db9e4ac8-1290-443e-ac15-e0005a9e8a5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/b6a58aa7-8c08-4678-8c1d-b217f01553fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ead2a8f3-31bf-4390-b343-733525cb4f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ab2f021c-6523-4ef3-930a-d9b58b8a283a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/20- 8K', 'remarks': '**344** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 28, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d644def2-d5bb-49ae-8bf0-eb80cf2bb6e6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117411447, 'registration': 'FE73ZHL', 'account': 'KIN032', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.6 Plug-in Hybrid GS 5dr Auto', 'mileage': 21241, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-10-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/c1a8bf9b-8ee1-4a5a-b9fc-65b63fbf2e26_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/3f2f2fb1-b658-44ae-9b03-4275cc3c3cd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/66c5940b-c32b-487f-9425-c7eed27eec44_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/2002f4b1-4db4-41d7-966a-f036248b3964_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ae71e3a6-3041-418b-9761-c4f710a64c2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/db9e4ac8-1290-443e-ac15-e0005a9e8a5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/b6a58aa7-8c08-4678-8c1d-b217f01553fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ead2a8f3-31bf-4390-b343-733525cb4f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ab2f021c-6523-4ef3-930a-d9b58b8a283a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/20- 8K', 'remarks': '**344** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 28, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d644def2-d5bb-49ae-8bf0-eb80cf2bb6e6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 778ed0e5-6670-5732-a457-03c3b097cdae with identifier: 117411447
2025-12-02 19:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 778ed0e5-6670-5732-a457-03c3b097cdae with scrape type 1
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 778ed0e5-6670-5732-a457-03c3b097cdae
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fc1a8bf9b-8ee1-4a5a-b9fc-65b63fbf2e26_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/c1a8bf9b-8ee1-4a5a-b9fc-65b63fbf2e26_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117444495, 'registration': 'NL72HVS', 'account': 'KIN032', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 Tekna+ 5dr', 'mileage': 25922, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-09-08', 'fuel': 'Petrol', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL72HVS/2025-11-24/image/9a78293d-2e45-4485-bee2-718e0e94f4d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/fc86b1c7-cfa1-4848-b758-e11e70b1947b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/5844fe8c-6076-4d11-ad2b-8d355b08345d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/69c8672c-3a2c-46d7-b798-cf471f04a014_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/a48e03f3-485c-4942-b31c-be4cb325d6fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/7c227297-c070-4aba-a884-5f65074913e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/52d151d2-daae-43a6-8ca8-e088dcdf8928_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/3fbbd393-873c-4aaf-8bd9-157dd75ab32f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/50ed4f4f-14ee-4a8e-afd9-61a589c7775f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/23 - 7K, 09/24 - 14K, 08/25 - 23K', 'remarks': '**280** VOSA STATES 23K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0b72df68-0b56-48db-b9a3-766325c86000.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117444495, 'registration': 'NL72HVS', 'account': 'KIN032', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 Tekna+ 5dr', 'mileage': 25922, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-09-08', 'fuel': 'Petrol', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL72HVS/2025-11-24/image/9a78293d-2e45-4485-bee2-718e0e94f4d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/fc86b1c7-cfa1-4848-b758-e11e70b1947b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/5844fe8c-6076-4d11-ad2b-8d355b08345d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/69c8672c-3a2c-46d7-b798-cf471f04a014_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/a48e03f3-485c-4942-b31c-be4cb325d6fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/7c227297-c070-4aba-a884-5f65074913e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/52d151d2-daae-43a6-8ca8-e088dcdf8928_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/3fbbd393-873c-4aaf-8bd9-157dd75ab32f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/50ed4f4f-14ee-4a8e-afd9-61a589c7775f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/23 - 7K, 09/24 - 14K, 08/25 - 23K', 'remarks': '**280** VOSA STATES 23K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0b72df68-0b56-48db-b9a3-766325c86000.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b2a6a6-02f1-5b26-a53e-170405e15852 with identifier: 117444495
2025-12-02 19:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b2a6a6-02f1-5b26-a53e-170405e15852 with scrape type 1
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 22b2a6a6-02f1-5b26-a53e-170405e15852
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F9a78293d-2e45-4485-bee2-718e0e94f4d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/9a78293d-2e45-4485-bee2-718e0e94f4d7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117605946
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605946%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117605946: 2
2025-12-02 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/ffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260567?view=catalogue)
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252Fec45f676-783b-4be5-9adb-2a7c5f2e9bb7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/ec45f676-783b-4be5-9adb-2a7c5f2e9bb7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F14515f80-1e86-40c8-aa3f-a148c0b61deb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/14515f80-1e86-40c8-aa3f-a148c0b61deb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252F3f2f2fb1-b658-44ae-9b03-4275cc3c3cd5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/3f2f2fb1-b658-44ae-9b03-4275cc3c3cd5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252Ffc86b1c7-cfa1-4848-b758-e11e70b1947b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/fc86b1c7-cfa1-4848-b758-e11e70b1947b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117045093
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117045093%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117045093: 2
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252F08a8bec3-62d4-4870-8572-e5f0c8c52677_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/08a8bec3-62d4-4870-8572-e5f0c8c52677_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F4774feed-21ec-4786-a3f1-a071dd14ae18_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/4774feed-21ec-4786-a3f1-a071dd14ae18_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252F66c5940b-c32b-487f-9425-c7eed27eec44_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/66c5940b-c32b-487f-9425-c7eed27eec44_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F5844fe8c-6076-4d11-ad2b-8d355b08345d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/5844fe8c-6076-4d11-ad2b-8d355b08345d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:05 [scrapy.extensions.logstats] INFO: Crawled 337 pages (at 66 pages/min), scraped 213 items (at 49 items/min)
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117407486
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407486%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117407486: 0
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117421105
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421105%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117421105: 0
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Found listing with ID: 117662441
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662441%27 HTTP/1.1" 200 None
2025-12-02 19:07:05 [astonbarclay.gb] INFO: Scrape type for 117662441: 1
2025-12-02 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117353225?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf065f890>
2025-12-02 19:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252Fffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/ffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ecc587c-496b-59ed-8a76-a9db935c478b
2025-12-02 19:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL72HVS/2025-11-24/image/9a78293d-2e45-4485-bee2-718e0e94f4d7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117444495?view=catalogue)
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252F9efff528-a4c0-4ec7-84db-76531497d6b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/9efff528-a4c0-4ec7-84db-76531497d6b0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252Fc31ede82-299e-400d-9fdd-8a80603eceda_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/c31ede82-299e-400d-9fdd-8a80603eceda_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252F2002f4b1-4db4-41d7-966a-f036248b3964_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/2002f4b1-4db4-41d7-966a-f036248b3964_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F69c8672c-3a2c-46d7-b798-cf471f04a014_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/69c8672c-3a2c-46d7-b798-cf471f04a014_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117625956?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:06 [astonbarclay.gb] INFO: Found listing with ID: 117667252
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117667252%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [astonbarclay.gb] INFO: Scrape type for 117667252: 1
2025-12-02 19:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252F7b9d87b6-1f22-4a3e-922c-7b22c6c6d2b7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/7b9d87b6-1f22-4a3e-922c-7b22c6c6d2b7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252Ff398c86a-ab30-47c1-bb49-e16fcc122718_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/f398c86a-ab30-47c1-bb49-e16fcc122718_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fae71e3a6-3041-418b-9761-c4f710a64c2b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ae71e3a6-3041-418b-9761-c4f710a64c2b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252Fa48e03f3-485c-4942-b31c-be4cb325d6fa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/a48e03f3-485c-4942-b31c-be4cb325d6fa_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [astonbarclay.gb] INFO: Found listing with ID: 117680503
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117680503%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [astonbarclay.gb] INFO: Scrape type for 117680503: 1
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252F0d3b5bf5-80f3-430b-917f-968c7a79b84b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/0d3b5bf5-80f3-430b-917f-968c7a79b84b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252Fa82e789a-6329-4bc9-b8b4-9f9d677c0037_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/a82e789a-6329-4bc9-b8b4-9f9d677c0037_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fdb9e4ac8-1290-443e-ac15-e0005a9e8a5e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/db9e4ac8-1290-443e-ac15-e0005a9e8a5e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F7c227297-c070-4aba-a884-5f65074913e4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/7c227297-c070-4aba-a884-5f65074913e4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117415829, 'registration': 'LN74OYX', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '210kW Match Pro 77kWh 5dr Auto', 'mileage': 16458, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-12', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/564cce15-2e8b-4452-9b14-23c2873f02c4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117415829, 'registration': 'LN74OYX', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '210kW Match Pro 77kWh 5dr Auto', 'mileage': 16458, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-12', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/564cce15-2e8b-4452-9b14-23c2873f02c4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33d7290d-cc06-57b8-b4b5-7609a19c2a74 with identifier: 117415829
2025-12-02 19:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74 with scrape type 2
2025-12-02 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74 with scrape type 2
2025-12-02 19:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 33d7290d-cc06-57b8-b4b5-7609a19c2a74, identifier: 117415829
2025-12-02 19:07:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117353225, 'registration': 'YC23JXL', 'account': 'KIN032', 'make': 'DACIA', 'model': 'DUSTER DIESEL ESTATE', 'derivative': '1.5 Blue dCi Expression 5dr 4X4', 'mileage': 21356, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-04-11', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1461, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YC23JXL/2025-11-19/image/e4a064ad-837f-4533-aded-a796934a93af_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/a16512e2-94f4-4130-8ae7-cc7d7d1ea837_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/b2edee8e-5c5a-44f4-b1ed-25830ea02a73_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/649f1ba4-d691-4a8d-b3d1-425e1f7a91cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/2ac3f7eb-7d60-4f67-9db3-f3d820cc56c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/ed61486d-93b9-4a71-9d0b-a7bfebaf19f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/fdeeb9aa-ee66-4eae-b1e8-bec9c44b0f39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/73b8ddb2-c1e3-42aa-8445-1ad59c5106b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/95142297-525b-493d-b651-34457721c118_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/23 - 15K, 10/24 - 17K,', 'remarks': '**216** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/18bd2191-2a14-4746-883e-96aa0a28b5a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117353225, 'registration': 'YC23JXL', 'account': 'KIN032', 'make': 'DACIA', 'model': 'DUSTER DIESEL ESTATE', 'derivative': '1.5 Blue dCi Expression 5dr 4X4', 'mileage': 21356, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-04-11', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1461, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YC23JXL/2025-11-19/image/e4a064ad-837f-4533-aded-a796934a93af_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/a16512e2-94f4-4130-8ae7-cc7d7d1ea837_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/b2edee8e-5c5a-44f4-b1ed-25830ea02a73_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/649f1ba4-d691-4a8d-b3d1-425e1f7a91cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/2ac3f7eb-7d60-4f67-9db3-f3d820cc56c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/ed61486d-93b9-4a71-9d0b-a7bfebaf19f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/fdeeb9aa-ee66-4eae-b1e8-bec9c44b0f39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/73b8ddb2-c1e3-42aa-8445-1ad59c5106b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/95142297-525b-493d-b651-34457721c118_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/23 - 15K, 10/24 - 17K,', 'remarks': '**216** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/18bd2191-2a14-4746-883e-96aa0a28b5a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9fe447e-d546-55e9-b9e6-e29c50579f5b with identifier: 117353225
2025-12-02 19:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9fe447e-d546-55e9-b9e6-e29c50579f5b with scrape type 1
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item c9fe447e-d546-55e9-b9e6-e29c50579f5b
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252Fe4a064ad-837f-4533-aded-a796934a93af_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/e4a064ad-837f-4533-aded-a796934a93af_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:07 [astonbarclay.gb] INFO: Found listing with ID: 117666471
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117666471%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [astonbarclay.gb] INFO: Scrape type for 117666471: 1
2025-12-02 19:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 33d7290d-cc06-57b8-b4b5-7609a19c2a74 with identifier: 117415829
2025-12-02 19:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 33d7290d-cc06-57b8-b4b5-7609a19c2a74 with identifier: 117415829
2025-12-02 19:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 210kw match pro 77kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 16458, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415829', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '210kw match pro 77kwh 5dr auto', 'license_plate': 'ln74oyx', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '33d7290d-cc06-57b8-b4b5-7609a19c2a74', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 26486} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '33d7290d-cc06-57b8-b4b5-7609a19c2a74',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ln74oyx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415829',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate',
     'model': 'id.4 estate',
     'odometer': 16458,
     'odometer_in_km': 26486,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-12',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.4 estate 210kw match pro 77kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw match pro 77kwh 5dr auto',
     'vin': None,
     'year': 2024}
2025-12-02 19:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 33d7290d-cc06-57b8-b4b5-7609a19c2a74 spider: astonbarclay.gb
2025-12-02 19:07:07 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 33d7290d-cc06-57b8-b4b5-7609a19c2a74 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 210kw match pro 77kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 16458, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415829', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '210kw match pro 77kwh 5dr auto', 'license_plate': 'ln74oyx', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '33d7290d-cc06-57b8-b4b5-7609a19c2a74', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 26486} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '33d7290d-cc06-57b8-b4b5-7609a19c2a74',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ln74oyx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415829',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate',
     'model': 'id.4 estate',
     'odometer': 16458,
     'odometer_in_km': 26486,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-12',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.4 estate 210kw match pro 77kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw match pro 77kwh 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '33d7290d-cc06-57b8-b4b5-7609a19c2a74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LN74OYX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415829',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'ID.4 ESTATE',
 'odometer': 16458,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-12',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN ID.4 ESTATE 210kW Match Pro 77kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '210kW Match Pro 77kWh 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415829%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [astonbarclay.gb] INFO: Saving data for 117415829: {'auction_closing_time': 1765792800.0, 'created_time': 1764615824.87923, 'last_price_update_time': 1764702427.444195}
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117415829') HTTP/1.1" 204 0
2025-12-02 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/66c5940b-c32b-487f-9425-c7eed27eec44_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411447?view=catalogue)
2025-12-02 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL72HVS/2025-11-24/image/5844fe8c-6076-4d11-ad2b-8d355b08345d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117444495?view=catalogue)
2025-12-02 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72EBD/2025-11-21/image/4774feed-21ec-4786-a3f1-a071dd14ae18_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399373?view=catalogue)
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252Fa42776ef-40bb-4ee9-8095-f6f0241c84c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/a42776ef-40bb-4ee9-8095-f6f0241c84c3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F183bfcfb-a202-4831-9ebe-441139da6047_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/183bfcfb-a202-4831-9ebe-441139da6047_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fb6a58aa7-8c08-4678-8c1d-b217f01553fd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/b6a58aa7-8c08-4678-8c1d-b217f01553fd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F52d151d2-daae-43a6-8ca8-e088dcdf8928_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/52d151d2-daae-43a6-8ca8-e088dcdf8928_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252Fa16512e2-94f4-4130-8ae7-cc7d7d1ea837_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/a16512e2-94f4-4130-8ae7-cc7d7d1ea837_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08fab90>
2025-12-02 19:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F9a78293d-2e45-4485-bee2-718e0e94f4d7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/9a78293d-2e45-4485-bee2-718e0e94f4d7_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22b2a6a6-02f1-5b26-a53e-170405e15852
2025-12-02 19:07:07 [astonbarclay.gb] INFO: Found listing with ID: 117660676
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660676%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [astonbarclay.gb] INFO: Scrape type for 117660676: 1
2025-12-02 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117217494?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117599419?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117087842?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F74a86661-99c2-4297-968b-35685fd1cd59_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/74a86661-99c2-4297-968b-35685fd1cd59_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fead2a8f3-31bf-4390-b343-733525cb4f03_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ead2a8f3-31bf-4390-b343-733525cb4f03_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F3fbbd393-873c-4aaf-8bd9-157dd75ab32f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/3fbbd393-873c-4aaf-8bd9-157dd75ab32f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252Fb2edee8e-5c5a-44f4-b1ed-25830ea02a73_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/b2edee8e-5c5a-44f4-b1ed-25830ea02a73_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:08 [astonbarclay.gb] INFO: Found listing with ID: 117660374
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660374%27 HTTP/1.1" 200 None
2025-12-02 19:07:08 [astonbarclay.gb] INFO: Scrape type for 117660374: 1
2025-12-02 19:07:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117625956, 'registration': 'LT75NVV', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Executive 5dr Auto', 'mileage': 1655, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-09-05', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ffa2c1d2-a88d-41bb-849f-c7303885101c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117625956, 'registration': 'LT75NVV', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Executive 5dr Auto', 'mileage': 1655, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-09-05', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ffa2c1d2-a88d-41bb-849f-c7303885101c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9996edc9-379f-5252-b45d-b27f85719929 with identifier: 117625956
2025-12-02 19:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9996edc9-379f-5252-b45d-b27f85719929 with scrape type 2
2025-12-02 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9996edc9-379f-5252-b45d-b27f85719929 with scrape type 2
2025-12-02 19:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9996edc9-379f-5252-b45d-b27f85719929, identifier: 117625956
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08e54d0>
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252F66c5940b-c32b-487f-9425-c7eed27eec44_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/66c5940b-c32b-487f-9425-c7eed27eec44_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 778ed0e5-6670-5732-a457-03c3b097cdae
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf2093150>
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F5844fe8c-6076-4d11-ad2b-8d355b08345d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/5844fe8c-6076-4d11-ad2b-8d355b08345d_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22b2a6a6-02f1-5b26-a53e-170405e15852
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0399850>
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F4774feed-21ec-4786-a3f1-a071dd14ae18_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/4774feed-21ec-4786-a3f1-a071dd14ae18_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e184f423-723a-544a-aee9-25b0e9972bbb
2025-12-02 19:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC23JXL/2025-11-19/image/e4a064ad-837f-4533-aded-a796934a93af_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117353225?view=catalogue)
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F6da92dc0-bc69-40b6-a629-f01c196dca2d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/6da92dc0-bc69-40b6-a629-f01c196dca2d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fab2f021c-6523-4ef3-930a-d9b58b8a283a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ab2f021c-6523-4ef3-930a-d9b58b8a283a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F50ed4f4f-14ee-4a8e-afd9-61a589c7775f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/50ed4f4f-14ee-4a8e-afd9-61a589c7775f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252F649f1ba4-d691-4a8d-b3d1-425e1f7a91cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/649f1ba4-d691-4a8d-b3d1-425e1f7a91cd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9996edc9-379f-5252-b45d-b27f85719929 with identifier: 117625956
2025-12-02 19:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9996edc9-379f-5252-b45d-b27f85719929 with identifier: 117625956
2025-12-02 19:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9996edc9-379f-5252-b45d-b27f85719929 with identifier: 117625956 to the API
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279996edc9-379f-5252-b45d-b27f85719929%27 HTTP/1.1" 200 None
2025-12-02 19:07:09 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9996edc9-379f-5252-b45d-b27f85719929: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:09 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117625956?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9996edc9-379f-5252-b45d-b27f85719929',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT75NVV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117625956',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK',
 'odometer': 1655,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-09-05',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 200 AMG Line Executive 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 200 AMG Line Executive 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625956%27 HTTP/1.1" 200 None
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Saving data for 117625956: {'auction_closing_time': 1765792800.0, 'created_time': 1764615726.70733, 'last_price_update_time': 1764702429.21001}
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117625956') HTTP/1.1" 204 0
2025-12-02 19:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/db9e4ac8-1290-443e-ac15-e0005a9e8a5e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411447?view=catalogue)
2025-12-02 19:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL72HVS/2025-11-24/image/7c227297-c070-4aba-a884-5f65074913e4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117444495?view=catalogue)
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Found listing with ID: 117659595
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117659595%27 HTTP/1.1" 200 None
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Scrape type for 117659595: 1
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252F2ac3f7eb-7d60-4f67-9db3-f3d820cc56c8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/2ac3f7eb-7d60-4f67-9db3-f3d820cc56c8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117416921, 'registration': 'LV24VUY', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 18895, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV24VUY/2025-11-25/image/354b23e8-7435-4583-a6e5-98f7080e99b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/412e036c-b41a-4409-8ff2-15242e796bd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/47bf93eb-86e5-4b1e-b422-c6ab74baf2f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/e918fe75-fb1b-41c3-b0ae-de85303bd5b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/d7fe0ebe-602a-47d4-881b-f5a911f9ab25_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/5568309f-8fd9-46c9-a927-68d10a3f2907_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/bdf87b18-11d9-46f6-afdb-9207355da6d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/aebf380c-8ebc-48aa-9974-792df1c3fe47_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/93ffa6d6-6b37-4cb5-8851-bec80ec86d7d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/85578af9-2326-4236-8167-acb0c0b1acd5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117416921, 'registration': 'LV24VUY', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 18895, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV24VUY/2025-11-25/image/354b23e8-7435-4583-a6e5-98f7080e99b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/412e036c-b41a-4409-8ff2-15242e796bd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/47bf93eb-86e5-4b1e-b422-c6ab74baf2f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/e918fe75-fb1b-41c3-b0ae-de85303bd5b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/d7fe0ebe-602a-47d4-881b-f5a911f9ab25_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/5568309f-8fd9-46c9-a927-68d10a3f2907_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/bdf87b18-11d9-46f6-afdb-9207355da6d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/aebf380c-8ebc-48aa-9974-792df1c3fe47_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/93ffa6d6-6b37-4cb5-8851-bec80ec86d7d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/85578af9-2326-4236-8167-acb0c0b1acd5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with identifier: 117416921
2025-12-02 19:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with scrape type 2
2025-12-02 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with scrape type 2
2025-12-02 19:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6071c6b2-0f41-5f72-90bd-eb2c31a3d527, identifier: 117416921
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117217494, 'registration': 'LY73UBS', 'account': 'MOT070', 'make': 'CITROEN', 'model': 'C3 AIRCROSS HATCHBACK', 'derivative': '1.2 PureTech 130 Max 5dr EAT6', 'mileage': 1765, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-01-31', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY73UBS/2025-11-25/image/ebb04199-2f10-4006-8340-496dad81126f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/ecc97fc0-dc6d-49e7-988f-65b448d1e0e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/707b5d12-802e-4683-b48d-c6b11b6e62f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/20ab2aa5-9a08-488f-8f6b-2b2efabcb2a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/fa330e75-945b-4ab8-989b-493441c178e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/fc6dda0e-1b8a-4d95-8577-1288a8da6465_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/dc5eabdf-adb0-4587-a5b2-e825d35bc852_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/deb806f8-0ade-4516-befe-45ab9ae2a366_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/b6b57f2b-60f9-4cc9-95d2-6a9ba9dfb458_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/2a34855b-dcbc-44e3-9030-3c7a74c32c93_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/30637315-60cb-431c-b58b-63707c4c6c06.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117217494, 'registration': 'LY73UBS', 'account': 'MOT070', 'make': 'CITROEN', 'model': 'C3 AIRCROSS HATCHBACK', 'derivative': '1.2 PureTech 130 Max 5dr EAT6', 'mileage': 1765, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-01-31', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY73UBS/2025-11-25/image/ebb04199-2f10-4006-8340-496dad81126f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/ecc97fc0-dc6d-49e7-988f-65b448d1e0e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/707b5d12-802e-4683-b48d-c6b11b6e62f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/20ab2aa5-9a08-488f-8f6b-2b2efabcb2a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/fa330e75-945b-4ab8-989b-493441c178e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/fc6dda0e-1b8a-4d95-8577-1288a8da6465_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/dc5eabdf-adb0-4587-a5b2-e825d35bc852_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/deb806f8-0ade-4516-befe-45ab9ae2a366_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/b6b57f2b-60f9-4cc9-95d2-6a9ba9dfb458_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY73UBS/2025-11-25/image/2a34855b-dcbc-44e3-9030-3c7a74c32c93_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/30637315-60cb-431c-b58b-63707c4c6c06.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d584faf-35f3-5cf6-9cf6-7e9cf10847bb with identifier: 117217494
2025-12-02 19:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d584faf-35f3-5cf6-9cf6-7e9cf10847bb with scrape type 2
2025-12-02 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d584faf-35f3-5cf6-9cf6-7e9cf10847bb with scrape type 2
2025-12-02 19:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1d584faf-35f3-5cf6-9cf6-7e9cf10847bb, identifier: 117217494
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117599419, 'registration': 'XGZ4127', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.2 MPi Premium 5dr Auto', 'mileage': 7260, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/XGZ4127/2025-11-29/image/414f3034-92f3-4ef2-9348-7a39364fccfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/9e2d38c8-8383-4aa3-9a65-aac87f5e348a_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/e2676681-00ab-4cfe-a60b-ba69dd212769_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/5db94439-5c8a-4bae-8477-1ce759384144_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/5371f1a3-8902-46f4-9b55-7029f8ae3bb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/7a369e2e-ec2b-499b-b1cf-2145dee93c07_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/cf43cdd5-53c1-477e-b75e-5e09b2b42816_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/2a9cd306-d84f-4693-9386-1d4a5ca1ab09_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/b6fc4c68-da51-4a07-953b-917edc85a44a_removebg.jpg?w=600'], 'colour': 'BRONZE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0dc21ae3-e8f2-4ddf-a754-aef543737d92.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117599419, 'registration': 'XGZ4127', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.2 MPi Premium 5dr Auto', 'mileage': 7260, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/XGZ4127/2025-11-29/image/414f3034-92f3-4ef2-9348-7a39364fccfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/9e2d38c8-8383-4aa3-9a65-aac87f5e348a_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/e2676681-00ab-4cfe-a60b-ba69dd212769_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/5db94439-5c8a-4bae-8477-1ce759384144_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/5371f1a3-8902-46f4-9b55-7029f8ae3bb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/7a369e2e-ec2b-499b-b1cf-2145dee93c07_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/cf43cdd5-53c1-477e-b75e-5e09b2b42816_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/2a9cd306-d84f-4693-9386-1d4a5ca1ab09_removebg.jpg?w=600', 'https://abimg003.imgix.net/XGZ4127/2025-11-29/image/b6fc4c68-da51-4a07-953b-917edc85a44a_removebg.jpg?w=600'], 'colour': 'BRONZE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0dc21ae3-e8f2-4ddf-a754-aef543737d92.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 315f3fad-e766-5601-b66d-391ac2355c03 with identifier: 117599419
2025-12-02 19:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 315f3fad-e766-5601-b66d-391ac2355c03 with scrape type 2
2025-12-02 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 315f3fad-e766-5601-b66d-391ac2355c03 with scrape type 2
2025-12-02 19:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 315f3fad-e766-5601-b66d-391ac2355c03, identifier: 117599419
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117087842, 'registration': 'LP74HZY', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'AUSTRAL ESTATE', 'derivative': 'E-Tech FHEV Iconic Esprit Alpine 5dr Auto', 'mileage': 8631, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-17', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP74HZY/2025-11-12/image/09b11760-090a-4d00-8bb4-6bb65e12f41d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/2095e6ef-5ee1-4b3e-9dba-8450a14b626a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/041141ee-9b2b-4f29-a381-c9068f2631e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/6dbb0efe-cebd-497f-b2d9-45d177a037ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/399afc64-662c-46ed-9753-88b8465a0c28_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/fae99931-2e04-47b1-891e-172d7c7d1232_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/6d85ba96-c5ef-49cf-817e-2c3018c8d828_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/c2bb8997-7d80-4103-bce2-3dc9a7922f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/7129a889-a750-4c94-bb73-e7140d3e6c4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/858f484c-8268-4734-b5fb-e10cee7222cb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3e95c39-32b2-480b-aa53-736a8cfd1304.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117087842, 'registration': 'LP74HZY', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'AUSTRAL ESTATE', 'derivative': 'E-Tech FHEV Iconic Esprit Alpine 5dr Auto', 'mileage': 8631, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-17', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP74HZY/2025-11-12/image/09b11760-090a-4d00-8bb4-6bb65e12f41d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/2095e6ef-5ee1-4b3e-9dba-8450a14b626a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/041141ee-9b2b-4f29-a381-c9068f2631e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/6dbb0efe-cebd-497f-b2d9-45d177a037ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/399afc64-662c-46ed-9753-88b8465a0c28_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/fae99931-2e04-47b1-891e-172d7c7d1232_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/6d85ba96-c5ef-49cf-817e-2c3018c8d828_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/c2bb8997-7d80-4103-bce2-3dc9a7922f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/7129a889-a750-4c94-bb73-e7140d3e6c4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/858f484c-8268-4734-b5fb-e10cee7222cb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3e95c39-32b2-480b-aa53-736a8cfd1304.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6cfee4e-4048-53f6-960e-9f5defdd1274 with identifier: 117087842
2025-12-02 19:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6cfee4e-4048-53f6-960e-9f5defdd1274 with scrape type 2
2025-12-02 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6cfee4e-4048-53f6-960e-9f5defdd1274 with scrape type 2
2025-12-02 19:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d6cfee4e-4048-53f6-960e-9f5defdd1274, identifier: 117087842
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117185008, 'registration': 'AP23VKB', 'account': 'MOT070', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '30 TFSI S Line 5dr', 'mileage': 33982, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4028a888-6714-4fe7-8672-1bfb808745ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/5a35829f-1fac-48a5-9644-d6b708c9dacf_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/a476a35b-c2c9-4f1d-b573-70ed1785a53b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/73b8cc7a-bea7-4a20-b83b-06d3cb3603e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6827af7d-8ef4-40a8-83ab-6c1644cb8ac4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/40f55a5d-86b6-46c9-b3ed-6aa2fb02781e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/b2fd1c98-6d01-4cfd-abb7-8fe2365fc477_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4c7837b0-f5ad-4a33-b31a-c23f0903389c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6704290f-a77a-4d02-81e4-97488e185212_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/24 14k - 02/25 21k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6959bb19-d6ce-4cf6-bc6d-30f98c98347b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117185008, 'registration': 'AP23VKB', 'account': 'MOT070', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '30 TFSI S Line 5dr', 'mileage': 33982, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4028a888-6714-4fe7-8672-1bfb808745ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/5a35829f-1fac-48a5-9644-d6b708c9dacf_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/a476a35b-c2c9-4f1d-b573-70ed1785a53b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/73b8cc7a-bea7-4a20-b83b-06d3cb3603e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6827af7d-8ef4-40a8-83ab-6c1644cb8ac4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/40f55a5d-86b6-46c9-b3ed-6aa2fb02781e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/b2fd1c98-6d01-4cfd-abb7-8fe2365fc477_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4c7837b0-f5ad-4a33-b31a-c23f0903389c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6704290f-a77a-4d02-81e4-97488e185212_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/24 14k - 02/25 21k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6959bb19-d6ce-4cf6-bc6d-30f98c98347b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with identifier: 117185008
2025-12-02 19:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with scrape type 2
2025-12-02 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with scrape type 2
2025-12-02 19:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4bc2920f-55ca-53ab-84a8-db2242b7bc17, identifier: 117185008
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Found listing with ID: 117407455
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407455%27 HTTP/1.1" 200 None
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Scrape type for 117407455: 0
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Found listing with ID: 116997220
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997220%27 HTTP/1.1" 200 None
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Scrape type for 116997220: 0
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Found listing with ID: 117679098
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117679098%27 HTTP/1.1" 200 None
2025-12-02 19:07:09 [astonbarclay.gb] INFO: Scrape type for 117679098: 1
2025-12-02 19:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with identifier: 117416921
2025-12-02 19:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with identifier: 117416921
2025-12-02 19:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with identifier: 117416921 to the API
2025-12-02 19:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6071c6b2-0f41-5f72-90bd-eb2c31a3d527',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV24VUY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117416921',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 18895,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-18',
 'seller_name': 'Motability Operations',
 'title': 'AUDI Q2 ESTATE 35 TFSI S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI S Line 5dr S Tronic',
 'vin': None,
 'year': 2024}
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117416921%27 HTTP/1.1" 200 None
2025-12-02 19:07:10 [astonbarclay.gb] INFO: Saving data for 117416921: {'auction_closing_time': 1765792800.0, 'created_time': 1764615742.409494, 'last_price_update_time': 1764702430.124666}
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117416921') HTTP/1.1" 204 0
2025-12-02 19:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1d584faf-35f3-5cf6-9cf6-7e9cf10847bb with identifier: 117217494
2025-12-02 19:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1d584faf-35f3-5cf6-9cf6-7e9cf10847bb with identifier: 117217494
2025-12-02 19:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1d584faf-35f3-5cf6-9cf6-7e9cf10847bb with identifier: 117217494 to the API
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117217494?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1d584faf-35f3-5cf6-9cf6-7e9cf10847bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LY73UBS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117217494',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'CITROEN',
 'model': 'C3 AIRCROSS HATCHBACK',
 'odometer': 1765,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-31',
 'seller_name': 'Motability Operations',
 'title': 'CITROEN C3 AIRCROSS HATCHBACK 1.2 PureTech 130 Max 5dr EAT6',
 'transmission': 'automatic',
 'trim': '1.2 PureTech 130 Max 5dr EAT6',
 'vin': None,
 'year': 2024}
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217494%27 HTTP/1.1" 200 None
2025-12-02 19:07:10 [astonbarclay.gb] INFO: Saving data for 117217494: {'auction_closing_time': 1765792800.0, 'created_time': 1763542888.38587, 'last_price_update_time': 1764702430.450392}
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117217494') HTTP/1.1" 204 0
2025-12-02 19:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 315f3fad-e766-5601-b66d-391ac2355c03 with identifier: 117599419
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BRONZE HTTP/1.1" 200 None
2025-12-02 19:07:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 315f3fad-e766-5601-b66d-391ac2355c03 with identifier: 117599419
2025-12-02 19:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 315f3fad-e766-5601-b66d-391ac2355c03 with identifier: 117599419 to the API
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27315f3fad-e766-5601-b66d-391ac2355c03%27 HTTP/1.1" 200 None
2025-12-02 19:07:10 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 315f3fad-e766-5601-b66d-391ac2355c03: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:10 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117599419?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BRONZE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '315f3fad-e766-5601-b66d-391ac2355c03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'XGZ4127',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599419',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'I10 HATCHBACK',
 'odometer': 7260,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-23',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI I10 HATCHBACK 1.2 MPi Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 MPi Premium 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599419%27 HTTP/1.1" 200 None
2025-12-02 19:07:10 [astonbarclay.gb] INFO: Saving data for 117599419: {'auction_closing_time': 1765792800.0, 'created_time': 1764356663.777281, 'last_price_update_time': 1764702430.943771}
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117599419') HTTP/1.1" 204 0
2025-12-02 19:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d6cfee4e-4048-53f6-960e-9f5defdd1274 with identifier: 117087842
2025-12-02 19:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d6cfee4e-4048-53f6-960e-9f5defdd1274 with identifier: 117087842
2025-12-02 19:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d6cfee4e-4048-53f6-960e-9f5defdd1274 with identifier: 117087842 to the API
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117087842?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'd6cfee4e-4048-53f6-960e-9f5defdd1274',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP74HZY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117087842',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'AUSTRAL ESTATE',
 'odometer': 8631,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-17',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT AUSTRAL ESTATE E-Tech FHEV Iconic Esprit Alpine 5dr Auto',
 'transmission': 'automatic',
 'trim': 'E-Tech FHEV Iconic Esprit Alpine 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117087842%27 HTTP/1.1" 200 None
2025-12-02 19:07:11 [astonbarclay.gb] INFO: Saving data for 117087842: {'auction_closing_time': 1765792800.0, 'created_time': 1763579108.273437, 'last_price_update_time': 1764702431.225093}
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117087842') HTTP/1.1" 204 0
2025-12-02 19:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with identifier: 117185008
2025-12-02 19:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with identifier: 117185008
2025-12-02 19:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with identifier: 117185008 to the API
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4bc2920f-55ca-53ab-84a8-db2242b7bc17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AP23VKB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117185008',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 33982,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-18',
 'seller_name': 'Motability Operations',
 'title': 'AUDI A3 SPORTBACK 30 TFSI S Line 5dr',
 'transmission': 'manual',
 'trim': '30 TFSI S Line 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117185008%27 HTTP/1.1" 200 None
2025-12-02 19:07:11 [astonbarclay.gb] INFO: Saving data for 117185008: {'auction_closing_time': 1765792800.0, 'created_time': 1764615763.855013, 'last_price_update_time': 1764702431.499603}
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117185008') HTTP/1.1" 204 0
2025-12-02 19:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC23JXL/2025-11-19/image/a16512e2-94f4-4130-8ae7-cc7d7d1ea837_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117353225?view=catalogue)
2025-12-02 19:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC23JXL/2025-11-19/image/b2edee8e-5c5a-44f4-b1ed-25830ea02a73_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117353225?view=catalogue)
2025-12-02 19:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/b6a58aa7-8c08-4678-8c1d-b217f01553fd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411447?view=catalogue)
2025-12-02 19:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72EBD/2025-11-21/image/183bfcfb-a202-4831-9ebe-441139da6047_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399373?view=catalogue)
2025-12-02 19:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL72HVS/2025-11-24/image/52d151d2-daae-43a6-8ca8-e088dcdf8928_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117444495?view=catalogue)
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252Fed61486d-93b9-4a71-9d0b-a7bfebaf19f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/ed61486d-93b9-4a71-9d0b-a7bfebaf19f2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1e5c290>
2025-12-02 19:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252Fe4a064ad-837f-4533-aded-a796934a93af_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/e4a064ad-837f-4533-aded-a796934a93af_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9fe447e-d546-55e9-b9e6-e29c50579f5b
2025-12-02 19:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL72HVS/2025-11-24/image/3fbbd393-873c-4aaf-8bd9-157dd75ab32f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117444495?view=catalogue)
2025-12-02 19:07:11 [astonbarclay.gb] INFO: Found listing with ID: 117633313
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633313%27 HTTP/1.1" 200 None
2025-12-02 19:07:11 [astonbarclay.gb] INFO: Scrape type for 117633313: 2
2025-12-02 19:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117219838?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116888595?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117399206?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252Ffdeeb9aa-ee66-4eae-b1e8-bec9c44b0f39_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/fdeeb9aa-ee66-4eae-b1e8-bec9c44b0f39_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:11 [astonbarclay.gb] INFO: Found listing with ID: 116269848
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116269848%27 HTTP/1.1" 200 None
2025-12-02 19:07:11 [astonbarclay.gb] INFO: Scrape type for 116269848: 0
2025-12-02 19:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0394910>
2025-12-02 19:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fdb9e4ac8-1290-443e-ac15-e0005a9e8a5e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/db9e4ac8-1290-443e-ac15-e0005a9e8a5e_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 778ed0e5-6670-5732-a457-03c3b097cdae
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b82310>
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F7c227297-c070-4aba-a884-5f65074913e4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/7c227297-c070-4aba-a884-5f65074913e4_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22b2a6a6-02f1-5b26-a53e-170405e15852
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a9ab90>
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252Fa16512e2-94f4-4130-8ae7-cc7d7d1ea837_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/a16512e2-94f4-4130-8ae7-cc7d7d1ea837_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9fe447e-d546-55e9-b9e6-e29c50579f5b
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0932ad0>
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252Fb2edee8e-5c5a-44f4-b1ed-25830ea02a73_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/b2edee8e-5c5a-44f4-b1ed-25830ea02a73_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9fe447e-d546-55e9-b9e6-e29c50579f5b
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf096a550>
2025-12-02 19:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fb6a58aa7-8c08-4678-8c1d-b217f01553fd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/b6a58aa7-8c08-4678-8c1d-b217f01553fd_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 778ed0e5-6670-5732-a457-03c3b097cdae
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0407410>
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F183bfcfb-a202-4831-9ebe-441139da6047_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/183bfcfb-a202-4831-9ebe-441139da6047_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e184f423-723a-544a-aee9-25b0e9972bbb
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06cd9d0>
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F52d151d2-daae-43a6-8ca8-e088dcdf8928_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/52d151d2-daae-43a6-8ca8-e088dcdf8928_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22b2a6a6-02f1-5b26-a53e-170405e15852
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252F73b8ddb2-c1e3-42aa-8445-1ad59c5106b6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/73b8ddb2-c1e3-42aa-8445-1ad59c5106b6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC23JXL/2025-11-19/image/2ac3f7eb-7d60-4f67-9db3-f3d820cc56c8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117353225?view=catalogue)
2025-12-02 19:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC23JXL/2025-11-19/image/649f1ba4-d691-4a8d-b3d1-425e1f7a91cd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117353225?view=catalogue)
2025-12-02 19:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL72HVS/2025-11-24/image/50ed4f4f-14ee-4a8e-afd9-61a589c7775f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117444495?view=catalogue)
2025-12-02 19:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ab2f021c-6523-4ef3-930a-d9b58b8a283a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411447?view=catalogue)
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252F95142297-525b-493d-b651-34457721c118_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/95142297-525b-493d-b651-34457721c118_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662441?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117690352?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117399593?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117474004?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04eeb50>
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F3fbbd393-873c-4aaf-8bd9-157dd75ab32f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/3fbbd393-873c-4aaf-8bd9-157dd75ab32f_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22b2a6a6-02f1-5b26-a53e-170405e15852
2025-12-02 19:07:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117219838, 'registration': 'NA72HVL', 'account': 'KIN032', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '30 TFSI Technik 5dr', 'mileage': 40606, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-10-14', 'fuel': 'Petrol', 'motExpiry': '2026-10-13', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NA72HVL/2025-11-14/image/5cb56246-25be-4ad8-bbf0-a067d32e0ed2_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/6b5187d2-220d-4de6-97dc-f21cf8bf3d21_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/880056de-5220-47aa-b309-5925b828182d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/76de69b3-76ff-46c2-b2ec-3d4333a177f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/4e71865c-6d62-4cd0-9489-64120bb7b316_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/904a4557-b1ea-44fe-afd1-40b6d7d7abbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/9696f272-4fe2-41e8-8554-618c99227cf5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/606a1920-2a5d-4c14-8346-0a1835793aeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/7f62dda6-bde8-4f7b-b2be-87dd0daae7b1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 09/23- 12K, 10/24 - 19K, 04/24 - 19K,12/24- 28K, 09/25 - 38K', 'remarks': '**264**VOSA STATES 39K  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/27ed471b-4ee4-4da1-b175-1ea84a4e0434.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117219838, 'registration': 'NA72HVL', 'account': 'KIN032', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '30 TFSI Technik 5dr', 'mileage': 40606, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-10-14', 'fuel': 'Petrol', 'motExpiry': '2026-10-13', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NA72HVL/2025-11-14/image/5cb56246-25be-4ad8-bbf0-a067d32e0ed2_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/6b5187d2-220d-4de6-97dc-f21cf8bf3d21_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/880056de-5220-47aa-b309-5925b828182d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/76de69b3-76ff-46c2-b2ec-3d4333a177f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/4e71865c-6d62-4cd0-9489-64120bb7b316_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/904a4557-b1ea-44fe-afd1-40b6d7d7abbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/9696f272-4fe2-41e8-8554-618c99227cf5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/606a1920-2a5d-4c14-8346-0a1835793aeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/7f62dda6-bde8-4f7b-b2be-87dd0daae7b1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 09/23- 12K, 10/24 - 19K, 04/24 - 19K,12/24- 28K, 09/25 - 38K', 'remarks': '**264**VOSA STATES 39K  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/27ed471b-4ee4-4da1-b175-1ea84a4e0434.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07009895-e542-5e3b-a5f2-179c007b5a49 with identifier: 117219838
2025-12-02 19:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07009895-e542-5e3b-a5f2-179c007b5a49 with scrape type 1
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 07009895-e542-5e3b-a5f2-179c007b5a49
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F5cb56246-25be-4ad8-bbf0-a067d32e0ed2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/5cb56246-25be-4ad8-bbf0-a067d32e0ed2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116888595, 'registration': 'LO25ZDR', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Executive 5dr Auto', 'mileage': 1408, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-08-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/d919b479-8ea4-4882-ab37-0ffbe0be7271_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/257124ea-36e5-489a-a209-2a3e95302a30_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/f2f8e100-6568-4705-8856-88b5f2707553_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/5f27bc21-73a8-481d-b7d9-354a825067c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/e8b89196-1dfc-4fd0-9046-2f59504f1295_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/329db351-8507-4707-9b03-2ef5e6e7db97_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/886fcbbf-fcab-43c1-97ad-cd5d63986d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/ec6f1a84-ab1b-4981-ab2a-28f14f4dcf67_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/70ad4439-382e-47c2-92ec-f5b070135bf0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/393d4453-d25e-4437-b3af-b4bb6b1491ab_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/04886749-59e5-4c94-bef2-b870eb7f0279.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116888595, 'registration': 'LO25ZDR', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Executive 5dr Auto', 'mileage': 1408, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-08-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/d919b479-8ea4-4882-ab37-0ffbe0be7271_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/257124ea-36e5-489a-a209-2a3e95302a30_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/f2f8e100-6568-4705-8856-88b5f2707553_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/5f27bc21-73a8-481d-b7d9-354a825067c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/e8b89196-1dfc-4fd0-9046-2f59504f1295_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/329db351-8507-4707-9b03-2ef5e6e7db97_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/886fcbbf-fcab-43c1-97ad-cd5d63986d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/ec6f1a84-ab1b-4981-ab2a-28f14f4dcf67_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/70ad4439-382e-47c2-92ec-f5b070135bf0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/393d4453-d25e-4437-b3af-b4bb6b1491ab_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/04886749-59e5-4c94-bef2-b870eb7f0279.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfc36008-d37a-5e84-9041-80ad3a50107c with identifier: 116888595
2025-12-02 19:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfc36008-d37a-5e84-9041-80ad3a50107c with scrape type 2
2025-12-02 19:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfc36008-d37a-5e84-9041-80ad3a50107c with scrape type 2
2025-12-02 19:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dfc36008-d37a-5e84-9041-80ad3a50107c, identifier: 116888595
2025-12-02 19:07:14 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117399206, 'registration': 'EJ71XRK', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK SPECIAL EDITIONS', 'derivative': 'A180 Sport Executive Edition 5dr Auto', 'mileage': 59863, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-01-17', 'fuel': 'Petrol', 'motExpiry': '2026-01-16', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/0485b9e6-087d-4065-b0d3-993fb98a9848_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/45b2b48e-d577-4e1e-bd3e-354fd23137f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/64e01ad7-7363-4297-a1cd-5a4f911cb64e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/412521d2-d6bc-43cd-8c33-293c1b879c02_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ff471089-550e-4bff-9319-a9511211a554_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/139ef87c-a9bf-4547-af22-c889987b7908_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/b9d30f7d-5df2-4f8b-92e9-514a85d72be4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ac622126-56ef-4180-8b25-bdc9a17170a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/f96afaff-0944-4cf4-8818-df81cc9841ac_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/23 - 28K,', 'remarks': '**250**VOSA STATES 45K, OUSTANDING RECALL', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3670cefa-f308-4624-83da-b4188f8b9ae8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:14 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117399206, 'registration': 'EJ71XRK', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK SPECIAL EDITIONS', 'derivative': 'A180 Sport Executive Edition 5dr Auto', 'mileage': 59863, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-01-17', 'fuel': 'Petrol', 'motExpiry': '2026-01-16', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/0485b9e6-087d-4065-b0d3-993fb98a9848_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/45b2b48e-d577-4e1e-bd3e-354fd23137f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/64e01ad7-7363-4297-a1cd-5a4f911cb64e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/412521d2-d6bc-43cd-8c33-293c1b879c02_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ff471089-550e-4bff-9319-a9511211a554_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/139ef87c-a9bf-4547-af22-c889987b7908_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/b9d30f7d-5df2-4f8b-92e9-514a85d72be4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ac622126-56ef-4180-8b25-bdc9a17170a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/f96afaff-0944-4cf4-8818-df81cc9841ac_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/23 - 28K,', 'remarks': '**250**VOSA STATES 45K, OUSTANDING RECALL', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3670cefa-f308-4624-83da-b4188f8b9ae8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f1374dc-a8ec-5154-9f62-7fffea2ed3df with identifier: 117399206
2025-12-02 19:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df with scrape type 1
2025-12-02 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252F0485b9e6-087d-4065-b0d3-993fb98a9848_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/0485b9e6-087d-4065-b0d3-993fb98a9848_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dfc36008-d37a-5e84-9041-80ad3a50107c with identifier: 116888595
2025-12-02 19:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dfc36008-d37a-5e84-9041-80ad3a50107c with identifier: 116888595
2025-12-02 19:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: dfc36008-d37a-5e84-9041-80ad3a50107c with identifier: 116888595 to the API
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116888595?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'dfc36008-d37a-5e84-9041-80ad3a50107c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LO25ZDR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116888595',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK',
 'odometer': 1408,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-08-18',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 200 AMG Line Executive 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 200 AMG Line Executive 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116888595%27 HTTP/1.1" 200 None
2025-12-02 19:07:14 [astonbarclay.gb] INFO: Saving data for 116888595: {'auction_closing_time': 1765792800.0, 'created_time': 1764184010.642484, 'last_price_update_time': 1764702434.406985}
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116888595') HTTP/1.1" 204 0
2025-12-02 19:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC23JXL/2025-11-19/image/ed61486d-93b9-4a71-9d0b-a7bfebaf19f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117353225?view=catalogue)
2025-12-02 19:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72EBD/2025-11-21/image/6da92dc0-bc69-40b6-a629-f01c196dca2d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399373?view=catalogue)
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F6b5187d2-220d-4de6-97dc-f21cf8bf3d21_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/6b5187d2-220d-4de6-97dc-f21cf8bf3d21_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252F45b2b48e-d577-4e1e-bd3e-354fd23137f8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/45b2b48e-d577-4e1e-bd3e-354fd23137f8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0406e10>
2025-12-02 19:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252F2ac3f7eb-7d60-4f67-9db3-f3d820cc56c8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/2ac3f7eb-7d60-4f67-9db3-f3d820cc56c8_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9fe447e-d546-55e9-b9e6-e29c50579f5b
2025-12-02 19:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066e210>
2025-12-02 19:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252F649f1ba4-d691-4a8d-b3d1-425e1f7a91cd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/649f1ba4-d691-4a8d-b3d1-425e1f7a91cd_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9fe447e-d546-55e9-b9e6-e29c50579f5b
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf20281d0>
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F50ed4f4f-14ee-4a8e-afd9-61a589c7775f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/50ed4f4f-14ee-4a8e-afd9-61a589c7775f_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22b2a6a6-02f1-5b26-a53e-170405e15852
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04277d0>
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fab2f021c-6523-4ef3-930a-d9b58b8a283a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ab2f021c-6523-4ef3-930a-d9b58b8a283a_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 778ed0e5-6670-5732-a457-03c3b097cdae
2025-12-02 19:07:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662441, 'registration': 'HK70XWV', 'account': 'RCI014', 'make': 'RENAULT', 'model': 'ZOE HATCHBACK', 'derivative': '100kW i GT Line R135 50kWh Rapid Charge 5dr Auto', 'mileage': 19312, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-12-17', 'fuel': 'Electric', 'motExpiry': '2026-10-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 9K 14K 18K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/951e5ea5-e382-4a9f-a576-c95dadb36714.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662441, 'registration': 'HK70XWV', 'account': 'RCI014', 'make': 'RENAULT', 'model': 'ZOE HATCHBACK', 'derivative': '100kW i GT Line R135 50kWh Rapid Charge 5dr Auto', 'mileage': 19312, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-12-17', 'fuel': 'Electric', 'motExpiry': '2026-10-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 9K 14K 18K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/951e5ea5-e382-4a9f-a576-c95dadb36714.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ccb990d-8de2-53d1-bd35-49aec4b4ef84 with identifier: 117662441
2025-12-02 19:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ccb990d-8de2-53d1-bd35-49aec4b4ef84 with scrape type 1
2025-12-02 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7ccb990d-8de2-53d1-bd35-49aec4b4ef84
2025-12-02 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7ccb990d-8de2-53d1-bd35-49aec4b4ef84
2025-12-02 19:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7ccb990d-8de2-53d1-bd35-49aec4b4ef84, identifier: 117662441
2025-12-02 19:07:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117690352, 'registration': 'YB71JYK', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta 5dr Xtronic', 'mileage': 57365, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-12-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 41K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a66a679-e595-41ca-b302-d7e5fa0d71b0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117690352, 'registration': 'YB71JYK', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta 5dr Xtronic', 'mileage': 57365, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-12-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 41K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a66a679-e595-41ca-b302-d7e5fa0d71b0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2590e077-8052-5865-849e-f7cff4709701 with identifier: 117690352
2025-12-02 19:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2590e077-8052-5865-849e-f7cff4709701 with scrape type 1
2025-12-02 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2590e077-8052-5865-849e-f7cff4709701
2025-12-02 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2590e077-8052-5865-849e-f7cff4709701
2025-12-02 19:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2590e077-8052-5865-849e-f7cff4709701, identifier: 117690352
2025-12-02 19:07:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117492820, 'registration': 'LN73OFU', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 20465, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-12-14', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LN73OFU/2025-11-27/image/78f7c909-3bf2-4c31-aaf7-b56b4f56787a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/921414e8-64e3-448b-a152-f2e85f71fb43_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/b3bd0ada-53fe-47b8-a0ce-b3eaf660abbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/be2d3a6c-129c-4222-a0a2-8ea76016b1a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/996933d0-7acf-45f9-b2db-93487c637ed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/20c329c2-4789-4011-9437-56b7d16d0930_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/1f8e0753-883a-4bc4-bb1d-cce4fddfed12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/45f27f64-03f4-40e9-ad51-11ed32688d29_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/54e18268-bd12-40ae-a9cb-b13f9d777c3a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/24 9k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFCE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/282f6c85-c576-418e-8cc1-509b0b15c8d0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117492820, 'registration': 'LN73OFU', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 20465, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-12-14', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LN73OFU/2025-11-27/image/78f7c909-3bf2-4c31-aaf7-b56b4f56787a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/921414e8-64e3-448b-a152-f2e85f71fb43_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/b3bd0ada-53fe-47b8-a0ce-b3eaf660abbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/be2d3a6c-129c-4222-a0a2-8ea76016b1a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/996933d0-7acf-45f9-b2db-93487c637ed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/20c329c2-4789-4011-9437-56b7d16d0930_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/1f8e0753-883a-4bc4-bb1d-cce4fddfed12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/45f27f64-03f4-40e9-ad51-11ed32688d29_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/54e18268-bd12-40ae-a9cb-b13f9d777c3a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/24 9k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFCE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/282f6c85-c576-418e-8cc1-509b0b15c8d0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with identifier: 117492820
2025-12-02 19:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with scrape type 2
2025-12-02 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with scrape type 2
2025-12-02 19:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f2b4c2d7-187b-5876-a316-a5afbbcf6cdf, identifier: 117492820
2025-12-02 19:07:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117399593, 'registration': 'ML73UCA', 'account': 'STE131', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT 5dr EAT8', 'mileage': 3886, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2023-09-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ML73UCA/2025-11-21/image/6cf6ec1f-a968-4c08-8234-382fa4d483d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/1a8bb398-905b-431e-8f73-7ae746d9a240_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/96b6413b-e82c-47d3-ad3a-93414cba58ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/90826264-4972-45e7-ab81-31cce49a2ec0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/3354e15f-f9a2-4280-848c-78f1345d4839_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/355d477b-dfc4-4cde-962d-470e49c7b236_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/313191a0-2728-4377-b4f9-dbb75e9ae989_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/6d91600f-b990-40c4-9ef3-4bc7b7f98d6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/6be0ad7f-d31b-4ef7-b67d-72ddfc52661b_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/c032ed46-5edc-403e-b30a-532d9ce6328e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/8d6eba95-77b1-4890-9a2f-5c2709f3c4f2_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ee3dccda-3448-41a6-bf24-1bff154228a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117399593, 'registration': 'ML73UCA', 'account': 'STE131', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech 130 GT 5dr EAT8', 'mileage': 3886, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2023-09-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ML73UCA/2025-11-21/image/6cf6ec1f-a968-4c08-8234-382fa4d483d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/1a8bb398-905b-431e-8f73-7ae746d9a240_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/96b6413b-e82c-47d3-ad3a-93414cba58ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/90826264-4972-45e7-ab81-31cce49a2ec0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/3354e15f-f9a2-4280-848c-78f1345d4839_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/355d477b-dfc4-4cde-962d-470e49c7b236_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/313191a0-2728-4377-b4f9-dbb75e9ae989_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/6d91600f-b990-40c4-9ef3-4bc7b7f98d6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/6be0ad7f-d31b-4ef7-b67d-72ddfc52661b_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/c032ed46-5edc-403e-b30a-532d9ce6328e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML73UCA/2025-11-21/image/8d6eba95-77b1-4890-9a2f-5c2709f3c4f2_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ee3dccda-3448-41a6-bf24-1bff154228a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60f8064a-b9bd-574a-91bf-ae0fa21ad783 with identifier: 117399593
2025-12-02 19:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60f8064a-b9bd-574a-91bf-ae0fa21ad783 with scrape type 2
2025-12-02 19:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60f8064a-b9bd-574a-91bf-ae0fa21ad783 with scrape type 2
2025-12-02 19:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 60f8064a-b9bd-574a-91bf-ae0fa21ad783, identifier: 117399593
2025-12-02 19:07:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117474004, 'registration': 'DU24MBV', 'account': 'STE131', 'make': 'CITROEN', 'model': 'E-C4 X ELECTRIC SALOON', 'derivative': '100kW E-Series 50kWh 4dr Auto', 'mileage': 13698, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2024-04-30', 'fuel': 'Electric', 'motExpiry': None, 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/DU24MBV/2025-11-25/image/c75b21f1-2959-4a37-bb55-fba796dd3fd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/7f63faef-163d-4c99-bb93-3e9bed33900a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/7643b9c6-11c5-4cd2-88e7-ea87562b4968_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/5a4e7fc4-1396-4f4a-98b3-c35f3b8f9833_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/796b33c7-3ee0-4451-89cf-6065c01244a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/c1fd68b7-3824-4171-8b9e-378640561fae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/f0d98a38-31c6-4025-8796-bd46d09a2ca8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/a5839b38-e312-452e-9609-52ffb1377777_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/788a6751-a775-4c15-808e-729d7005240b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/477933e8-b0f9-469e-982c-0fe434594a76_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/f9558be7-39b4-4adb-9879-b85ad12f0117_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/97f2269e-ee3b-4e5f-b895-864eeffb2378_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/94fa89c6-adbb-4f9a-ad96-b6facd03f04a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117474004, 'registration': 'DU24MBV', 'account': 'STE131', 'make': 'CITROEN', 'model': 'E-C4 X ELECTRIC SALOON', 'derivative': '100kW E-Series 50kWh 4dr Auto', 'mileage': 13698, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2024-04-30', 'fuel': 'Electric', 'motExpiry': None, 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/DU24MBV/2025-11-25/image/c75b21f1-2959-4a37-bb55-fba796dd3fd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/7f63faef-163d-4c99-bb93-3e9bed33900a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/7643b9c6-11c5-4cd2-88e7-ea87562b4968_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/5a4e7fc4-1396-4f4a-98b3-c35f3b8f9833_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/796b33c7-3ee0-4451-89cf-6065c01244a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/c1fd68b7-3824-4171-8b9e-378640561fae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/f0d98a38-31c6-4025-8796-bd46d09a2ca8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/a5839b38-e312-452e-9609-52ffb1377777_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/788a6751-a775-4c15-808e-729d7005240b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/477933e8-b0f9-469e-982c-0fe434594a76_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/f9558be7-39b4-4adb-9879-b85ad12f0117_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU24MBV/2025-11-25/image/97f2269e-ee3b-4e5f-b895-864eeffb2378_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/94fa89c6-adbb-4f9a-ad96-b6facd03f04a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48277f6-61e8-5dfb-b85f-0b2ade04550b with identifier: 117474004
2025-12-02 19:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48277f6-61e8-5dfb-b85f-0b2ade04550b with scrape type 2
2025-12-02 19:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f48277f6-61e8-5dfb-b85f-0b2ade04550b with scrape type 2
2025-12-02 19:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f48277f6-61e8-5dfb-b85f-0b2ade04550b, identifier: 117474004
2025-12-02 19:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC23JXL/2025-11-19/image/fdeeb9aa-ee66-4eae-b1e8-bec9c44b0f39_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117353225?view=catalogue)
2025-12-02 19:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC23JXL/2025-11-19/image/73b8ddb2-c1e3-42aa-8445-1ad59c5106b6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117353225?view=catalogue)
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F880056de-5220-47aa-b309-5925b828182d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/880056de-5220-47aa-b309-5925b828182d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252F64e01ad7-7363-4297-a1cd-5a4f911cb64e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/64e01ad7-7363-4297-a1cd-5a4f911cb64e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7ccb990d-8de2-53d1-bd35-49aec4b4ef84 with identifier: 117662441
2025-12-02 19:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7ccb990d-8de2-53d1-bd35-49aec4b4ef84 with identifier: 117662441
2025-12-02 19:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'renault zoe hatchback 100kw i gt line r135 50kwh rapid charge 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'zoe hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 19312, 'odometer_reading_unit': 'mi', 'registration_date': '2020-12-17', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662441', 'expiration_date': None, 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw i gt line r135 50kwh rapid charge 5dr auto', 'license_plate': 'hk70xwv', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '7ccb990d-8de2-53d1-bd35-49aec4b4ef84', 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'renault zoe hatchback', 'sanitized_make': 'renault', 'odometer_in_km': 31079} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 59,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': '7ccb990d-8de2-53d1-bd35-49aec4b4ef84',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'hk70xwv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662441',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'renault',
     'make_model': 'renault zoe hatchback',
     'model': 'zoe hatchback',
     'odometer': 19312,
     'odometer_in_km': 31079,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-17',
     'sanitized_make': 'renault',
     'seller_name': None,
     'title': 'renault zoe hatchback 100kw i gt line r135 50kwh rapid '
              'charge 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw i gt line r135 50kwh rapid charge 5dr auto',
     'vin': None,
     'year': 2020}
2025-12-02 19:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 7ccb990d-8de2-53d1-bd35-49aec4b4ef84 spider: astonbarclay.gb
2025-12-02 19:07:16 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7ccb990d-8de2-53d1-bd35-49aec4b4ef84 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'renault zoe hatchback 100kw i gt line r135 50kwh rapid charge 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'zoe hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 19312, 'odometer_reading_unit': 'mi', 'registration_date': '2020-12-17', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662441', 'expiration_date': None, 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw i gt line r135 50kwh rapid charge 5dr auto', 'license_plate': 'hk70xwv', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '7ccb990d-8de2-53d1-bd35-49aec4b4ef84', 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'renault zoe hatchback', 'sanitized_make': 'renault', 'odometer_in_km': 31079} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 59,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': '7ccb990d-8de2-53d1-bd35-49aec4b4ef84',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'hk70xwv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662441',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'renault',
     'make_model': 'renault zoe hatchback',
     'model': 'zoe hatchback',
     'odometer': 19312,
     'odometer_in_km': 31079,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-17',
     'sanitized_make': 'renault',
     'seller_name': None,
     'title': 'renault zoe hatchback 100kw i gt line r135 50kwh rapid '
              'charge 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw i gt line r135 50kwh rapid charge 5dr auto',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': None,
 'fuel_type': 'Electric',
 'id': '7ccb990d-8de2-53d1-bd35-49aec4b4ef84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HK70XWV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662441',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'RENAULT',
 'model': 'ZOE HATCHBACK',
 'odometer': 19312,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seller_name': None,
 'title': 'RENAULT ZOE HATCHBACK 100kW i GT Line R135 50kWh Rapid Charge 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '100kW i GT Line R135 50kWh Rapid Charge 5dr Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662441%27 HTTP/1.1" 200 None
2025-12-02 19:07:16 [astonbarclay.gb] INFO: Saving data for 117662441: {'created_time': 1764702436.472337, 'last_price_update_time': 1764702436.472347}
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662441') HTTP/1.1" 204 0
2025-12-02 19:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2590e077-8052-5865-849e-f7cff4709701 with identifier: 117690352
2025-12-02 19:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2590e077-8052-5865-849e-f7cff4709701 with identifier: 117690352
2025-12-02 19:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2590e077-8052-5865-849e-f7cff4709701 with identifier: 117690352 to the API
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272590e077-8052-5865-849e-f7cff4709701%27 HTTP/1.1" 200 None
2025-12-02 19:07:16 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2590e077-8052-5865-849e-f7cff4709701: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:16 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117690352?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '2590e077-8052-5865-849e-f7cff4709701',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YB71JYK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117690352',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 57365,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-31',
 'seller_name': None,
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 N-Connecta 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 N-Connecta 5dr Xtronic',
 'vin': None,
 'year': 2021}
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117690352%27 HTTP/1.1" 200 None
2025-12-02 19:07:16 [astonbarclay.gb] INFO: Saving data for 117690352: {'created_time': 1764702436.782335, 'last_price_update_time': 1764702436.782346}
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117690352') HTTP/1.1" 204 0
2025-12-02 19:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with identifier: 117492820
2025-12-02 19:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with identifier: 117492820
2025-12-02 19:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with identifier: 117492820 to the API
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f2b4c2d7-187b-5876-a316-a5afbbcf6cdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LN73OFU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117492820',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 20465,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-14',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH Acenta Premium 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492820%27 HTTP/1.1" 200 None
2025-12-02 19:07:17 [astonbarclay.gb] INFO: Saving data for 117492820: {'auction_closing_time': 1765792800.0, 'created_time': 1764615818.399328, 'last_price_update_time': 1764702437.051301}
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117492820') HTTP/1.1" 204 0
2025-12-02 19:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 60f8064a-b9bd-574a-91bf-ae0fa21ad783 with identifier: 117399593
2025-12-02 19:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 60f8064a-b9bd-574a-91bf-ae0fa21ad783 with identifier: 117399593
2025-12-02 19:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 60f8064a-b9bd-574a-91bf-ae0fa21ad783 with identifier: 117399593 to the API
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117399593?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '60f8064a-b9bd-574a-91bf-ae0fa21ad783',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'ML73UCA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117399593',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 3886,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-15',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech 130 GT 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.2 PureTech 130 GT 5dr EAT8',
 'vin': None,
 'year': 2023}
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399593%27 HTTP/1.1" 200 None
2025-12-02 19:07:17 [astonbarclay.gb] INFO: Saving data for 117399593: {'auction_closing_time': 1764756000.0, 'created_time': 1764356612.72635, 'last_price_update_time': 1764702437.343532}
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117399593') HTTP/1.1" 204 0
2025-12-02 19:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f48277f6-61e8-5dfb-b85f-0b2ade04550b with identifier: 117474004
2025-12-02 19:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f48277f6-61e8-5dfb-b85f-0b2ade04550b with identifier: 117474004
2025-12-02 19:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'stellantis financial services uk', 'price_includes_vat': False, 'title': 'citroen e-c4 x electric saloon 100kw e-series 50kwh 4dr auto', 'price': 0, 'currency': 'gbp', 'make': 'citroen', 'model': 'e-c4 x electric saloon', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 13698, 'odometer_reading_unit': 'mi', 'registration_date': '2024-04-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117474004', 'expiration_date': None, 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '100kw e-series 50kwh 4dr auto', 'license_plate': 'du24mbv', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 4, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f48277f6-61e8-5dfb-b85f-0b2ade04550b', 'current_year_diff': 1, 'age_in_months': 19, 'make_model': 'citroen e-c4 x electric saloon', 'sanitized_make': 'citroen', 'odometer_in_km': 22044} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 19,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': 'f48277f6-61e8-5dfb-b85f-0b2ade04550b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'du24mbv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117474004',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'citroen',
     'make_model': 'citroen e-c4 x electric saloon',
     'model': 'e-c4 x electric saloon',
     'odometer': 13698,
     'odometer_in_km': 22044,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-04-30',
     'sanitized_make': 'citroen',
     'seller_name': 'stellantis financial services uk',
     'title': 'citroen e-c4 x electric saloon 100kw e-series 50kwh 4dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw e-series 50kwh 4dr auto',
     'vin': None,
     'year': 2024}
2025-12-02 19:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: f48277f6-61e8-5dfb-b85f-0b2ade04550b spider: astonbarclay.gb
2025-12-02 19:07:17 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f48277f6-61e8-5dfb-b85f-0b2ade04550b due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'stellantis financial services uk', 'price_includes_vat': False, 'title': 'citroen e-c4 x electric saloon 100kw e-series 50kwh 4dr auto', 'price': 0, 'currency': 'gbp', 'make': 'citroen', 'model': 'e-c4 x electric saloon', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 13698, 'odometer_reading_unit': 'mi', 'registration_date': '2024-04-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117474004', 'expiration_date': None, 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '100kw e-series 50kwh 4dr auto', 'license_plate': 'du24mbv', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 4, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f48277f6-61e8-5dfb-b85f-0b2ade04550b', 'current_year_diff': 1, 'age_in_months': 19, 'make_model': 'citroen e-c4 x electric saloon', 'sanitized_make': 'citroen', 'odometer_in_km': 22044} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 19,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': 'f48277f6-61e8-5dfb-b85f-0b2ade04550b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'du24mbv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117474004',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'citroen',
     'make_model': 'citroen e-c4 x electric saloon',
     'model': 'e-c4 x electric saloon',
     'odometer': 13698,
     'odometer_in_km': 22044,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-04-30',
     'sanitized_make': 'citroen',
     'seller_name': 'stellantis financial services uk',
     'title': 'citroen e-c4 x electric saloon 100kw e-series 50kwh 4dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw e-series 50kwh 4dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': None,
 'fuel_type': 'Electric',
 'id': 'f48277f6-61e8-5dfb-b85f-0b2ade04550b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DU24MBV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117474004',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'CITROEN',
 'model': 'E-C4 X ELECTRIC SALOON',
 'odometer': 13698,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-30',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'CITROEN E-C4 X ELECTRIC SALOON 100kW E-Series 50kWh 4dr Auto',
 'transmission': 'automatic',
 'trim': '100kW E-Series 50kWh 4dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117474004%27 HTTP/1.1" 200 None
2025-12-02 19:07:17 [astonbarclay.gb] INFO: Saving data for 117474004: {'auction_closing_time': 1764756000.0, 'created_time': 1764356616.664011, 'last_price_update_time': 1764702437.554443}
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117474004') HTTP/1.1" 204 0
2025-12-02 19:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ead2a8f3-31bf-4390-b343-733525cb4f03_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411447?view=catalogue)
2025-12-02 19:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72EBD/2025-11-21/image/74a86661-99c2-4297-968b-35685fd1cd59_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399373?view=catalogue)
2025-12-02 19:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72EBD/2025-11-21/image/a82e789a-6329-4bc9-b8b4-9f9d677c0037_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399373?view=catalogue)
2025-12-02 19:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72FRF/2025-11-17/image/a42776ef-40bb-4ee9-8095-f6f0241c84c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117269658?view=catalogue)
2025-12-02 19:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72FRF/2025-11-17/image/0d3b5bf5-80f3-430b-917f-968c7a79b84b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117269658?view=catalogue)
2025-12-02 19:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/0485b9e6-087d-4065-b0d3-993fb98a9848_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399206?view=catalogue)
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F76de69b3-76ff-46c2-b2ec-3d4333a177f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/76de69b3-76ff-46c2-b2ec-3d4333a177f4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252F412521d2-d6bc-43cd-8c33-293c1b879c02_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/412521d2-d6bc-43cd-8c33-293c1b879c02_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf202ac90>
2025-12-02 19:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252Fed61486d-93b9-4a71-9d0b-a7bfebaf19f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/ed61486d-93b9-4a71-9d0b-a7bfebaf19f2_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9fe447e-d546-55e9-b9e6-e29c50579f5b
2025-12-02 19:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03f6190>
2025-12-02 19:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F6da92dc0-bc69-40b6-a629-f01c196dca2d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/6da92dc0-bc69-40b6-a629-f01c196dca2d_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e184f423-723a-544a-aee9-25b0e9972bbb
2025-12-02 19:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72HVL/2025-11-14/image/5cb56246-25be-4ad8-bbf0-a067d32e0ed2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117219838?view=catalogue)
2025-12-02 19:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/45b2b48e-d577-4e1e-bd3e-354fd23137f8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399206?view=catalogue)
2025-12-02 19:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72HVL/2025-11-14/image/6b5187d2-220d-4de6-97dc-f21cf8bf3d21_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117219838?view=catalogue)
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F4e71865c-6d62-4cd0-9489-64120bb7b316_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/4e71865c-6d62-4cd0-9489-64120bb7b316_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252Fff471089-550e-4bff-9319-a9511211a554_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ff471089-550e-4bff-9319-a9511211a554_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08313d0>
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252Ffdeeb9aa-ee66-4eae-b1e8-bec9c44b0f39_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/fdeeb9aa-ee66-4eae-b1e8-bec9c44b0f39_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9fe447e-d546-55e9-b9e6-e29c50579f5b
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ed490>
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252F73b8ddb2-c1e3-42aa-8445-1ad59c5106b6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/73b8ddb2-c1e3-42aa-8445-1ad59c5106b6_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9fe447e-d546-55e9-b9e6-e29c50579f5b
2025-12-02 19:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC23JXL/2025-11-19/image/95142297-525b-493d-b651-34457721c118_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117353225?view=catalogue)
2025-12-02 19:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL72HVS/2025-11-24/image/a48e03f3-485c-4942-b31c-be4cb325d6fa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117444495?view=catalogue)
2025-12-02 19:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ae71e3a6-3041-418b-9761-c4f710a64c2b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411447?view=catalogue)
2025-12-02 19:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72FRF/2025-11-17/image/7b9d87b6-1f22-4a3e-922c-7b22c6c6d2b7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117269658?view=catalogue)
2025-12-02 19:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72EBD/2025-11-21/image/f398c86a-ab30-47c1-bb49-e16fcc122718_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399373?view=catalogue)
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F904a4557-b1ea-44fe-afd1-40b6d7d7abbe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/904a4557-b1ea-44fe-afd1-40b6d7d7abbe_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252F139ef87c-a9bf-4547-af22-c889987b7908_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/139ef87c-a9bf-4547-af22-c889987b7908_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0460210>
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fead2a8f3-31bf-4390-b343-733525cb4f03_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ead2a8f3-31bf-4390-b343-733525cb4f03_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 778ed0e5-6670-5732-a457-03c3b097cdae
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07c63d0>
2025-12-02 19:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F74a86661-99c2-4297-968b-35685fd1cd59_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/74a86661-99c2-4297-968b-35685fd1cd59_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e184f423-723a-544a-aee9-25b0e9972bbb
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09c1f50>
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252Fa82e789a-6329-4bc9-b8b4-9f9d677c0037_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/a82e789a-6329-4bc9-b8b4-9f9d677c0037_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e184f423-723a-544a-aee9-25b0e9972bbb
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0643150>
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252Fa42776ef-40bb-4ee9-8095-f6f0241c84c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/a42776ef-40bb-4ee9-8095-f6f0241c84c3_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0462550>
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252F0d3b5bf5-80f3-430b-917f-968c7a79b84b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/0d3b5bf5-80f3-430b-917f-968c7a79b84b_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03e2f90>
2025-12-02 19:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252F0485b9e6-087d-4065-b0d3-993fb98a9848_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/0485b9e6-087d-4065-b0d3-993fb98a9848_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0606f10>
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F5cb56246-25be-4ad8-bbf0-a067d32e0ed2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/5cb56246-25be-4ad8-bbf0-a067d32e0ed2_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07009895-e542-5e3b-a5f2-179c007b5a49
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07a5e10>
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252F45b2b48e-d577-4e1e-bd3e-354fd23137f8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/45b2b48e-d577-4e1e-bd3e-354fd23137f8_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf079ac90>
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F6b5187d2-220d-4de6-97dc-f21cf8bf3d21_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/6b5187d2-220d-4de6-97dc-f21cf8bf3d21_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07009895-e542-5e3b-a5f2-179c007b5a49
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F9696f272-4fe2-41e8-8554-618c99227cf5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/9696f272-4fe2-41e8-8554-618c99227cf5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252Fb9d30f7d-5df2-4f8b-92e9-514a85d72be4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/b9d30f7d-5df2-4f8b-92e9-514a85d72be4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/412521d2-d6bc-43cd-8c33-293c1b879c02_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399206?view=catalogue)
2025-12-02 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/64e01ad7-7363-4297-a1cd-5a4f911cb64e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399206?view=catalogue)
2025-12-02 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72HVL/2025-11-14/image/76de69b3-76ff-46c2-b2ec-3d4333a177f4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117219838?view=catalogue)
2025-12-02 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117660676?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F606a1920-2a5d-4c14-8346-0a1835793aeb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/606a1920-2a5d-4c14-8346-0a1835793aeb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252Fac622126-56ef-4180-8b25-bdc9a17170a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ac622126-56ef-4180-8b25-bdc9a17170a9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117633313?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117666471?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117660374?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117659595?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c7010>
2025-12-02 19:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC23JXL%252F2025-11-19%252Fimage%252F95142297-525b-493d-b651-34457721c118_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC23JXL/2025-11-19/image/95142297-525b-493d-b651-34457721c118_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9fe447e-d546-55e9-b9e6-e29c50579f5b
2025-12-02 19:07:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9fe447e-d546-55e9-b9e6-e29c50579f5b, skipping ID generation
2025-12-02 19:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9fe447e-d546-55e9-b9e6-e29c50579f5b with scrape type 1
2025-12-02 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c9fe447e-d546-55e9-b9e6-e29c50579f5b from tracking dictionaries
2025-12-02 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9fe447e-d546-55e9-b9e6-e29c50579f5b sending to next pipeline
2025-12-02 19:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c9fe447e-d546-55e9-b9e6-e29c50579f5b, identifier: 117353225
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf121f590>
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252Fa48e03f3-485c-4942-b31c-be4cb325d6fa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/a48e03f3-485c-4942-b31c-be4cb325d6fa_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22b2a6a6-02f1-5b26-a53e-170405e15852
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0923dd0>
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fae71e3a6-3041-418b-9761-c4f710a64c2b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ae71e3a6-3041-418b-9761-c4f710a64c2b_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 778ed0e5-6670-5732-a457-03c3b097cdae
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf099b4d0>
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252F7b9d87b6-1f22-4a3e-922c-7b22c6c6d2b7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/7b9d87b6-1f22-4a3e-922c-7b22c6c6d2b7_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0666190>
2025-12-02 19:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252Ff398c86a-ab30-47c1-bb49-e16fcc122718_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/f398c86a-ab30-47c1-bb49-e16fcc122718_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e184f423-723a-544a-aee9-25b0e9972bbb
2025-12-02 19:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c9fe447e-d546-55e9-b9e6-e29c50579f5b with identifier: 117353225
2025-12-02 19:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c9fe447e-d546-55e9-b9e6-e29c50579f5b with identifier: 117353225
2025-12-02 19:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c9fe447e-d546-55e9-b9e6-e29c50579f5b with identifier: 117353225 to the API
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YC23JXL/2025-11-19/image/95142297-525b-493d-b651-34457721c118_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'c9fe447e-d546-55e9-b9e6-e29c50579f5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YC23JXL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117353225',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'DACIA',
 'model': 'DUSTER DIESEL ESTATE',
 'odometer': 21356,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20762,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/e4a064ad-837f-4533-aded-a796934a93af_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 19746,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/a16512e2-94f4-4130-8ae7-cc7d7d1ea837_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20797,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/b2edee8e-5c5a-44f4-b1ed-25830ea02a73_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20267,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/649f1ba4-d691-4a8d-b3d1-425e1f7a91cd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34712,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/2ac3f7eb-7d60-4f67-9db3-f3d820cc56c8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42296,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/ed61486d-93b9-4a71-9d0b-a7bfebaf19f2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33006,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/fdeeb9aa-ee66-4eae-b1e8-bec9c44b0f39_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34754,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/73b8ddb2-c1e3-42aa-8445-1ad59c5106b6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fe447e-d546-55e9-b9e6-e29c50579f5b/c9fe447e-d546-55e9-b9e6-e29c50579f5b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40443,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YC23JXL/2025-11-19/image/95142297-525b-493d-b651-34457721c118_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-11',
 'seller_name': 'Kinto',
 'title': 'DACIA DUSTER DIESEL ESTATE 1.5 Blue dCi Expression 5dr 4X4',
 'transmission': 'manual',
 'trim': '1.5 Blue dCi Expression 5dr 4X4',
 'vin': None,
 'year': 2023}
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117353225%27 HTTP/1.1" 200 None
2025-12-02 19:07:22 [astonbarclay.gb] INFO: Saving data for 117353225: {'created_time': 1764702442.522639, 'last_price_update_time': 1764702442.522648, 'auction_closing_time': 1765532700.0}
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117353225') HTTP/1.1" 204 0
2025-12-02 19:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ff471089-550e-4bff-9319-a9511211a554_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399206?view=catalogue)
2025-12-02 19:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72HVL/2025-11-14/image/880056de-5220-47aa-b309-5925b828182d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117219838?view=catalogue)
2025-12-02 19:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/2002f4b1-4db4-41d7-966a-f036248b3964_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411447?view=catalogue)
2025-12-02 19:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72HVL/2025-11-14/image/4e71865c-6d62-4cd0-9489-64120bb7b316_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117219838?view=catalogue)
2025-12-02 19:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL72HVS/2025-11-24/image/69c8672c-3a2c-46d7-b798-cf471f04a014_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117444495?view=catalogue)
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F7f62dda6-bde8-4f7b-b2be-87dd0daae7b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/7f62dda6-bde8-4f7b-b2be-87dd0daae7b1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252Ff96afaff-0944-4cf4-8818-df81cc9841ac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/f96afaff-0944-4cf4-8818-df81cc9841ac_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0432590>
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252F412521d2-d6bc-43cd-8c33-293c1b879c02_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/412521d2-d6bc-43cd-8c33-293c1b879c02_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ca9850>
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252F64e01ad7-7363-4297-a1cd-5a4f911cb64e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/64e01ad7-7363-4297-a1cd-5a4f911cb64e_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df
2025-12-02 19:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1cab6d0>
2025-12-02 19:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F76de69b3-76ff-46c2-b2ec-3d4333a177f4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/76de69b3-76ff-46c2-b2ec-3d4333a177f4_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07009895-e542-5e3b-a5f2-179c007b5a49
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117660676, 'registration': 'SO18XEY', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL SALOON', 'derivative': 'C200d Sport 4dr Auto', 'mileage': 63056, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2018-03-22', 'fuel': 'Diesel', 'motExpiry': '2026-05-26', 'doors': 4, 'engineSize': 1598, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbd72070-2bc9-4233-a36c-e4cb626d292e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4c925ad4-e6bf-4c7b-a302-58d2c5228cd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/72f13b29-ab1b-4148-a0d1-128401175602_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4a30f7fd-9efa-401b-be72-781169d7788e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbacbd23-5799-4135-a7f8-bdda8fecedca_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/a0261872-431d-41ce-bf21-2683a6c82aa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/0a8b1e9d-50e9-424f-9af7-f0a5489cf2dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/1a712d19-23e9-4331-ad83-168d7766cfc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/8507d8a8-0e69-432e-aa14-137f9c12451b_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/22- 23K, 10/23- 35K, 10/24- 46K, 07/25- 56K', 'remarks': 'VOSA STATES 21K, 31K, 42K, 54K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/229795fc-880e-4bf0-8f40-28b66cae8cc2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117660676, 'registration': 'SO18XEY', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL SALOON', 'derivative': 'C200d Sport 4dr Auto', 'mileage': 63056, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2018-03-22', 'fuel': 'Diesel', 'motExpiry': '2026-05-26', 'doors': 4, 'engineSize': 1598, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbd72070-2bc9-4233-a36c-e4cb626d292e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4c925ad4-e6bf-4c7b-a302-58d2c5228cd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/72f13b29-ab1b-4148-a0d1-128401175602_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4a30f7fd-9efa-401b-be72-781169d7788e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbacbd23-5799-4135-a7f8-bdda8fecedca_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/a0261872-431d-41ce-bf21-2683a6c82aa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/0a8b1e9d-50e9-424f-9af7-f0a5489cf2dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/1a712d19-23e9-4331-ad83-168d7766cfc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/8507d8a8-0e69-432e-aa14-137f9c12451b_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/22- 23K, 10/23- 35K, 10/24- 46K, 07/25- 56K', 'remarks': 'VOSA STATES 21K, 31K, 42K, 54K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/229795fc-880e-4bf0-8f40-28b66cae8cc2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9268db81-8202-5fa9-889b-dd8553742c4e with identifier: 117660676
2025-12-02 19:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9268db81-8202-5fa9-889b-dd8553742c4e with scrape type 1
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 9268db81-8202-5fa9-889b-dd8553742c4e
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252Fdbd72070-2bc9-4233-a36c-e4cb626d292e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbd72070-2bc9-4233-a36c-e4cb626d292e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117633313, 'registration': 'AO72GYV', 'account': 'KIN032', 'make': 'TOYOTA', 'model': 'AYGO X HATCHBACK', 'derivative': '1.0 VVT-i Edge 5dr', 'mileage': 24000, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2022-11-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-27', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO72GYV/2025-12-02/image/232c93f7-2e4e-41ba-a13b-c0efb3833e80_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/59ea8539-5a09-4fcc-b11a-3b73c783402d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/f6b24645-c4d6-42bc-bf5c-f42c10aaae55_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/72dd6bc7-50d0-40d1-89a2-027a4935de7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/17a10cf5-8715-43c0-83d4-a4a61026dc0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/0b4548f2-dd8c-4b07-877a-e17fca25f14e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/bd6ec70b-bc55-4a0a-9a34-639ff92b2472_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/12754625-5307-4eec-bd30-970b80e9eba2_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/23-6K, 11/24-15K', 'remarks': 'SPARE KEY, VOSA STATE 23K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cdf0719c-f8bb-496c-8727-cc4fedc5cdf7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117633313, 'registration': 'AO72GYV', 'account': 'KIN032', 'make': 'TOYOTA', 'model': 'AYGO X HATCHBACK', 'derivative': '1.0 VVT-i Edge 5dr', 'mileage': 24000, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2022-11-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-27', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO72GYV/2025-12-02/image/232c93f7-2e4e-41ba-a13b-c0efb3833e80_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/59ea8539-5a09-4fcc-b11a-3b73c783402d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/f6b24645-c4d6-42bc-bf5c-f42c10aaae55_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/72dd6bc7-50d0-40d1-89a2-027a4935de7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/17a10cf5-8715-43c0-83d4-a4a61026dc0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/0b4548f2-dd8c-4b07-877a-e17fca25f14e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/bd6ec70b-bc55-4a0a-9a34-639ff92b2472_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO72GYV/2025-12-02/image/12754625-5307-4eec-bd30-970b80e9eba2_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/23-6K, 11/24-15K', 'remarks': 'SPARE KEY, VOSA STATE 23K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cdf0719c-f8bb-496c-8727-cc4fedc5cdf7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78013d61-594c-5897-bef1-2438f77cbd0c with identifier: 117633313
2025-12-02 19:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78013d61-594c-5897-bef1-2438f77cbd0c with scrape type 2
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78013d61-594c-5897-bef1-2438f77cbd0c with scrape type 2
2025-12-02 19:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 78013d61-594c-5897-bef1-2438f77cbd0c, identifier: 117633313
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117679098, 'registration': 'MV19AYA', 'account': 'WBA001', 'make': 'BMW', 'model': '2 SERIES GRAN TOURER', 'derivative': '218i Luxury 5dr', 'mileage': 21286, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-03-08', 'fuel': 'Petrol', 'motExpiry': '2026-05-19', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9e6697fe-8300-4791-9a1a-d6635377c851_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/e0bccf79-6cdc-40d0-ae43-d1ee045040b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/0cdf4f79-bf66-4d24-ad2a-42f5eac99a28_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/6fcb8213-7ed5-4d81-b0be-5b1c57ff4e0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/de0909d3-f589-4707-8d20-40c7246f0e01_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/7975edc1-dc36-4154-aff6-40daa31fdfe9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/a97ea3e7-0cf2-46af-a8ea-39cbfbbdf06a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/963eb79f-aff4-4a66-b78b-dfa8e3728ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/128f429e-7201-4525-9656-7a60256b21d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/847259ef-e3ea-4f82-823a-c064a935ebde_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9a6546d9-fb8c-4cc8-a899-fbe621dc43f5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 11K, 15K, 17K, 20K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/48bb3ac6-63e8-4d5c-8efd-a77b373c5a46.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117679098, 'registration': 'MV19AYA', 'account': 'WBA001', 'make': 'BMW', 'model': '2 SERIES GRAN TOURER', 'derivative': '218i Luxury 5dr', 'mileage': 21286, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-03-08', 'fuel': 'Petrol', 'motExpiry': '2026-05-19', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9e6697fe-8300-4791-9a1a-d6635377c851_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/e0bccf79-6cdc-40d0-ae43-d1ee045040b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/0cdf4f79-bf66-4d24-ad2a-42f5eac99a28_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/6fcb8213-7ed5-4d81-b0be-5b1c57ff4e0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/de0909d3-f589-4707-8d20-40c7246f0e01_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/7975edc1-dc36-4154-aff6-40daa31fdfe9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/a97ea3e7-0cf2-46af-a8ea-39cbfbbdf06a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/963eb79f-aff4-4a66-b78b-dfa8e3728ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/128f429e-7201-4525-9656-7a60256b21d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/847259ef-e3ea-4f82-823a-c064a935ebde_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9a6546d9-fb8c-4cc8-a899-fbe621dc43f5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 11K, 15K, 17K, 20K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/48bb3ac6-63e8-4d5c-8efd-a77b373c5a46.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 888b8009-a330-59ce-8808-778f9f11d5d9 with identifier: 117679098
2025-12-02 19:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 888b8009-a330-59ce-8808-778f9f11d5d9 with scrape type 1
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F9e6697fe-8300-4791-9a1a-d6635377c851_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9e6697fe-8300-4791-9a1a-d6635377c851_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117666471, 'registration': 'H5UNE', 'account': 'WBA001', 'make': 'JAGUAR', 'model': 'XF DIESEL SALOON', 'derivative': '2.0d Portfolio 4dr Auto', 'mileage': 97713, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-03-11', 'fuel': 'Diesel', 'motExpiry': '2026-08-24', 'doors': 4, 'engineSize': 1999, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/H5UNE/2025-12-02/image/ea9c576a-989c-4443-a01d-8b3b06e55f67_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/d4a410e4-c056-4757-b3da-38101b796aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/318075c5-a5b9-41c5-8d7c-cea4204ac601_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/1c4c309e-fe7a-43af-a405-be19bad553c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/295a362f-94a7-4c37-97ea-d7f9a85b75e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/b9e33229-edc7-4c34-a3e8-9d2d5e26c6ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/e4010b4f-3a2c-4e2c-9145-a2008e242a13_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/b2624cdc-2c47-4c06-9d23-5cec4f7eaebb_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/cc7be145-e7ba-4113-bbe4-bcf62a17c078_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/9c998c6a-3b08-4279-94e9-b6d144c4fe7f_removebg.jpg?w=600'], 'colour': 'BRONZE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 66K, 81K, 91K, 97K, SPARE KEY IN OFFICE, Ex-Private Hire', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cbe75e6a-69b4-4e72-affc-7b881bc8bb2f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117666471, 'registration': 'H5UNE', 'account': 'WBA001', 'make': 'JAGUAR', 'model': 'XF DIESEL SALOON', 'derivative': '2.0d Portfolio 4dr Auto', 'mileage': 97713, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-03-11', 'fuel': 'Diesel', 'motExpiry': '2026-08-24', 'doors': 4, 'engineSize': 1999, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/H5UNE/2025-12-02/image/ea9c576a-989c-4443-a01d-8b3b06e55f67_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/d4a410e4-c056-4757-b3da-38101b796aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/318075c5-a5b9-41c5-8d7c-cea4204ac601_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/1c4c309e-fe7a-43af-a405-be19bad553c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/295a362f-94a7-4c37-97ea-d7f9a85b75e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/b9e33229-edc7-4c34-a3e8-9d2d5e26c6ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/e4010b4f-3a2c-4e2c-9145-a2008e242a13_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/b2624cdc-2c47-4c06-9d23-5cec4f7eaebb_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/cc7be145-e7ba-4113-bbe4-bcf62a17c078_removebg.jpg?w=600', 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/9c998c6a-3b08-4279-94e9-b6d144c4fe7f_removebg.jpg?w=600'], 'colour': 'BRONZE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 66K, 81K, 91K, 97K, SPARE KEY IN OFFICE, Ex-Private Hire', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cbe75e6a-69b4-4e72-affc-7b881bc8bb2f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1777a46-13ac-5c66-8e33-2700e0f0340b with identifier: 117666471
2025-12-02 19:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1777a46-13ac-5c66-8e33-2700e0f0340b with scrape type 1
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1777a46-13ac-5c66-8e33-2700e0f0340b
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fea9c576a-989c-4443-a01d-8b3b06e55f67_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/ea9c576a-989c-4443-a01d-8b3b06e55f67_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117660374, 'registration': 'EA17XVN', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL ESTATE', 'derivative': 'E220d AMG Line Premium 5dr 9G-Tronic', 'mileage': 68903, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2017-04-28', 'fuel': 'Diesel', 'motExpiry': '2026-01-06', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA17XVN/2025-12-02/image/d6354368-a1c2-495c-97db-35958cff4877_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/0d79d5e1-d492-45ed-86e9-a2a8f158b93a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/ec58155b-dbbe-448f-9405-b29eb8e9f845_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/9c2951df-521b-4473-a68f-1288f4d05bb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/20fd5d9e-1547-46e1-b8cd-e5a297ea947b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/085d4c93-3b3a-4cd5-9d12-8520de5f7b5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/755d6620-a9f4-4cde-b828-4875f48c0fdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/8fdfb156-4b43-4285-bdcc-10bcd465902e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/46ed2001-22f2-464f-a9bb-c8f2361b5115_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/460b6929-12f0-4b29-a547-705b910a2340_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/86aa9b1f-de3f-4f19-b86c-88fde81bf7ba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117660374, 'registration': 'EA17XVN', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL ESTATE', 'derivative': 'E220d AMG Line Premium 5dr 9G-Tronic', 'mileage': 68903, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2017-04-28', 'fuel': 'Diesel', 'motExpiry': '2026-01-06', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA17XVN/2025-12-02/image/d6354368-a1c2-495c-97db-35958cff4877_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/0d79d5e1-d492-45ed-86e9-a2a8f158b93a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/ec58155b-dbbe-448f-9405-b29eb8e9f845_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/9c2951df-521b-4473-a68f-1288f4d05bb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/20fd5d9e-1547-46e1-b8cd-e5a297ea947b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/085d4c93-3b3a-4cd5-9d12-8520de5f7b5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/755d6620-a9f4-4cde-b828-4875f48c0fdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/8fdfb156-4b43-4285-bdcc-10bcd465902e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/46ed2001-22f2-464f-a9bb-c8f2361b5115_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/460b6929-12f0-4b29-a547-705b910a2340_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/86aa9b1f-de3f-4f19-b86c-88fde81bf7ba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf47b3a-1f85-591b-9075-e3d02db82618 with identifier: 117660374
2025-12-02 19:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf47b3a-1f85-591b-9075-e3d02db82618 with scrape type 1
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbf47b3a-1f85-591b-9075-e3d02db82618
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252Fd6354368-a1c2-495c-97db-35958cff4877_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/d6354368-a1c2-495c-97db-35958cff4877_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117659595, 'registration': 'BG68WDC', 'account': 'WBA001', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 75 SE 5dr', 'mileage': 56452, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-10-09', 'fuel': 'Petrol', 'motExpiry': '2026-07-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BG68WDC/2025-12-02/image/b10646e7-e124-4184-967c-442783299b01_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/88dfaf58-e5c7-42dc-8f6c-5f22434b26b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/f9faad2b-960b-4568-a93c-42080f47d5c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/efbe504e-6b01-4343-8155-ff1cb8227f0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/9aaba09f-ccc6-430c-aa3b-c6038b78e140_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/94b4ac1f-31c5-4593-bc93-820fa56140cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/34fc63fe-9baa-478a-85c0-ca0077690e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/78f3f6e4-1b38-483b-bc30-02dd3584c410_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/fff36b8c-2342-4f1e-afed-571b1cbcf6a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/2c260d76-f4f8-436e-9fcd-61710354f8bf_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY - VOSA STATES 53k 45k 33k 25k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8685819-fa86-46f0-9f04-b339abe7146a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117659595, 'registration': 'BG68WDC', 'account': 'WBA001', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 75 SE 5dr', 'mileage': 56452, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-10-09', 'fuel': 'Petrol', 'motExpiry': '2026-07-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BG68WDC/2025-12-02/image/b10646e7-e124-4184-967c-442783299b01_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/88dfaf58-e5c7-42dc-8f6c-5f22434b26b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/f9faad2b-960b-4568-a93c-42080f47d5c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/efbe504e-6b01-4343-8155-ff1cb8227f0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/9aaba09f-ccc6-430c-aa3b-c6038b78e140_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/94b4ac1f-31c5-4593-bc93-820fa56140cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/34fc63fe-9baa-478a-85c0-ca0077690e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/78f3f6e4-1b38-483b-bc30-02dd3584c410_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/fff36b8c-2342-4f1e-afed-571b1cbcf6a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/2c260d76-f4f8-436e-9fcd-61710354f8bf_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY - VOSA STATES 53k 45k 33k 25k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8685819-fa86-46f0-9f04-b339abe7146a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccdb7727-701c-5599-b62d-b4ba533095d5 with identifier: 117659595
2025-12-02 19:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccdb7727-701c-5599-b62d-b4ba533095d5 with scrape type 1
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ccdb7727-701c-5599-b62d-b4ba533095d5
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252Fb10646e7-e124-4184-967c-442783299b01_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/b10646e7-e124-4184-967c-442783299b01_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117680503, 'registration': 'GK16AKF', 'account': 'WBA001', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '120i Sport 5dr Step Auto', 'mileage': 112546, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-03-07', 'fuel': 'Petrol', 'motExpiry': '2025-12-20', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4c7d186a-8eb9-4311-b387-1fd55b0ea4be_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e2d7bb50-cd72-4833-97ee-f1206ddad4ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/9e445304-4c3b-41c2-9fb7-ff8cb573444c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e12a7d0d-ac3f-4a93-9b26-0ff3218e7c71_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1e9f78e8-0ecb-4cd0-ae0d-ff8963e06aa3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/ad071757-074c-4e07-925b-e2c7afafe6f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/97be3d6c-2f56-4989-9b23-307962624785_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/188047e8-0243-448e-81f6-f3a589675cfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/5b4d01fa-41b6-4286-9709-4f3e62dd6558_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/8b49e478-cc73-44a9-98a4-a82505b46c36_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1b0b7edb-f99f-4883-afd0-d071bd343317_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4a6a86f1-5338-4f4b-82d3-facb20c8c064_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/a5183e77-ef50-46d7-a418-d1124dc5a751_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'VOSA STATES 47K, 89K, 90K, 102K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8e67e2d-9ec1-440f-88cf-01cf8092ff15.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117680503, 'registration': 'GK16AKF', 'account': 'WBA001', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '120i Sport 5dr Step Auto', 'mileage': 112546, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-03-07', 'fuel': 'Petrol', 'motExpiry': '2025-12-20', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4c7d186a-8eb9-4311-b387-1fd55b0ea4be_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e2d7bb50-cd72-4833-97ee-f1206ddad4ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/9e445304-4c3b-41c2-9fb7-ff8cb573444c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e12a7d0d-ac3f-4a93-9b26-0ff3218e7c71_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1e9f78e8-0ecb-4cd0-ae0d-ff8963e06aa3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/ad071757-074c-4e07-925b-e2c7afafe6f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/97be3d6c-2f56-4989-9b23-307962624785_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/188047e8-0243-448e-81f6-f3a589675cfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/5b4d01fa-41b6-4286-9709-4f3e62dd6558_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/8b49e478-cc73-44a9-98a4-a82505b46c36_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1b0b7edb-f99f-4883-afd0-d071bd343317_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4a6a86f1-5338-4f4b-82d3-facb20c8c064_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/a5183e77-ef50-46d7-a418-d1124dc5a751_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'VOSA STATES 47K, 89K, 90K, 102K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8e67e2d-9ec1-440f-88cf-01cf8092ff15.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e00f3f41-1eba-576e-ba7d-c7713c9bfb86 with identifier: 117680503
2025-12-02 19:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86 with scrape type 1
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F4c7d186a-8eb9-4311-b387-1fd55b0ea4be_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4c7d186a-8eb9-4311-b387-1fd55b0ea4be_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/139ef87c-a9bf-4547-af22-c889987b7908_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399206?view=catalogue)
2025-12-02 19:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 78013d61-594c-5897-bef1-2438f77cbd0c with identifier: 117633313
2025-12-02 19:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 78013d61-594c-5897-bef1-2438f77cbd0c with identifier: 117633313
2025-12-02 19:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 78013d61-594c-5897-bef1-2438f77cbd0c with identifier: 117633313 to the API
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2778013d61-594c-5897-bef1-2438f77cbd0c%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 78013d61-594c-5897-bef1-2438f77cbd0c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117633313?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'GREEN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '78013d61-594c-5897-bef1-2438f77cbd0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AO72GYV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117633313',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'TOYOTA',
 'model': 'AYGO X HATCHBACK',
 'odometer': 24000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seller_name': 'Kinto',
 'title': 'TOYOTA AYGO X HATCHBACK 1.0 VVT-i Edge 5dr',
 'transmission': 'manual',
 'trim': '1.0 VVT-i Edge 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633313%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [astonbarclay.gb] INFO: Saving data for 117633313: {'created_time': 1764615743.553093, 'last_price_update_time': 1764702443.775464}
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117633313') HTTP/1.1" 204 0
2025-12-02 19:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/b9d30f7d-5df2-4f8b-92e9-514a85d72be4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399206?view=catalogue)
2025-12-02 19:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72HVL/2025-11-14/image/9696f272-4fe2-41e8-8554-618c99227cf5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117219838?view=catalogue)
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F4c925ad4-e6bf-4c7b-a302-58d2c5228cd7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4c925ad4-e6bf-4c7b-a302-58d2c5228cd7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252Fe0bccf79-6cdc-40d0-ae43-d1ee045040b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/e0bccf79-6cdc-40d0-ae43-d1ee045040b9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fd4a410e4-c056-4757-b3da-38101b796aa2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/d4a410e4-c056-4757-b3da-38101b796aa2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F0d79d5e1-d492-45ed-86e9-a2a8f158b93a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/0d79d5e1-d492-45ed-86e9-a2a8f158b93a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F88dfaf58-e5c7-42dc-8f6c-5f22434b26b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/88dfaf58-e5c7-42dc-8f6c-5f22434b26b1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252Fe2d7bb50-cd72-4833-97ee-f1206ddad4ea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e2d7bb50-cd72-4833-97ee-f1206ddad4ea_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72FRF/2025-11-17/image/08a8bec3-62d4-4870-8572-e5f0c8c52677_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117269658?view=catalogue)
2025-12-02 19:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL72HVS/2025-11-24/image/fc86b1c7-cfa1-4848-b758-e11e70b1947b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117444495?view=catalogue)
2025-12-02 19:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72HVL/2025-11-14/image/904a4557-b1ea-44fe-afd1-40b6d7d7abbe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117219838?view=catalogue)
2025-12-02 19:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72FRF/2025-11-17/image/9efff528-a4c0-4ec7-84db-76531497d6b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117269658?view=catalogue)
2025-12-02 19:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117667252?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf044a810>
2025-12-02 19:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252Fff471089-550e-4bff-9319-a9511211a554_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ff471089-550e-4bff-9319-a9511211a554_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf051a6d0>
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F880056de-5220-47aa-b309-5925b828182d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/880056de-5220-47aa-b309-5925b828182d_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07009895-e542-5e3b-a5f2-179c007b5a49
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf072ca50>
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252F2002f4b1-4db4-41d7-966a-f036248b3964_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/2002f4b1-4db4-41d7-966a-f036248b3964_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 778ed0e5-6670-5732-a457-03c3b097cdae
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0589250>
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F4e71865c-6d62-4cd0-9489-64120bb7b316_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/4e71865c-6d62-4cd0-9489-64120bb7b316_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07009895-e542-5e3b-a5f2-179c007b5a49
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c7ed0>
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252F69c8672c-3a2c-46d7-b798-cf471f04a014_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/69c8672c-3a2c-46d7-b798-cf471f04a014_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22b2a6a6-02f1-5b26-a53e-170405e15852
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F72f13b29-ab1b-4148-a0d1-128401175602_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/72f13b29-ab1b-4148-a0d1-128401175602_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F0cdf4f79-bf66-4d24-ad2a-42f5eac99a28_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/0cdf4f79-bf66-4d24-ad2a-42f5eac99a28_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252F318075c5-a5b9-41c5-8d7c-cea4204ac601_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/318075c5-a5b9-41c5-8d7c-cea4204ac601_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252Fec58155b-dbbe-448f-9405-b29eb8e9f845_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/ec58155b-dbbe-448f-9405-b29eb8e9f845_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252Ff9faad2b-960b-4568-a93c-42080f47d5c9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/f9faad2b-960b-4568-a93c-42080f47d5c9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F9e445304-4c3b-41c2-9fb7-ff8cb573444c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/9e445304-4c3b-41c2-9fb7-ff8cb573444c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf072ec10>
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252F139ef87c-a9bf-4547-af22-c889987b7908_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/139ef87c-a9bf-4547-af22-c889987b7908_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df
2025-12-02 19:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ac622126-56ef-4180-8b25-bdc9a17170a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399206?view=catalogue)
2025-12-02 19:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72EBD/2025-11-21/image/c31ede82-299e-400d-9fdd-8a80603eceda_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399373?view=catalogue)
2025-12-02 19:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/3f2f2fb1-b658-44ae-9b03-4275cc3c3cd5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411447?view=catalogue)
2025-12-02 19:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72HVL/2025-11-14/image/606a1920-2a5d-4c14-8346-0a1835793aeb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117219838?view=catalogue)
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0865750>
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252Fb9d30f7d-5df2-4f8b-92e9-514a85d72be4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/b9d30f7d-5df2-4f8b-92e9-514a85d72be4_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df
2025-12-02 19:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4c7d186a-8eb9-4311-b387-1fd55b0ea4be_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/f96afaff-0944-4cf4-8818-df81cc9841ac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399206?view=catalogue)
2025-12-02 19:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72FRF/2025-11-17/image/ec45f676-783b-4be5-9adb-2a7c5f2e9bb7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117269658?view=catalogue)
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F4a30f7fd-9efa-401b-be72-781169d7788e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4a30f7fd-9efa-401b-be72-781169d7788e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F6fcb8213-7ed5-4d81-b0be-5b1c57ff4e0b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/6fcb8213-7ed5-4d81-b0be-5b1c57ff4e0b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252F1c4c309e-fe7a-43af-a405-be19bad553c9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/1c4c309e-fe7a-43af-a405-be19bad553c9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F9c2951df-521b-4473-a68f-1288f4d05bb9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/9c2951df-521b-4473-a68f-1288f4d05bb9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252Fefbe504e-6b01-4343-8155-ff1cb8227f0c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/efbe504e-6b01-4343-8155-ff1cb8227f0c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252Fe12a7d0d-ac3f-4a93-9b26-0ff3218e7c71_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e12a7d0d-ac3f-4a93-9b26-0ff3218e7c71_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0427190>
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F9696f272-4fe2-41e8-8554-618c99227cf5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/9696f272-4fe2-41e8-8554-618c99227cf5_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07009895-e542-5e3b-a5f2-179c007b5a49
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0998a10>
2025-12-02 19:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252F08a8bec3-62d4-4870-8572-e5f0c8c52677_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/08a8bec3-62d4-4870-8572-e5f0c8c52677_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0427e90>
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL72HVS%252F2025-11-24%252Fimage%252Ffc86b1c7-cfa1-4848-b758-e11e70b1947b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL72HVS/2025-11-24/image/fc86b1c7-cfa1-4848-b758-e11e70b1947b_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22b2a6a6-02f1-5b26-a53e-170405e15852
2025-12-02 19:07:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22b2a6a6-02f1-5b26-a53e-170405e15852, skipping ID generation
2025-12-02 19:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b2a6a6-02f1-5b26-a53e-170405e15852 with scrape type 1
2025-12-02 19:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 22b2a6a6-02f1-5b26-a53e-170405e15852 from tracking dictionaries
2025-12-02 19:07:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22b2a6a6-02f1-5b26-a53e-170405e15852 sending to next pipeline
2025-12-02 19:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 22b2a6a6-02f1-5b26-a53e-170405e15852, identifier: 117444495
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aa9fd0>
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F904a4557-b1ea-44fe-afd1-40b6d7d7abbe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/904a4557-b1ea-44fe-afd1-40b6d7d7abbe_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07009895-e542-5e3b-a5f2-179c007b5a49
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0830b10>
2025-12-02 19:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252F9efff528-a4c0-4ec7-84db-76531497d6b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/9efff528-a4c0-4ec7-84db-76531497d6b0_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8
2025-12-02 19:07:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117667252, 'registration': 'GU20POF', 'account': 'WBA001', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i Sport 5dr Step Auto', 'mileage': 46440, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-05-12', 'fuel': 'Petrol', 'motExpiry': '2025-12-21', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GU20POF/2025-12-02/image/b50397ff-de0b-43ec-90ce-dca739c37faf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/76ea7c7e-c7ed-4bbb-ab83-be0b445a46bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/f530f084-5412-4647-820e-3e4dcdcf61bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/49a57a59-11d3-4c5e-8a89-97f2ae8ca281_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/2f3e54c5-53c2-408e-817c-c325bd6a88ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/35d248a0-3de4-4aa8-8556-d1f2c48dc4d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/a945038c-5f2f-403f-ab99-084854cdb5c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/f00f13cd-2b81-4b97-bd03-baaeb4fad92a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/f4657a6e-db3e-4ae2-96ed-978d6af40c9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/491378d4-eece-4190-9e2f-da8857cdff16_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital iDRIVE @ 05/21-17k,  11/21-27k,  12/21-28k,', 'remarks': 'SPARE KEY - VOSA STATES 45k 45k 45k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7ca5a3c3-6633-4dd3-97a7-110589630854.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117667252, 'registration': 'GU20POF', 'account': 'WBA001', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i Sport 5dr Step Auto', 'mileage': 46440, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-05-12', 'fuel': 'Petrol', 'motExpiry': '2025-12-21', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GU20POF/2025-12-02/image/b50397ff-de0b-43ec-90ce-dca739c37faf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/76ea7c7e-c7ed-4bbb-ab83-be0b445a46bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/f530f084-5412-4647-820e-3e4dcdcf61bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/49a57a59-11d3-4c5e-8a89-97f2ae8ca281_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/2f3e54c5-53c2-408e-817c-c325bd6a88ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/35d248a0-3de4-4aa8-8556-d1f2c48dc4d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/a945038c-5f2f-403f-ab99-084854cdb5c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/f00f13cd-2b81-4b97-bd03-baaeb4fad92a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/f4657a6e-db3e-4ae2-96ed-978d6af40c9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/491378d4-eece-4190-9e2f-da8857cdff16_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital iDRIVE @ 05/21-17k,  11/21-27k,  12/21-28k,', 'remarks': 'SPARE KEY - VOSA STATES 45k 45k 45k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7ca5a3c3-6633-4dd3-97a7-110589630854.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617 with identifier: 117667252
2025-12-02 19:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617 with scrape type 1
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252Fb50397ff-de0b-43ec-90ce-dca739c37faf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/b50397ff-de0b-43ec-90ce-dca739c37faf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72EBD/2025-11-21/image/14515f80-1e86-40c8-aa3f-a148c0b61deb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399373?view=catalogue)
2025-12-02 19:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 22b2a6a6-02f1-5b26-a53e-170405e15852 with identifier: 117444495
2025-12-02 19:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 22b2a6a6-02f1-5b26-a53e-170405e15852 with identifier: 117444495
2025-12-02 19:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 22b2a6a6-02f1-5b26-a53e-170405e15852 with identifier: 117444495 to the API
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NL72HVS/2025-11-24/image/fc86b1c7-cfa1-4848-b758-e11e70b1947b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '22b2a6a6-02f1-5b26-a53e-170405e15852',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NL72HVS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117444495',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 25922,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31572,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/9a78293d-2e45-4485-bee2-718e0e94f4d7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31619,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/fc86b1c7-cfa1-4848-b758-e11e70b1947b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35035,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/5844fe8c-6076-4d11-ad2b-8d355b08345d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34172,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/69c8672c-3a2c-46d7-b798-cf471f04a014_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45311,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/a48e03f3-485c-4942-b31c-be4cb325d6fa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61851,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/7c227297-c070-4aba-a884-5f65074913e4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46370,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/52d151d2-daae-43a6-8ca8-e088dcdf8928_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44960,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/3fbbd393-873c-4aaf-8bd9-157dd75ab32f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b2a6a6-02f1-5b26-a53e-170405e15852/22b2a6a6-02f1-5b26-a53e-170405e15852_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51775,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL72HVS/2025-11-24/image/50ed4f4f-14ee-4a8e-afd9-61a589c7775f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-08',
 'seller_name': 'Kinto',
 'title': 'NISSAN JUKE HATCHBACK 1.0 DiG-T 114 Tekna+ 5dr',
 'transmission': 'manual',
 'trim': '1.0 DiG-T 114 Tekna+ 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444495%27 HTTP/1.1" 200 None
2025-12-02 19:07:27 [astonbarclay.gb] INFO: Saving data for 117444495: {'created_time': 1764702447.497239, 'last_price_update_time': 1764702447.497249, 'auction_closing_time': 1765532700.0}
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117444495') HTTP/1.1" 204 0
2025-12-02 19:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA17XVN/2025-12-02/image/d6354368-a1c2-495c-97db-35958cff4877_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660374?view=catalogue)
2025-12-02 19:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/H5UNE/2025-12-02/image/ea9c576a-989c-4443-a01d-8b3b06e55f67_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117666471?view=catalogue)
2025-12-02 19:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG68WDC/2025-12-02/image/b10646e7-e124-4184-967c-442783299b01_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117659595?view=catalogue)
2025-12-02 19:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9e6697fe-8300-4791-9a1a-d6635377c851_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue)
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252Fdbacbd23-5799-4135-a7f8-bdda8fecedca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbacbd23-5799-4135-a7f8-bdda8fecedca_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252Fde0909d3-f589-4707-8d20-40c7246f0e01_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/de0909d3-f589-4707-8d20-40c7246f0e01_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252F295a362f-94a7-4c37-97ea-d7f9a85b75e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/295a362f-94a7-4c37-97ea-d7f9a85b75e7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F20fd5d9e-1547-46e1-b8cd-e5a297ea947b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/20fd5d9e-1547-46e1-b8cd-e5a297ea947b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F9aaba09f-ccc6-430c-aa3b-c6038b78e140_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/9aaba09f-ccc6-430c-aa3b-c6038b78e140_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F1e9f78e8-0ecb-4cd0-ae0d-ff8963e06aa3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1e9f78e8-0ecb-4cd0-ae0d-ff8963e06aa3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252F76ea7c7e-c7ed-4bbb-ab83-be0b445a46bb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/76ea7c7e-c7ed-4bbb-ab83-be0b445a46bb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117045093?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117605946?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07fd5d0>
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252Fac622126-56ef-4180-8b25-bdc9a17170a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ac622126-56ef-4180-8b25-bdc9a17170a9_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0557c90>
2025-12-02 19:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252Fc31ede82-299e-400d-9fdd-8a80603eceda_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/c31ede82-299e-400d-9fdd-8a80603eceda_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e184f423-723a-544a-aee9-25b0e9972bbb
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098b790>
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252F3f2f2fb1-b658-44ae-9b03-4275cc3c3cd5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/3f2f2fb1-b658-44ae-9b03-4275cc3c3cd5_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 778ed0e5-6670-5732-a457-03c3b097cdae
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf069fd10>
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F606a1920-2a5d-4c14-8346-0a1835793aeb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/606a1920-2a5d-4c14-8346-0a1835793aeb_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07009895-e542-5e3b-a5f2-179c007b5a49
2025-12-02 19:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG68WDC/2025-12-02/image/88dfaf58-e5c7-42dc-8f6c-5f22434b26b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117659595?view=catalogue)
2025-12-02 19:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbd72070-2bc9-4233-a36c-e4cb626d292e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660676?view=catalogue)
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e2250>
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F4c7d186a-8eb9-4311-b387-1fd55b0ea4be_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4c7d186a-8eb9-4311-b387-1fd55b0ea4be_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c8950>
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ71XRK%252F2025-11-21%252Fimage%252Ff96afaff-0944-4cf4-8818-df81cc9841ac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/f96afaff-0944-4cf4-8818-df81cc9841ac_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df
2025-12-02 19:07:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f1374dc-a8ec-5154-9f62-7fffea2ed3df, skipping ID generation
2025-12-02 19:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df with scrape type 1
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df from tracking dictionaries
2025-12-02 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f1374dc-a8ec-5154-9f62-7fffea2ed3df sending to next pipeline
2025-12-02 19:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8f1374dc-a8ec-5154-9f62-7fffea2ed3df, identifier: 117399206
2025-12-02 19:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07f2750>
2025-12-02 19:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252Fec45f676-783b-4be5-9adb-2a7c5f2e9bb7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/ec45f676-783b-4be5-9adb-2a7c5f2e9bb7_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8
2025-12-02 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e2d7bb50-cd72-4833-97ee-f1206ddad4ea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA17XVN/2025-12-02/image/0d79d5e1-d492-45ed-86e9-a2a8f158b93a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660374?view=catalogue)
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252Fa0261872-431d-41ce-bf21-2683a6c82aa8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/a0261872-431d-41ce-bf21-2683a6c82aa8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F7975edc1-dc36-4154-aff6-40daa31fdfe9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/7975edc1-dc36-4154-aff6-40daa31fdfe9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fb9e33229-edc7-4c34-a3e8-9d2d5e26c6ff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/b9e33229-edc7-4c34-a3e8-9d2d5e26c6ff_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F085d4c93-3b3a-4cd5-9d12-8520de5f7b5c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/085d4c93-3b3a-4cd5-9d12-8520de5f7b5c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F94b4ac1f-31c5-4593-bc93-820fa56140cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/94b4ac1f-31c5-4593-bc93-820fa56140cc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252Fad071757-074c-4e07-925b-e2c7afafe6f0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/ad071757-074c-4e07-925b-e2c7afafe6f0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252Ff530f084-5412-4647-820e-3e4dcdcf61bc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/f530f084-5412-4647-820e-3e4dcdcf61bc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8f1374dc-a8ec-5154-9f62-7fffea2ed3df with identifier: 117399206
2025-12-02 19:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8f1374dc-a8ec-5154-9f62-7fffea2ed3df with identifier: 117399206
2025-12-02 19:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8f1374dc-a8ec-5154-9f62-7fffea2ed3df with identifier: 117399206 to the API
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/f96afaff-0944-4cf4-8818-df81cc9841ac_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '8f1374dc-a8ec-5154-9f62-7fffea2ed3df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'EJ71XRK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117399206',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK SPECIAL EDITIONS',
 'odometer': 59863,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27132,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/0485b9e6-087d-4065-b0d3-993fb98a9848_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27109,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/45b2b48e-d577-4e1e-bd3e-354fd23137f8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28314,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/64e01ad7-7363-4297-a1cd-5a4f911cb64e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30951,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/412521d2-d6bc-43cd-8c33-293c1b879c02_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40322,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ff471089-550e-4bff-9319-a9511211a554_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63969,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/139ef87c-a9bf-4547-af22-c889987b7908_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53368,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/b9d30f7d-5df2-4f8b-92e9-514a85d72be4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42688,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/ac622126-56ef-4180-8b25-bdc9a17170a9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1374dc-a8ec-5154-9f62-7fffea2ed3df/8f1374dc-a8ec-5154-9f62-7fffea2ed3df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52554,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ71XRK/2025-11-21/image/f96afaff-0944-4cf4-8818-df81cc9841ac_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK SPECIAL EDITIONS A180 Sport '
          'Executive Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A180 Sport Executive Edition 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399206%27 HTTP/1.1" 200 None
2025-12-02 19:07:29 [astonbarclay.gb] INFO: Saving data for 117399206: {'created_time': 1764702449.801455, 'last_price_update_time': 1764702449.801466, 'auction_closing_time': 1765532700.0}
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117399206') HTTP/1.1" 204 0
2025-12-02 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG68WDC/2025-12-02/image/f9faad2b-960b-4568-a93c-42080f47d5c9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117659595?view=catalogue)
2025-12-02 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV19AYA/2025-12-02/image/e0bccf79-6cdc-40d0-ae43-d1ee045040b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue)
2025-12-02 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/H5UNE/2025-12-02/image/d4a410e4-c056-4757-b3da-38101b796aa2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117666471?view=catalogue)
2025-12-02 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/9e445304-4c3b-41c2-9fb7-ff8cb573444c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04c1750>
2025-12-02 19:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F14515f80-1e86-40c8-aa3f-a148c0b61deb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/14515f80-1e86-40c8-aa3f-a148c0b61deb_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e184f423-723a-544a-aee9-25b0e9972bbb
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09039d0>
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252Fd6354368-a1c2-495c-97db-35958cff4877_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/d6354368-a1c2-495c-97db-35958cff4877_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbf47b3a-1f85-591b-9075-e3d02db82618
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a80190>
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fea9c576a-989c-4443-a01d-8b3b06e55f67_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/ea9c576a-989c-4443-a01d-8b3b06e55f67_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1777a46-13ac-5c66-8e33-2700e0f0340b
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09b8410>
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252Fb10646e7-e124-4184-967c-442783299b01_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/b10646e7-e124-4184-967c-442783299b01_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccdb7727-701c-5599-b62d-b4ba533095d5
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0817c50>
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F9e6697fe-8300-4791-9a1a-d6635377c851_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9e6697fe-8300-4791-9a1a-d6635377c851_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117045093, 'registration': 'FG72SWO', 'account': 'STE131', 'make': 'PEUGEOT', 'model': 'E-TRAVELLER ELECTRIC ESTATE', 'derivative': '100kW Allure Long [8 Seat] 50kWh 5dr Auto', 'mileage': 44106, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Electric', 'motExpiry': '2026-07-10', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FG72SWO/2025-11-11/image/dd349445-9cef-4816-acba-88aa4d63c171_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/62ef49a1-de5c-4a86-8dd8-5a61c31b1c48_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/746c4faa-30d3-479a-83e6-8e882e4ee466_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/b01b0c55-292b-4130-a74f-a742ab4623b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/3a970744-f326-4cf0-82d9-2547ce0b2788_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/f454a3ce-3059-4422-9a55-76137c922eb8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/fc69ea27-219b-41b1-8882-2397bb29a329_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/2d2e408a-b85f-4a1e-8eae-97800038a05b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/0fc82c16-98b1-4a94-8b7e-544077d66186_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/32e4a1b1-ff3b-4084-866c-86aeb60880a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/7ab96529-2ed4-4f53-b2aa-02829d36a4fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/bec21ac5-338c-4ba5-8642-7205718d00a7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'Ex-Private Hire', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7f117944-1df5-41c2-be0a-ce209f7d3cf5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117045093, 'registration': 'FG72SWO', 'account': 'STE131', 'make': 'PEUGEOT', 'model': 'E-TRAVELLER ELECTRIC ESTATE', 'derivative': '100kW Allure Long [8 Seat] 50kWh 5dr Auto', 'mileage': 44106, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Electric', 'motExpiry': '2026-07-10', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FG72SWO/2025-11-11/image/dd349445-9cef-4816-acba-88aa4d63c171_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/62ef49a1-de5c-4a86-8dd8-5a61c31b1c48_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/746c4faa-30d3-479a-83e6-8e882e4ee466_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/b01b0c55-292b-4130-a74f-a742ab4623b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/3a970744-f326-4cf0-82d9-2547ce0b2788_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/f454a3ce-3059-4422-9a55-76137c922eb8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/fc69ea27-219b-41b1-8882-2397bb29a329_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/2d2e408a-b85f-4a1e-8eae-97800038a05b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/0fc82c16-98b1-4a94-8b7e-544077d66186_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/32e4a1b1-ff3b-4084-866c-86aeb60880a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/7ab96529-2ed4-4f53-b2aa-02829d36a4fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/FG72SWO/2025-11-11/image/bec21ac5-338c-4ba5-8642-7205718d00a7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'Ex-Private Hire', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7f117944-1df5-41c2-be0a-ce209f7d3cf5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c07c73-4a67-5e76-aa42-caa293ef0963 with identifier: 117045093
2025-12-02 19:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c07c73-4a67-5e76-aa42-caa293ef0963 with scrape type 2
2025-12-02 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2c07c73-4a67-5e76-aa42-caa293ef0963 with scrape type 2
2025-12-02 19:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c2c07c73-4a67-5e76-aa42-caa293ef0963, identifier: 117045093
2025-12-02 19:07:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117605946, 'registration': 'DA23OMT', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 25526, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117605946, 'registration': 'DA23OMT', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 25526, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 433645bd-28b1-582b-bbe8-8655a2f00939 with identifier: 117605946
2025-12-02 19:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 433645bd-28b1-582b-bbe8-8655a2f00939 with scrape type 2
2025-12-02 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 433645bd-28b1-582b-bbe8-8655a2f00939 with scrape type 2
2025-12-02 19:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 433645bd-28b1-582b-bbe8-8655a2f00939, identifier: 117605946
2025-12-02 19:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA17XVN/2025-12-02/image/ec58155b-dbbe-448f-9405-b29eb8e9f845_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660374?view=catalogue)
2025-12-02 19:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/H5UNE/2025-12-02/image/318075c5-a5b9-41c5-8d7c-cea4204ac601_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117666471?view=catalogue)
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F0a8b1e9d-50e9-424f-9af7-f0a5489cf2dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/0a8b1e9d-50e9-424f-9af7-f0a5489cf2dd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252Fa97ea3e7-0cf2-46af-a8ea-39cbfbbdf06a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/a97ea3e7-0cf2-46af-a8ea-39cbfbbdf06a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fe4010b4f-3a2c-4e2c-9145-a2008e242a13_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/e4010b4f-3a2c-4e2c-9145-a2008e242a13_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F755d6620-a9f4-4cde-b828-4875f48c0fdd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/755d6620-a9f4-4cde-b828-4875f48c0fdd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F34fc63fe-9baa-478a-85c0-ca0077690e5e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/34fc63fe-9baa-478a-85c0-ca0077690e5e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F97be3d6c-2f56-4989-9b23-307962624785_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/97be3d6c-2f56-4989-9b23-307962624785_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252F49a57a59-11d3-4c5e-8a89-97f2ae8ca281_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/49a57a59-11d3-4c5e-8a89-97f2ae8ca281_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c2c07c73-4a67-5e76-aa42-caa293ef0963 with identifier: 117045093
2025-12-02 19:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c2c07c73-4a67-5e76-aa42-caa293ef0963 with identifier: 117045093
2025-12-02 19:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'e-traveller electric estate' containing 'traveller'
2025-12-02 19:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c2c07c73-4a67-5e76-aa42-caa293ef0963 spider: astonbarclay.gb
2025-12-02 19:07:31 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c2c07c73-4a67-5e76-aa42-caa293ef0963 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'e-traveller electric estate' containing 'traveller'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': None,
 'fuel_type': 'Electric',
 'id': 'c2c07c73-4a67-5e76-aa42-caa293ef0963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FG72SWO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117045093',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': 'E-TRAVELLER ELECTRIC ESTATE',
 'odometer': 44106,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'PEUGEOT E-TRAVELLER ELECTRIC ESTATE 100kW Allure Long [8 Seat] '
          '50kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Allure Long [8 Seat] 50kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117045093%27 HTTP/1.1" 200 None
2025-12-02 19:07:31 [astonbarclay.gb] INFO: Saving data for 117045093: {'auction_closing_time': 1764756000.0, 'created_time': 1764356613.527851, 'last_price_update_time': 1764702451.841382}
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117045093') HTTP/1.1" 204 0
2025-12-02 19:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 433645bd-28b1-582b-bbe8-8655a2f00939 with identifier: 117605946
2025-12-02 19:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 433645bd-28b1-582b-bbe8-8655a2f00939 with identifier: 117605946
2025-12-02 19:07:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 433645bd-28b1-582b-bbe8-8655a2f00939 with identifier: 117605946 to the API
2025-12-02 19:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27433645bd-28b1-582b-bbe8-8655a2f00939%27 HTTP/1.1" 200 None
2025-12-02 19:07:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 433645bd-28b1-582b-bbe8-8655a2f00939: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:31 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117605946?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '433645bd-28b1-582b-bbe8-8655a2f00939',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DA23OMT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117605946',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 25526,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-24',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605946%27 HTTP/1.1" 200 None
2025-12-02 19:07:32 [astonbarclay.gb] INFO: Saving data for 117605946: {'auction_closing_time': 1764670500.0, 'created_time': 1764356487.753763, 'last_price_update_time': 1764702452.135523}
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117605946') HTTP/1.1" 204 0
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07939d0>
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F88dfaf58-e5c7-42dc-8f6c-5f22434b26b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/88dfaf58-e5c7-42dc-8f6c-5f22434b26b1_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ccdb7727-701c-5599-b62d-b4ba533095d5
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf079c5d0>
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252Fdbd72070-2bc9-4233-a36c-e4cb626d292e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbd72070-2bc9-4233-a36c-e4cb626d292e_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9268db81-8202-5fa9-889b-dd8553742c4e
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03fb290>
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252Fe2d7bb50-cd72-4833-97ee-f1206ddad4ea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e2d7bb50-cd72-4833-97ee-f1206ddad4ea_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06dff50>
2025-12-02 19:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F0d79d5e1-d492-45ed-86e9-a2a8f158b93a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/0d79d5e1-d492-45ed-86e9-a2a8f158b93a_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbf47b3a-1f85-591b-9075-e3d02db82618
2025-12-02 19:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA17XVN/2025-12-02/image/9c2951df-521b-4473-a68f-1288f4d05bb9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660374?view=catalogue)
2025-12-02 19:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG68WDC/2025-12-02/image/efbe504e-6b01-4343-8155-ff1cb8227f0c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117659595?view=catalogue)
2025-12-02 19:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV19AYA/2025-12-02/image/6fcb8213-7ed5-4d81-b0be-5b1c57ff4e0b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue)
2025-12-02 19:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU20POF/2025-12-02/image/b50397ff-de0b-43ec-90ce-dca739c37faf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117667252?view=catalogue)
2025-12-02 19:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/H5UNE/2025-12-02/image/1c4c309e-fe7a-43af-a405-be19bad553c9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117666471?view=catalogue)
2025-12-02 19:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e12a7d0d-ac3f-4a93-9b26-0ff3218e7c71_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F1a712d19-23e9-4331-ad83-168d7766cfc3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/1a712d19-23e9-4331-ad83-168d7766cfc3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F963eb79f-aff4-4a66-b78b-dfa8e3728ee5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/963eb79f-aff4-4a66-b78b-dfa8e3728ee5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fb2624cdc-2c47-4c06-9d23-5cec4f7eaebb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/b2624cdc-2c47-4c06-9d23-5cec4f7eaebb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F8fdfb156-4b43-4285-bdcc-10bcd465902e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/8fdfb156-4b43-4285-bdcc-10bcd465902e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F78f3f6e4-1b38-483b-bc30-02dd3584c410_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/78f3f6e4-1b38-483b-bc30-02dd3584c410_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F188047e8-0243-448e-81f6-f3a589675cfa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/188047e8-0243-448e-81f6-f3a589675cfa_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252F2f3e54c5-53c2-408e-817c-c325bd6a88ed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/2f3e54c5-53c2-408e-817c-c325bd6a88ed_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0350090>
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252Ff9faad2b-960b-4568-a93c-42080f47d5c9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/f9faad2b-960b-4568-a93c-42080f47d5c9_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ccdb7727-701c-5599-b62d-b4ba533095d5
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0557850>
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252Fe0bccf79-6cdc-40d0-ae43-d1ee045040b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/e0bccf79-6cdc-40d0-ae43-d1ee045040b9_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf059fc50>
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fd4a410e4-c056-4757-b3da-38101b796aa2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/d4a410e4-c056-4757-b3da-38101b796aa2_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1777a46-13ac-5c66-8e33-2700e0f0340b
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08fccd0>
2025-12-02 19:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F9e445304-4c3b-41c2-9fb7-ff8cb573444c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/9e445304-4c3b-41c2-9fb7-ff8cb573444c_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV19AYA/2025-12-02/image/0cdf4f79-bf66-4d24-ad2a-42f5eac99a28_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue)
2025-12-02 19:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4a30f7fd-9efa-401b-be72-781169d7788e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660676?view=catalogue)
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F8507d8a8-0e69-432e-aa14-137f9c12451b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/8507d8a8-0e69-432e-aa14-137f9c12451b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F128f429e-7201-4525-9656-7a60256b21d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/128f429e-7201-4525-9656-7a60256b21d8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fcc7be145-e7ba-4113-bbe4-bcf62a17c078_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/cc7be145-e7ba-4113-bbe4-bcf62a17c078_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F46ed2001-22f2-464f-a9bb-c8f2361b5115_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/46ed2001-22f2-464f-a9bb-c8f2361b5115_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252Ffff36b8c-2342-4f1e-afed-571b1cbcf6a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/fff36b8c-2342-4f1e-afed-571b1cbcf6a5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F5b4d01fa-41b6-4286-9709-4f3e62dd6558_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/5b4d01fa-41b6-4286-9709-4f3e62dd6558_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252F35d248a0-3de4-4aa8-8556-d1f2c48dc4d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/35d248a0-3de4-4aa8-8556-d1f2c48dc4d2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02fe310>
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252Fec58155b-dbbe-448f-9405-b29eb8e9f845_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/ec58155b-dbbe-448f-9405-b29eb8e9f845_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbf47b3a-1f85-591b-9075-e3d02db82618
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08080d0>
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252F318075c5-a5b9-41c5-8d7c-cea4204ac601_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/318075c5-a5b9-41c5-8d7c-cea4204ac601_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1777a46-13ac-5c66-8e33-2700e0f0340b
2025-12-02 19:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU20POF/2025-12-02/image/76ea7c7e-c7ed-4bbb-ab83-be0b445a46bb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117667252?view=catalogue)
2025-12-02 19:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV19AYA/2025-12-02/image/de0909d3-f589-4707-8d20-40c7246f0e01_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue)
2025-12-02 19:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA17XVN/2025-12-02/image/20fd5d9e-1547-46e1-b8cd-e5a297ea947b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660374?view=catalogue)
2025-12-02 19:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG68WDC/2025-12-02/image/9aaba09f-ccc6-430c-aa3b-c6038b78e140_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117659595?view=catalogue)
2025-12-02 19:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/H5UNE/2025-12-02/image/295a362f-94a7-4c37-97ea-d7f9a85b75e7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117666471?view=catalogue)
2025-12-02 19:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1e9f78e8-0ecb-4cd0-ae0d-ff8963e06aa3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F847259ef-e3ea-4f82-823a-c064a935ebde_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/847259ef-e3ea-4f82-823a-c064a935ebde_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252F9c998c6a-3b08-4279-94e9-b6d144c4fe7f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/9c998c6a-3b08-4279-94e9-b6d144c4fe7f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F460b6929-12f0-4b29-a547-705b910a2340_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/460b6929-12f0-4b29-a547-705b910a2340_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F2c260d76-f4f8-436e-9fcd-61710354f8bf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/2c260d76-f4f8-436e-9fcd-61710354f8bf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F8b49e478-cc73-44a9-98a4-a82505b46c36_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/8b49e478-cc73-44a9-98a4-a82505b46c36_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252Fa945038c-5f2f-403f-ab99-084854cdb5c6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/a945038c-5f2f-403f-ab99-084854cdb5c6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0949050>
2025-12-02 19:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F9c2951df-521b-4473-a68f-1288f4d05bb9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/9c2951df-521b-4473-a68f-1288f4d05bb9_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbf47b3a-1f85-591b-9075-e3d02db82618
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08a4690>
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252Fefbe504e-6b01-4343-8155-ff1cb8227f0c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/efbe504e-6b01-4343-8155-ff1cb8227f0c_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ccdb7727-701c-5599-b62d-b4ba533095d5
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04607d0>
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F6fcb8213-7ed5-4d81-b0be-5b1c57ff4e0b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/6fcb8213-7ed5-4d81-b0be-5b1c57ff4e0b_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e0d90>
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252Fb50397ff-de0b-43ec-90ce-dca739c37faf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/b50397ff-de0b-43ec-90ce-dca739c37faf_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf049d0d0>
2025-12-02 19:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252F1c4c309e-fe7a-43af-a405-be19bad553c9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/1c4c309e-fe7a-43af-a405-be19bad553c9_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1777a46-13ac-5c66-8e33-2700e0f0340b
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf082a0d0>
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252Fe12a7d0d-ac3f-4a93-9b26-0ff3218e7c71_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e12a7d0d-ac3f-4a93-9b26-0ff3218e7c71_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0634c10>
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F0cdf4f79-bf66-4d24-ad2a-42f5eac99a28_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/0cdf4f79-bf66-4d24-ad2a-42f5eac99a28_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf068b3d0>
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F4a30f7fd-9efa-401b-be72-781169d7788e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4a30f7fd-9efa-401b-be72-781169d7788e_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9268db81-8202-5fa9-889b-dd8553742c4e
2025-12-02 19:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU20POF/2025-12-02/image/f530f084-5412-4647-820e-3e4dcdcf61bc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117667252?view=catalogue)
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F9a6546d9-fb8c-4cc8-a899-fbe621dc43f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9a6546d9-fb8c-4cc8-a899-fbe621dc43f5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F1b0b7edb-f99f-4883-afd0-d071bd343317_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1b0b7edb-f99f-4883-afd0-d071bd343317_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252Ff00f13cd-2b81-4b97-bd03-baaeb4fad92a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/f00f13cd-2b81-4b97-bd03-baaeb4fad92a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/ad071757-074c-4e07-925b-e2c7afafe6f0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf037dc90>
2025-12-02 19:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252F76ea7c7e-c7ed-4bbb-ab83-be0b445a46bb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/76ea7c7e-c7ed-4bbb-ab83-be0b445a46bb_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c4390>
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252Fde0909d3-f589-4707-8d20-40c7246f0e01_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/de0909d3-f589-4707-8d20-40c7246f0e01_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA17XVN/2025-12-02/image/755d6620-a9f4-4cde-b828-4875f48c0fdd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660374?view=catalogue)
2025-12-02 19:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU20POF/2025-12-02/image/49a57a59-11d3-4c5e-8a89-97f2ae8ca281_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117667252?view=catalogue)
2025-12-02 19:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV19AYA/2025-12-02/image/a97ea3e7-0cf2-46af-a8ea-39cbfbbdf06a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue)
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F4a6a86f1-5338-4f4b-82d3-facb20c8c064_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4a6a86f1-5338-4f4b-82d3-facb20c8c064_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252Ff4657a6e-db3e-4ae2-96ed-978d6af40c9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/f4657a6e-db3e-4ae2-96ed-978d6af40c9e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf11e5f10>
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F20fd5d9e-1547-46e1-b8cd-e5a297ea947b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/20fd5d9e-1547-46e1-b8cd-e5a297ea947b_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbf47b3a-1f85-591b-9075-e3d02db82618
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090cd90>
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F9aaba09f-ccc6-430c-aa3b-c6038b78e140_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/9aaba09f-ccc6-430c-aa3b-c6038b78e140_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ccdb7727-701c-5599-b62d-b4ba533095d5
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ff8f10>
2025-12-02 19:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252F295a362f-94a7-4c37-97ea-d7f9a85b75e7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/295a362f-94a7-4c37-97ea-d7f9a85b75e7_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1777a46-13ac-5c66-8e33-2700e0f0340b
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0519950>
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F1e9f78e8-0ecb-4cd0-ae0d-ff8963e06aa3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1e9f78e8-0ecb-4cd0-ae0d-ff8963e06aa3_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU20POF/2025-12-02/image/2f3e54c5-53c2-408e-817c-c325bd6a88ed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117667252?view=catalogue)
2025-12-02 19:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/H5UNE/2025-12-02/image/e4010b4f-3a2c-4e2c-9145-a2008e242a13_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117666471?view=catalogue)
2025-12-02 19:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/97be3d6c-2f56-4989-9b23-307962624785_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG68WDC/2025-12-02/image/34fc63fe-9baa-478a-85c0-ca0077690e5e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117659595?view=catalogue)
2025-12-02 19:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/188047e8-0243-448e-81f6-f3a589675cfa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252Fa5183e77-ef50-46d7-a418-d1124dc5a751_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/a5183e77-ef50-46d7-a418-d1124dc5a751_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252F491378d4-eece-4190-9e2f-da8857cdff16_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/491378d4-eece-4190-9e2f-da8857cdff16_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1bcef50>
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252Ff530f084-5412-4647-820e-3e4dcdcf61bc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/f530f084-5412-4647-820e-3e4dcdcf61bc_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090bdd0>
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252Fad071757-074c-4e07-925b-e2c7afafe6f0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/ad071757-074c-4e07-925b-e2c7afafe6f0_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0637190>
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F755d6620-a9f4-4cde-b828-4875f48c0fdd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/755d6620-a9f4-4cde-b828-4875f48c0fdd_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbf47b3a-1f85-591b-9075-e3d02db82618
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0593850>
2025-12-02 19:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252F49a57a59-11d3-4c5e-8a89-97f2ae8ca281_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/49a57a59-11d3-4c5e-8a89-97f2ae8ca281_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf096b950>
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252Fa97ea3e7-0cf2-46af-a8ea-39cbfbbdf06a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/a97ea3e7-0cf2-46af-a8ea-39cbfbbdf06a_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA17XVN/2025-12-02/image/46ed2001-22f2-464f-a9bb-c8f2361b5115_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660374?view=catalogue)
2025-12-02 19:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV19AYA/2025-12-02/image/128f429e-7201-4525-9656-7a60256b21d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue)
2025-12-02 19:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU20POF/2025-12-02/image/35d248a0-3de4-4aa8-8556-d1f2c48dc4d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117667252?view=catalogue)
2025-12-02 19:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/H5UNE/2025-12-02/image/cc7be145-e7ba-4113-bbe4-bcf62a17c078_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117666471?view=catalogue)
2025-12-02 19:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG68WDC/2025-12-02/image/fff36b8c-2342-4f1e-afed-571b1cbcf6a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117659595?view=catalogue)
2025-12-02 19:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU20POF/2025-12-02/image/a945038c-5f2f-403f-ab99-084854cdb5c6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117667252?view=catalogue)
2025-12-02 19:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/5b4d01fa-41b6-4286-9709-4f3e62dd6558_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0689f90>
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252F2f3e54c5-53c2-408e-817c-c325bd6a88ed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/2f3e54c5-53c2-408e-817c-c325bd6a88ed_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf076b950>
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fe4010b4f-3a2c-4e2c-9145-a2008e242a13_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/e4010b4f-3a2c-4e2c-9145-a2008e242a13_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1777a46-13ac-5c66-8e33-2700e0f0340b
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08a5b50>
2025-12-02 19:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F97be3d6c-2f56-4989-9b23-307962624785_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/97be3d6c-2f56-4989-9b23-307962624785_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09b62d0>
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F34fc63fe-9baa-478a-85c0-ca0077690e5e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/34fc63fe-9baa-478a-85c0-ca0077690e5e_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ccdb7727-701c-5599-b62d-b4ba533095d5
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0789ed0>
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F188047e8-0243-448e-81f6-f3a589675cfa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/188047e8-0243-448e-81f6-f3a589675cfa_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/8b49e478-cc73-44a9-98a4-a82505b46c36_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ee7390>
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F46ed2001-22f2-464f-a9bb-c8f2361b5115_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/46ed2001-22f2-464f-a9bb-c8f2361b5115_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbf47b3a-1f85-591b-9075-e3d02db82618
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0590c90>
2025-12-02 19:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F128f429e-7201-4525-9656-7a60256b21d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/128f429e-7201-4525-9656-7a60256b21d8_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090d290>
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252F35d248a0-3de4-4aa8-8556-d1f2c48dc4d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/35d248a0-3de4-4aa8-8556-d1f2c48dc4d2_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07cc6d0>
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fcc7be145-e7ba-4113-bbe4-bcf62a17c078_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/cc7be145-e7ba-4113-bbe4-bcf62a17c078_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1777a46-13ac-5c66-8e33-2700e0f0340b
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c4610>
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252Ffff36b8c-2342-4f1e-afed-571b1cbcf6a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/fff36b8c-2342-4f1e-afed-571b1cbcf6a5_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ccdb7727-701c-5599-b62d-b4ba533095d5
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c7890>
2025-12-02 19:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252Fa945038c-5f2f-403f-ab99-084854cdb5c6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/a945038c-5f2f-403f-ab99-084854cdb5c6_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0679750>
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F5b4d01fa-41b6-4286-9709-4f3e62dd6558_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/5b4d01fa-41b6-4286-9709-4f3e62dd6558_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU20POF/2025-12-02/image/f4657a6e-db3e-4ae2-96ed-978d6af40c9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117667252?view=catalogue)
2025-12-02 19:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA17XVN/2025-12-02/image/460b6929-12f0-4b29-a547-705b910a2340_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660374?view=catalogue)
2025-12-02 19:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV19AYA/2025-12-02/image/847259ef-e3ea-4f82-823a-c064a935ebde_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue)
2025-12-02 19:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9a6546d9-fb8c-4cc8-a899-fbe621dc43f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue)
2025-12-02 19:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/H5UNE/2025-12-02/image/9c998c6a-3b08-4279-94e9-b6d144c4fe7f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117666471?view=catalogue)
2025-12-02 19:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1b0b7edb-f99f-4883-afd0-d071bd343317_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU20POF/2025-12-02/image/f00f13cd-2b81-4b97-bd03-baaeb4fad92a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117667252?view=catalogue)
2025-12-02 19:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG68WDC/2025-12-02/image/2c260d76-f4f8-436e-9fcd-61710354f8bf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117659595?view=catalogue)
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf37e3dd0>
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F8b49e478-cc73-44a9-98a4-a82505b46c36_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/8b49e478-cc73-44a9-98a4-a82505b46c36_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU20POF/2025-12-02/image/491378d4-eece-4190-9e2f-da8857cdff16_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117667252?view=catalogue)
2025-12-02 19:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA17XVN/2025-12-02/image/8fdfb156-4b43-4285-bdcc-10bcd465902e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660374?view=catalogue)
2025-12-02 19:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG68WDC/2025-12-02/image/78f3f6e4-1b38-483b-bc30-02dd3584c410_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117659595?view=catalogue)
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0890c10>
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252Ff4657a6e-db3e-4ae2-96ed-978d6af40c9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/f4657a6e-db3e-4ae2-96ed-978d6af40c9e_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04dea10>
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F460b6929-12f0-4b29-a547-705b910a2340_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/460b6929-12f0-4b29-a547-705b910a2340_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbf47b3a-1f85-591b-9075-e3d02db82618
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf067d950>
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F847259ef-e3ea-4f82-823a-c064a935ebde_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/847259ef-e3ea-4f82-823a-c064a935ebde_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf060a850>
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F9a6546d9-fb8c-4cc8-a899-fbe621dc43f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9a6546d9-fb8c-4cc8-a899-fbe621dc43f5_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0399550>
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252F9c998c6a-3b08-4279-94e9-b6d144c4fe7f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/9c998c6a-3b08-4279-94e9-b6d144c4fe7f_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1777a46-13ac-5c66-8e33-2700e0f0340b
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf050ec50>
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F1b0b7edb-f99f-4883-afd0-d071bd343317_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1b0b7edb-f99f-4883-afd0-d071bd343317_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1cc9ad0>
2025-12-02 19:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252Ff00f13cd-2b81-4b97-bd03-baaeb4fad92a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/f00f13cd-2b81-4b97-bd03-baaeb4fad92a_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0996610>
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F2c260d76-f4f8-436e-9fcd-61710354f8bf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/2c260d76-f4f8-436e-9fcd-61710354f8bf_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ccdb7727-701c-5599-b62d-b4ba533095d5
2025-12-02 19:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV19AYA/2025-12-02/image/963eb79f-aff4-4a66-b78b-dfa8e3728ee5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue)
2025-12-02 19:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SO18XEY/2025-12-02/image/8507d8a8-0e69-432e-aa14-137f9c12451b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660676?view=catalogue)
2025-12-02 19:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4a6a86f1-5338-4f4b-82d3-facb20c8c064_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/H5UNE/2025-12-02/image/b2624cdc-2c47-4c06-9d23-5cec4f7eaebb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117666471?view=catalogue)
2025-12-02 19:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SO18XEY/2025-12-02/image/0a8b1e9d-50e9-424f-9af7-f0a5489cf2dd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660676?view=catalogue)
2025-12-02 19:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SO18XEY/2025-12-02/image/1a712d19-23e9-4331-ad83-168d7766cfc3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660676?view=catalogue)
2025-12-02 19:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK16AKF/2025-12-02/image/a5183e77-ef50-46d7-a418-d1124dc5a751_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117680503?view=catalogue)
2025-12-02 19:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG68WDC/2025-12-02/image/94b4ac1f-31c5-4593-bc93-820fa56140cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117659595?view=catalogue)
2025-12-02 19:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0997b10>
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU20POF%252F2025-12-02%252Fimage%252F491378d4-eece-4190-9e2f-da8857cdff16_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU20POF/2025-12-02/image/491378d4-eece-4190-9e2f-da8857cdff16_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617
2025-12-02 19:07:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617, skipping ID generation
2025-12-02 19:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617 with scrape type 1
2025-12-02 19:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617 from tracking dictionaries
2025-12-02 19:07:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617 sending to next pipeline
2025-12-02 19:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617, identifier: 117667252
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c8ae90>
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F8fdfb156-4b43-4285-bdcc-10bcd465902e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/8fdfb156-4b43-4285-bdcc-10bcd465902e_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbf47b3a-1f85-591b-9075-e3d02db82618
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0398cd0>
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F78f3f6e4-1b38-483b-bc30-02dd3584c410_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/78f3f6e4-1b38-483b-bc30-02dd3584c410_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ccdb7727-701c-5599-b62d-b4ba533095d5
2025-12-02 19:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617 with identifier: 117667252
2025-12-02 19:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617 with identifier: 117667252
2025-12-02 19:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0d7e2cdd-1b34-5291-8a02-8e4cd39e4617 with identifier: 117667252 to the API
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/GU20POF/2025-12-02/image/491378d4-eece-4190-9e2f-da8857cdff16_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '0d7e2cdd-1b34-5291-8a02-8e4cd39e4617',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GU20POF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117667252',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 46440,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31375,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/b50397ff-de0b-43ec-90ce-dca739c37faf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34251,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/76ea7c7e-c7ed-4bbb-ab83-be0b445a46bb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31368,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/f530f084-5412-4647-820e-3e4dcdcf61bc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31767,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/49a57a59-11d3-4c5e-8a89-97f2ae8ca281_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38727,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/2f3e54c5-53c2-408e-817c-c325bd6a88ed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47970,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/35d248a0-3de4-4aa8-8556-d1f2c48dc4d2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83348,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/a945038c-5f2f-403f-ab99-084854cdb5c6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82212,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/f00f13cd-2b81-4b97-bd03-baaeb4fad92a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45435,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/f4657a6e-db3e-4ae2-96ed-978d6af40c9e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7e2cdd-1b34-5291-8a02-8e4cd39e4617/0d7e2cdd-1b34-5291-8a02-8e4cd39e4617_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38090,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GU20POF/2025-12-02/image/491378d4-eece-4190-9e2f-da8857cdff16_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-12',
 'seller_name': 'UKCGR',
 'title': 'BMW 1 SERIES HATCHBACK 118i Sport 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '118i Sport 5dr Step Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117667252%27 HTTP/1.1" 200 None
2025-12-02 19:07:46 [astonbarclay.gb] INFO: Saving data for 117667252: {'created_time': 1764702466.117716, 'last_price_update_time': 1764702466.117728}
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117667252') HTTP/1.1" 204 0
2025-12-02 19:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV19AYA/2025-12-02/image/7975edc1-dc36-4154-aff6-40daa31fdfe9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117679098?view=catalogue)
2025-12-02 19:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA17XVN/2025-12-02/image/085d4c93-3b3a-4cd5-9d12-8520de5f7b5c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660374?view=catalogue)
2025-12-02 19:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/H5UNE/2025-12-02/image/b9e33229-edc7-4c34-a3e8-9d2d5e26c6ff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117666471?view=catalogue)
2025-12-02 19:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SO18XEY/2025-12-02/image/72f13b29-ab1b-4148-a0d1-128401175602_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660676?view=catalogue)
2025-12-02 19:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SO18XEY/2025-12-02/image/a0261872-431d-41ce-bf21-2683a6c82aa8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660676?view=catalogue)
2025-12-02 19:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbacbd23-5799-4135-a7f8-bdda8fecedca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660676?view=catalogue)
2025-12-02 19:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4c925ad4-e6bf-4c7b-a302-58d2c5228cd7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660676?view=catalogue)
2025-12-02 19:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066b7d0>
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F963eb79f-aff4-4a66-b78b-dfa8e3728ee5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/963eb79f-aff4-4a66-b78b-dfa8e3728ee5_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08c5c50>
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F8507d8a8-0e69-432e-aa14-137f9c12451b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/8507d8a8-0e69-432e-aa14-137f9c12451b_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9268db81-8202-5fa9-889b-dd8553742c4e
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02dd550>
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_11.jpg HTTP/1.1" 201 0
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252F4a6a86f1-5338-4f4b-82d3-facb20c8c064_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4a6a86f1-5338-4f4b-82d3-facb20c8c064_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0636950>
2025-12-02 19:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fb2624cdc-2c47-4c06-9d23-5cec4f7eaebb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/b2624cdc-2c47-4c06-9d23-5cec4f7eaebb_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1777a46-13ac-5c66-8e33-2700e0f0340b
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02dced0>
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F0a8b1e9d-50e9-424f-9af7-f0a5489cf2dd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/0a8b1e9d-50e9-424f-9af7-f0a5489cf2dd_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9268db81-8202-5fa9-889b-dd8553742c4e
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf060f390>
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F1a712d19-23e9-4331-ad83-168d7766cfc3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/1a712d19-23e9-4331-ad83-168d7766cfc3_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9268db81-8202-5fa9-889b-dd8553742c4e
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf060cc50>
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_12.jpg HTTP/1.1" 201 0
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK16AKF%252F2025-12-02%252Fimage%252Fa5183e77-ef50-46d7-a418-d1124dc5a751_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK16AKF/2025-12-02/image/a5183e77-ef50-46d7-a418-d1124dc5a751_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86
2025-12-02 19:07:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e00f3f41-1eba-576e-ba7d-c7713c9bfb86, skipping ID generation
2025-12-02 19:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86 with scrape type 1
2025-12-02 19:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e00f3f41-1eba-576e-ba7d-c7713c9bfb86 from tracking dictionaries
2025-12-02 19:07:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e00f3f41-1eba-576e-ba7d-c7713c9bfb86 sending to next pipeline
2025-12-02 19:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e00f3f41-1eba-576e-ba7d-c7713c9bfb86, identifier: 117680503
2025-12-02 19:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02ddcd0>
2025-12-02 19:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG68WDC%252F2025-12-02%252Fimage%252F94b4ac1f-31c5-4593-bc93-820fa56140cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG68WDC/2025-12-02/image/94b4ac1f-31c5-4593-bc93-820fa56140cc_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ccdb7727-701c-5599-b62d-b4ba533095d5
2025-12-02 19:07:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccdb7727-701c-5599-b62d-b4ba533095d5, skipping ID generation
2025-12-02 19:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccdb7727-701c-5599-b62d-b4ba533095d5 with scrape type 1
2025-12-02 19:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ccdb7727-701c-5599-b62d-b4ba533095d5 from tracking dictionaries
2025-12-02 19:07:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccdb7727-701c-5599-b62d-b4ba533095d5 sending to next pipeline
2025-12-02 19:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ccdb7727-701c-5599-b62d-b4ba533095d5, identifier: 117659595
2025-12-02 19:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e00f3f41-1eba-576e-ba7d-c7713c9bfb86 with identifier: 117680503
2025-12-02 19:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e00f3f41-1eba-576e-ba7d-c7713c9bfb86 with identifier: 117680503
2025-12-02 19:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181124 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181124
2025-12-02 19:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e00f3f41-1eba-576e-ba7d-c7713c9bfb86 spider: astonbarclay.gb
2025-12-02 19:07:48 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e00f3f41-1eba-576e-ba7d-c7713c9bfb86 due to rule: high_mileage_for_country.json, error: 181124 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181124
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'e00f3f41-1eba-576e-ba7d-c7713c9bfb86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GK16AKF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117680503',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 112546,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29472,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4c7d186a-8eb9-4311-b387-1fd55b0ea4be_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31758,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e2d7bb50-cd72-4833-97ee-f1206ddad4ea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32759,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/9e445304-4c3b-41c2-9fb7-ff8cb573444c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27120,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/e12a7d0d-ac3f-4a93-9b26-0ff3218e7c71_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44586,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1e9f78e8-0ecb-4cd0-ae0d-ff8963e06aa3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42316,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/ad071757-074c-4e07-925b-e2c7afafe6f0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43649,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/97be3d6c-2f56-4989-9b23-307962624785_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49435,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/188047e8-0243-448e-81f6-f3a589675cfa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94485,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/5b4d01fa-41b6-4286-9709-4f3e62dd6558_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97197,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/8b49e478-cc73-44a9-98a4-a82505b46c36_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46805,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/1b0b7edb-f99f-4883-afd0-d071bd343317_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48058,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/4a6a86f1-5338-4f4b-82d3-facb20c8c064_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00f3f41-1eba-576e-ba7d-c7713c9bfb86/e00f3f41-1eba-576e-ba7d-c7713c9bfb86_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27020,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GK16AKF/2025-12-02/image/a5183e77-ef50-46d7-a418-d1124dc5a751_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-07',
 'seller_name': 'UKCGR',
 'title': 'BMW 1 SERIES HATCHBACK 120i Sport 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '120i Sport 5dr Step Auto',
 'vin': None,
 'year': 2016}
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117680503%27 HTTP/1.1" 200 None
2025-12-02 19:07:48 [astonbarclay.gb] INFO: Saving data for 117680503: {'created_time': 1764702468.575238, 'last_price_update_time': 1764702468.57525}
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117680503') HTTP/1.1" 204 0
2025-12-02 19:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ccdb7727-701c-5599-b62d-b4ba533095d5 with identifier: 117659595
2025-12-02 19:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ccdb7727-701c-5599-b62d-b4ba533095d5 with identifier: 117659595
2025-12-02 19:07:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ccdb7727-701c-5599-b62d-b4ba533095d5 with identifier: 117659595 to the API
2025-12-02 19:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BG68WDC/2025-12-02/image/94b4ac1f-31c5-4593-bc93-820fa56140cc_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'ccdb7727-701c-5599-b62d-b4ba533095d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BG68WDC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117659595',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'POLO HATCHBACK',
 'odometer': 56452,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39367,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/b10646e7-e124-4184-967c-442783299b01_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40234,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/88dfaf58-e5c7-42dc-8f6c-5f22434b26b1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40261,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/f9faad2b-960b-4568-a93c-42080f47d5c9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39756,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/efbe504e-6b01-4343-8155-ff1cb8227f0c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62513,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/9aaba09f-ccc6-430c-aa3b-c6038b78e140_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64854,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/94b4ac1f-31c5-4593-bc93-820fa56140cc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72889,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/34fc63fe-9baa-478a-85c0-ca0077690e5e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44100,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/78f3f6e4-1b38-483b-bc30-02dd3584c410_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68743,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/fff36b8c-2342-4f1e-afed-571b1cbcf6a5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccdb7727-701c-5599-b62d-b4ba533095d5/ccdb7727-701c-5599-b62d-b4ba533095d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74522,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG68WDC/2025-12-02/image/2c260d76-f4f8-436e-9fcd-61710354f8bf_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-09',
 'seller_name': 'UKCGR',
 'title': 'VOLKSWAGEN POLO HATCHBACK 1.0 75 SE 5dr',
 'transmission': 'manual',
 'trim': '1.0 75 SE 5dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117659595%27 HTTP/1.1" 200 None
2025-12-02 19:07:50 [astonbarclay.gb] INFO: Saving data for 117659595: {'created_time': 1764702470.023629, 'last_price_update_time': 1764702470.02364}
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117659595') HTTP/1.1" 204 0
2025-12-02 19:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72HVL/2025-11-14/image/7f62dda6-bde8-4f7b-b2be-87dd0daae7b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117219838?view=catalogue)
2025-12-02 19:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e35211e4-be2a-4e74-af6d-98ee75025880_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117269658?view=catalogue)
2025-12-02 19:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72EBD/2025-11-21/image/35d595a4-5675-4676-b10c-1c450d858a9b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117399373?view=catalogue)
2025-12-02 19:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/c1a8bf9b-8ee1-4a5a-b9fc-65b63fbf2e26_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411447?view=catalogue)
2025-12-02 19:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e5fefdae-8b84-465e-83ca-195217d36c66_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117269658?view=catalogue)
2025-12-02 19:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/a33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260567?view=catalogue)
2025-12-02 19:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72FRF/2025-11-17/image/907974b8-7b19-4e11-b46d-ae94021a5ef8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117269658?view=catalogue)
2025-12-02 19:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260567?view=catalogue)
2025-12-02 19:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07cc390>
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV19AYA%252F2025-12-02%252Fimage%252F7975edc1-dc36-4154-aff6-40daa31fdfe9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV19AYA/2025-12-02/image/7975edc1-dc36-4154-aff6-40daa31fdfe9_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 888b8009-a330-59ce-8808-778f9f11d5d9
2025-12-02 19:07:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 888b8009-a330-59ce-8808-778f9f11d5d9, skipping ID generation
2025-12-02 19:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 888b8009-a330-59ce-8808-778f9f11d5d9 with scrape type 1
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 888b8009-a330-59ce-8808-778f9f11d5d9 from tracking dictionaries
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 888b8009-a330-59ce-8808-778f9f11d5d9 sending to next pipeline
2025-12-02 19:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 888b8009-a330-59ce-8808-778f9f11d5d9, identifier: 117679098
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0692450>
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA17XVN%252F2025-12-02%252Fimage%252F085d4c93-3b3a-4cd5-9d12-8520de5f7b5c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA17XVN/2025-12-02/image/085d4c93-3b3a-4cd5-9d12-8520de5f7b5c_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbf47b3a-1f85-591b-9075-e3d02db82618
2025-12-02 19:07:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbf47b3a-1f85-591b-9075-e3d02db82618, skipping ID generation
2025-12-02 19:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf47b3a-1f85-591b-9075-e3d02db82618 with scrape type 1
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bbf47b3a-1f85-591b-9075-e3d02db82618 from tracking dictionaries
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbf47b3a-1f85-591b-9075-e3d02db82618 sending to next pipeline
2025-12-02 19:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bbf47b3a-1f85-591b-9075-e3d02db82618, identifier: 117660374
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac9d90>
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FH5UNE%252F2025-12-02%252Fimage%252Fb9e33229-edc7-4c34-a3e8-9d2d5e26c6ff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/H5UNE/2025-12-02/image/b9e33229-edc7-4c34-a3e8-9d2d5e26c6ff_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1777a46-13ac-5c66-8e33-2700e0f0340b
2025-12-02 19:07:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1777a46-13ac-5c66-8e33-2700e0f0340b, skipping ID generation
2025-12-02 19:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1777a46-13ac-5c66-8e33-2700e0f0340b with scrape type 1
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e1777a46-13ac-5c66-8e33-2700e0f0340b from tracking dictionaries
2025-12-02 19:07:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1777a46-13ac-5c66-8e33-2700e0f0340b sending to next pipeline
2025-12-02 19:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e1777a46-13ac-5c66-8e33-2700e0f0340b, identifier: 117666471
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07cd950>
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F72f13b29-ab1b-4148-a0d1-128401175602_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/72f13b29-ab1b-4148-a0d1-128401175602_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9268db81-8202-5fa9-889b-dd8553742c4e
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0722b90>
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252Fa0261872-431d-41ce-bf21-2683a6c82aa8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/a0261872-431d-41ce-bf21-2683a6c82aa8_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9268db81-8202-5fa9-889b-dd8553742c4e
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0932ed0>
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252Fdbacbd23-5799-4135-a7f8-bdda8fecedca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbacbd23-5799-4135-a7f8-bdda8fecedca_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9268db81-8202-5fa9-889b-dd8553742c4e
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0656150>
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSO18XEY%252F2025-12-02%252Fimage%252F4c925ad4-e6bf-4c7b-a302-58d2c5228cd7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4c925ad4-e6bf-4c7b-a302-58d2c5228cd7_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9268db81-8202-5fa9-889b-dd8553742c4e
2025-12-02 19:07:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9268db81-8202-5fa9-889b-dd8553742c4e, skipping ID generation
2025-12-02 19:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9268db81-8202-5fa9-889b-dd8553742c4e with scrape type 1
2025-12-02 19:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9268db81-8202-5fa9-889b-dd8553742c4e from tracking dictionaries
2025-12-02 19:07:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9268db81-8202-5fa9-889b-dd8553742c4e sending to next pipeline
2025-12-02 19:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9268db81-8202-5fa9-889b-dd8553742c4e, identifier: 117660676
2025-12-02 19:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 888b8009-a330-59ce-8808-778f9f11d5d9 with identifier: 117679098
2025-12-02 19:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 888b8009-a330-59ce-8808-778f9f11d5d9 with identifier: 117679098
2025-12-02 19:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 888b8009-a330-59ce-8808-778f9f11d5d9 with identifier: 117679098 to the API
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MV19AYA/2025-12-02/image/7975edc1-dc36-4154-aff6-40daa31fdfe9_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '888b8009-a330-59ce-8808-778f9f11d5d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MV19AYA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117679098',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '2 SERIES GRAN TOURER',
 'odometer': 21286,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40552,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9e6697fe-8300-4791-9a1a-d6635377c851_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43742,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/e0bccf79-6cdc-40d0-ae43-d1ee045040b9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36959,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/0cdf4f79-bf66-4d24-ad2a-42f5eac99a28_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40397,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/6fcb8213-7ed5-4d81-b0be-5b1c57ff4e0b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52736,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/de0909d3-f589-4707-8d20-40c7246f0e01_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45017,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/7975edc1-dc36-4154-aff6-40daa31fdfe9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45352,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/a97ea3e7-0cf2-46af-a8ea-39cbfbbdf06a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53757,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/963eb79f-aff4-4a66-b78b-dfa8e3728ee5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47857,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/128f429e-7201-4525-9656-7a60256b21d8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57348,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/847259ef-e3ea-4f82-823a-c064a935ebde_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888b8009-a330-59ce-8808-778f9f11d5d9/888b8009-a330-59ce-8808-778f9f11d5d9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62121,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV19AYA/2025-12-02/image/9a6546d9-fb8c-4cc8-a899-fbe621dc43f5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-08',
 'seller_name': 'UKCGR',
 'title': 'BMW 2 SERIES GRAN TOURER 218i Luxury 5dr',
 'transmission': 'manual',
 'trim': '218i Luxury 5dr',
 'vin': None,
 'year': 2019}
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117679098%27 HTTP/1.1" 200 None
2025-12-02 19:07:52 [astonbarclay.gb] INFO: Saving data for 117679098: {'created_time': 1764702472.480175, 'last_price_update_time': 1764702472.480188}
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117679098') HTTP/1.1" 204 0
2025-12-02 19:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bbf47b3a-1f85-591b-9075-e3d02db82618 with identifier: 117660374
2025-12-02 19:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bbf47b3a-1f85-591b-9075-e3d02db82618 with identifier: 117660374
2025-12-02 19:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bbf47b3a-1f85-591b-9075-e3d02db82618 with identifier: 117660374 to the API
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EA17XVN/2025-12-02/image/085d4c93-3b3a-4cd5-9d12-8520de5f7b5c_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'bbf47b3a-1f85-591b-9075-e3d02db82618',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA17XVN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117660374',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS DIESEL ESTATE',
 'odometer': 68903,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35351,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/d6354368-a1c2-495c-97db-35958cff4877_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34757,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/0d79d5e1-d492-45ed-86e9-a2a8f158b93a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35968,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/ec58155b-dbbe-448f-9405-b29eb8e9f845_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34034,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/9c2951df-521b-4473-a68f-1288f4d05bb9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49867,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/20fd5d9e-1547-46e1-b8cd-e5a297ea947b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52529,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/085d4c93-3b3a-4cd5-9d12-8520de5f7b5c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44622,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/755d6620-a9f4-4cde-b828-4875f48c0fdd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50447,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/8fdfb156-4b43-4285-bdcc-10bcd465902e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52398,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/46ed2001-22f2-464f-a9bb-c8f2361b5115_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf47b3a-1f85-591b-9075-e3d02db82618/bbf47b3a-1f85-591b-9075-e3d02db82618_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45514,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA17XVN/2025-12-02/image/460b6929-12f0-4b29-a547-705b910a2340_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-28',
 'seller_name': 'UKCGR',
 'title': 'MERCEDES-BENZ E CLASS DIESEL ESTATE E220d AMG Line Premium 5dr '
          '9G-Tronic',
 'transmission': 'automatic',
 'trim': 'E220d AMG Line Premium 5dr 9G-Tronic',
 'vin': None,
 'year': 2017}
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660374%27 HTTP/1.1" 200 None
2025-12-02 19:07:52 [astonbarclay.gb] INFO: Saving data for 117660374: {'created_time': 1764702472.836255, 'last_price_update_time': 1764702472.836265}
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117660374') HTTP/1.1" 204 0
2025-12-02 19:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e1777a46-13ac-5c66-8e33-2700e0f0340b with identifier: 117666471
2025-12-02 19:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e1777a46-13ac-5c66-8e33-2700e0f0340b with identifier: 117666471
2025-12-02 19:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157253 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157253
2025-12-02 19:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e1777a46-13ac-5c66-8e33-2700e0f0340b spider: astonbarclay.gb
2025-12-02 19:07:53 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e1777a46-13ac-5c66-8e33-2700e0f0340b due to rule: high_mileage_for_country.json, error: 157253 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157253
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'BRONZE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'e1777a46-13ac-5c66-8e33-2700e0f0340b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'H5UNE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117666471',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JAGUAR',
 'model': 'XF DIESEL SALOON',
 'odometer': 97713,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34090,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/ea9c576a-989c-4443-a01d-8b3b06e55f67_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35794,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/d4a410e4-c056-4757-b3da-38101b796aa2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28971,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/318075c5-a5b9-41c5-8d7c-cea4204ac601_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28569,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/1c4c309e-fe7a-43af-a405-be19bad553c9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37503,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/295a362f-94a7-4c37-97ea-d7f9a85b75e7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34249,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/b9e33229-edc7-4c34-a3e8-9d2d5e26c6ff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55888,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/e4010b4f-3a2c-4e2c-9145-a2008e242a13_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41829,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/b2624cdc-2c47-4c06-9d23-5cec4f7eaebb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47428,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/cc7be145-e7ba-4113-bbe4-bcf62a17c078_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1777a46-13ac-5c66-8e33-2700e0f0340b/e1777a46-13ac-5c66-8e33-2700e0f0340b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53306,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/H5UNE/2025-12-02/image/9c998c6a-3b08-4279-94e9-b6d144c4fe7f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-11',
 'seller_name': 'UKCGR',
 'title': 'JAGUAR XF DIESEL SALOON 2.0d Portfolio 4dr Auto',
 'transmission': 'automatic',
 'trim': '2.0d Portfolio 4dr Auto',
 'vin': None,
 'year': 2016}
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117666471%27 HTTP/1.1" 200 None
2025-12-02 19:07:53 [astonbarclay.gb] INFO: Saving data for 117666471: {'created_time': 1764702473.043475, 'last_price_update_time': 1764702473.043488}
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117666471') HTTP/1.1" 204 0
2025-12-02 19:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9268db81-8202-5fa9-889b-dd8553742c4e with identifier: 117660676
2025-12-02 19:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9268db81-8202-5fa9-889b-dd8553742c4e with identifier: 117660676
2025-12-02 19:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9268db81-8202-5fa9-889b-dd8553742c4e with identifier: 117660676 to the API
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4c925ad4-e6bf-4c7b-a302-58d2c5228cd7_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '9268db81-8202-5fa9-889b-dd8553742c4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SO18XEY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117660676',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS DIESEL SALOON',
 'odometer': 63056,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30819,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbd72070-2bc9-4233-a36c-e4cb626d292e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30006,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4c925ad4-e6bf-4c7b-a302-58d2c5228cd7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31525,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/72f13b29-ab1b-4148-a0d1-128401175602_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29115,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/4a30f7fd-9efa-401b-be72-781169d7788e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36941,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/dbacbd23-5799-4135-a7f8-bdda8fecedca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50598,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/a0261872-431d-41ce-bf21-2683a6c82aa8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30861,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/0a8b1e9d-50e9-424f-9af7-f0a5489cf2dd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49761,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/1a712d19-23e9-4331-ad83-168d7766cfc3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9268db81-8202-5fa9-889b-dd8553742c4e/9268db81-8202-5fa9-889b-dd8553742c4e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41026,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SO18XEY/2025-12-02/image/8507d8a8-0e69-432e-aa14-137f9c12451b_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-22',
 'seller_name': 'UKCGR',
 'title': 'MERCEDES-BENZ C CLASS DIESEL SALOON C200d Sport 4dr Auto',
 'transmission': 'automatic',
 'trim': 'C200d Sport 4dr Auto',
 'vin': None,
 'year': 2018}
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660676%27 HTTP/1.1" 200 None
2025-12-02 19:07:53 [astonbarclay.gb] INFO: Saving data for 117660676: {'created_time': 1764702473.399075, 'last_price_update_time': 1764702473.399086}
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117660676') HTTP/1.1" 204 0
2025-12-02 19:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260567?view=catalogue)
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c8abd0>
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72HVL%252F2025-11-14%252Fimage%252F7f62dda6-bde8-4f7b-b2be-87dd0daae7b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72HVL/2025-11-14/image/7f62dda6-bde8-4f7b-b2be-87dd0daae7b1_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07009895-e542-5e3b-a5f2-179c007b5a49
2025-12-02 19:07:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07009895-e542-5e3b-a5f2-179c007b5a49, skipping ID generation
2025-12-02 19:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07009895-e542-5e3b-a5f2-179c007b5a49 with scrape type 1
2025-12-02 19:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 07009895-e542-5e3b-a5f2-179c007b5a49 from tracking dictionaries
2025-12-02 19:07:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07009895-e542-5e3b-a5f2-179c007b5a49 sending to next pipeline
2025-12-02 19:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 07009895-e542-5e3b-a5f2-179c007b5a49, identifier: 117219838
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07c13d0>
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252Fe35211e4-be2a-4e74-af6d-98ee75025880_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e35211e4-be2a-4e74-af6d-98ee75025880_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0339410>
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72EBD%252F2025-11-21%252Fimage%252F35d595a4-5675-4676-b10c-1c450d858a9b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72EBD/2025-11-21/image/35d595a4-5675-4676-b10c-1c450d858a9b_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e184f423-723a-544a-aee9-25b0e9972bbb
2025-12-02 19:07:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e184f423-723a-544a-aee9-25b0e9972bbb, skipping ID generation
2025-12-02 19:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e184f423-723a-544a-aee9-25b0e9972bbb with scrape type 1
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e184f423-723a-544a-aee9-25b0e9972bbb from tracking dictionaries
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e184f423-723a-544a-aee9-25b0e9972bbb sending to next pipeline
2025-12-02 19:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e184f423-723a-544a-aee9-25b0e9972bbb, identifier: 117399373
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09cef10>
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFE73ZHL%252F2025-11-21%252Fimage%252Fc1a8bf9b-8ee1-4a5a-b9fc-65b63fbf2e26_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/c1a8bf9b-8ee1-4a5a-b9fc-65b63fbf2e26_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 778ed0e5-6670-5732-a457-03c3b097cdae
2025-12-02 19:07:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 778ed0e5-6670-5732-a457-03c3b097cdae, skipping ID generation
2025-12-02 19:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 778ed0e5-6670-5732-a457-03c3b097cdae with scrape type 1
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 778ed0e5-6670-5732-a457-03c3b097cdae from tracking dictionaries
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 778ed0e5-6670-5732-a457-03c3b097cdae sending to next pipeline
2025-12-02 19:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 778ed0e5-6670-5732-a457-03c3b097cdae, identifier: 117411447
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c8a350>
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252Fe5fefdae-8b84-465e-83ca-195217d36c66_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e5fefdae-8b84-465e-83ca-195217d36c66_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06bce50>
2025-12-02 19:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252Fa33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/a33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ecc587c-496b-59ed-8a76-a9db935c478b
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07c0f10>
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72FRF%252F2025-11-17%252Fimage%252F907974b8-7b19-4e11-b46d-ae94021a5ef8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72FRF/2025-11-17/image/907974b8-7b19-4e11-b46d-ae94021a5ef8_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8
2025-12-02 19:07:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8, skipping ID generation
2025-12-02 19:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8 with scrape type 1
2025-12-02 19:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8 from tracking dictionaries
2025-12-02 19:07:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8 sending to next pipeline
2025-12-02 19:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8, identifier: 117269658
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08a7d90>
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252Ff91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ecc587c-496b-59ed-8a76-a9db935c478b
2025-12-02 19:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 07009895-e542-5e3b-a5f2-179c007b5a49 with identifier: 117219838
2025-12-02 19:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 07009895-e542-5e3b-a5f2-179c007b5a49 with identifier: 117219838
2025-12-02 19:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 07009895-e542-5e3b-a5f2-179c007b5a49 with identifier: 117219838 to the API
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NA72HVL/2025-11-14/image/7f62dda6-bde8-4f7b-b2be-87dd0daae7b1_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '07009895-e542-5e3b-a5f2-179c007b5a49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NA72HVL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117219838',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 40606,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35936,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/5cb56246-25be-4ad8-bbf0-a067d32e0ed2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33879,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/6b5187d2-220d-4de6-97dc-f21cf8bf3d21_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33096,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/880056de-5220-47aa-b309-5925b828182d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35263,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/76de69b3-76ff-46c2-b2ec-3d4333a177f4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44042,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/4e71865c-6d62-4cd0-9489-64120bb7b316_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56274,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/904a4557-b1ea-44fe-afd1-40b6d7d7abbe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51208,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/9696f272-4fe2-41e8-8554-618c99227cf5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53109,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/606a1920-2a5d-4c14-8346-0a1835793aeb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07009895-e542-5e3b-a5f2-179c007b5a49/07009895-e542-5e3b-a5f2-179c007b5a49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49007,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72HVL/2025-11-14/image/7f62dda6-bde8-4f7b-b2be-87dd0daae7b1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-14',
 'seller_name': 'Kinto',
 'title': 'AUDI Q2 ESTATE 30 TFSI Technik 5dr',
 'transmission': 'manual',
 'trim': '30 TFSI Technik 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117219838%27 HTTP/1.1" 200 None
2025-12-02 19:07:56 [astonbarclay.gb] INFO: Saving data for 117219838: {'created_time': 1764702476.100416, 'last_price_update_time': 1764702476.100426, 'auction_closing_time': 1765532700.0}
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117219838') HTTP/1.1" 204 0
2025-12-02 19:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e184f423-723a-544a-aee9-25b0e9972bbb with identifier: 117399373
2025-12-02 19:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e184f423-723a-544a-aee9-25b0e9972bbb with identifier: 117399373
2025-12-02 19:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e184f423-723a-544a-aee9-25b0e9972bbb with identifier: 117399373 to the API
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NA72EBD/2025-11-21/image/35d595a4-5675-4676-b10c-1c450d858a9b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'e184f423-723a-544a-aee9-25b0e9972bbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NA72EBD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117399373',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'KIA',
 'model': 'SPORTAGE DIESEL ESTATE',
 'odometer': 19581,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30577,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/35d595a4-5675-4676-b10c-1c450d858a9b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26500,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/14515f80-1e86-40c8-aa3f-a148c0b61deb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32031,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/4774feed-21ec-4786-a3f1-a071dd14ae18_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36447,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/c31ede82-299e-400d-9fdd-8a80603eceda_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48564,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/f398c86a-ab30-47c1-bb49-e16fcc122718_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60669,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/a82e789a-6329-4bc9-b8b4-9f9d677c0037_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50104,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/183bfcfb-a202-4831-9ebe-441139da6047_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41968,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/74a86661-99c2-4297-968b-35685fd1cd59_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e184f423-723a-544a-aee9-25b0e9972bbb/e184f423-723a-544a-aee9-25b0e9972bbb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51228,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72EBD/2025-11-21/image/6da92dc0-bc69-40b6-a629-f01c196dca2d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-21',
 'seller_name': 'Kinto',
 'title': 'KIA SPORTAGE DIESEL ESTATE 1.6 CRDi ISG 2 5dr',
 'transmission': 'manual',
 'trim': '1.6 CRDi ISG 2 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399373%27 HTTP/1.1" 200 None
2025-12-02 19:07:56 [astonbarclay.gb] INFO: Saving data for 117399373: {'created_time': 1764702476.445627, 'last_price_update_time': 1764702476.445638, 'auction_closing_time': 1765532700.0}
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117399373') HTTP/1.1" 204 0
2025-12-02 19:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 778ed0e5-6670-5732-a457-03c3b097cdae with identifier: 117411447
2025-12-02 19:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 778ed0e5-6670-5732-a457-03c3b097cdae with identifier: 117411447
2025-12-02 19:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 778ed0e5-6670-5732-a457-03c3b097cdae with identifier: 117411447 to the API
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/c1a8bf9b-8ee1-4a5a-b9fc-65b63fbf2e26_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 28,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '778ed0e5-6670-5732-a457-03c3b097cdae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FE73ZHL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117411447',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND HATCHBACK',
 'odometer': 21241,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30858,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/c1a8bf9b-8ee1-4a5a-b9fc-65b63fbf2e26_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30600,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/3f2f2fb1-b658-44ae-9b03-4275cc3c3cd5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35734,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/66c5940b-c32b-487f-9425-c7eed27eec44_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36699,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/2002f4b1-4db4-41d7-966a-f036248b3964_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39368,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ae71e3a6-3041-418b-9761-c4f710a64c2b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61430,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/db9e4ac8-1290-443e-ac15-e0005a9e8a5e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52172,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/b6a58aa7-8c08-4678-8c1d-b217f01553fd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57153,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ead2a8f3-31bf-4390-b343-733525cb4f03_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_778ed0e5-6670-5732-a457-03c3b097cdae/778ed0e5-6670-5732-a457-03c3b097cdae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52100,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FE73ZHL/2025-11-21/image/ab2f021c-6523-4ef3-930a-d9b58b8a283a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-27',
 'seller_name': 'Kinto',
 'title': 'VAUXHALL GRANDLAND HATCHBACK 1.6 Plug-in Hybrid GS 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 Plug-in Hybrid GS 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117411447%27 HTTP/1.1" 200 None
2025-12-02 19:07:56 [astonbarclay.gb] INFO: Saving data for 117411447: {'created_time': 1764702476.796291, 'last_price_update_time': 1764702476.796301, 'auction_closing_time': 1765532700.0}
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117411447') HTTP/1.1" 204 0
2025-12-02 19:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8 with identifier: 117269658
2025-12-02 19:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8 with identifier: 117269658
2025-12-02 19:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8 with identifier: 117269658 to the API
2025-12-02 19:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NA72FRF/2025-11-17/image/907974b8-7b19-4e11-b46d-ae94021a5ef8_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NA72FRF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117269658',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'CITROEN',
 'model': 'C5 AIRCROSS HATCHBACK',
 'odometer': 54616,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39447,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e35211e4-be2a-4e74-af6d-98ee75025880_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38055,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/e5fefdae-8b84-465e-83ca-195217d36c66_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38212,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/907974b8-7b19-4e11-b46d-ae94021a5ef8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37777,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/ec45f676-783b-4be5-9adb-2a7c5f2e9bb7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42296,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/08a8bec3-62d4-4870-8572-e5f0c8c52677_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58405,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/9efff528-a4c0-4ec7-84db-76531497d6b0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55054,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/7b9d87b6-1f22-4a3e-922c-7b22c6c6d2b7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57656,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/0d3b5bf5-80f3-430b-917f-968c7a79b84b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8/6b43ea9c-fe03-555b-b38d-55d0d1b9f8a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52835,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72FRF/2025-11-17/image/a42776ef-40bb-4ee9-8095-f6f0241c84c3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seller_name': 'Kinto',
 'title': 'CITROEN C5 AIRCROSS HATCHBACK 1.2 PureTech Shine 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Shine 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269658%27 HTTP/1.1" 200 None
2025-12-02 19:07:57 [astonbarclay.gb] INFO: Saving data for 117269658: {'created_time': 1764702477.144034, 'last_price_update_time': 1764702477.144043, 'auction_closing_time': 1765532700.0}
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117269658') HTTP/1.1" 204 0
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260567?view=catalogue)
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/acb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260567?view=catalogue)
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260567?view=catalogue)
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260567?view=catalogue)
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117651744?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117563859?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117605936?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117359649?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117681164?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117684407?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117660985?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf049d0d0>
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252F569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ecc587c-496b-59ed-8a76-a9db935c478b
2025-12-02 19:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260567?view=catalogue)
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066c890>
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252F1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ecc587c-496b-59ed-8a76-a9db935c478b
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03e4790>
2025-12-02 19:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252Facb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/acb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ecc587c-496b-59ed-8a76-a9db935c478b
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066ef50>
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252F4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ecc587c-496b-59ed-8a76-a9db935c478b
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066f410>
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252Ff55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg?w=600 saved to cache
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ecc587c-496b-59ed-8a76-a9db935c478b
2025-12-02 19:07:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117651744, 'registration': 'FV18FGE', 'account': 'MOT075', 'make': 'AUDI', 'model': 'A5 DIESEL SPORTBACK', 'derivative': '2.0 TDI Ultra S Line 5dr S Tronic', 'mileage': 62221, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2018-05-10', 'fuel': 'Diesel', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117651744, 'registration': 'FV18FGE', 'account': 'MOT075', 'make': 'AUDI', 'model': 'A5 DIESEL SPORTBACK', 'derivative': '2.0 TDI Ultra S Line 5dr S Tronic', 'mileage': 62221, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2018-05-10', 'fuel': 'Diesel', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39bfeb76-2f3f-5085-a62d-22987d9fc25b with identifier: 117651744
2025-12-02 19:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39bfeb76-2f3f-5085-a62d-22987d9fc25b with scrape type 1
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 39bfeb76-2f3f-5085-a62d-22987d9fc25b
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 39bfeb76-2f3f-5085-a62d-22987d9fc25b
2025-12-02 19:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 39bfeb76-2f3f-5085-a62d-22987d9fc25b, identifier: 117651744
2025-12-02 19:07:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117563859, 'registration': 'PK21UWZ', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI EVO SEL 5dr DSG', 'mileage': 4227, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-06-10', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117563859, 'registration': 'PK21UWZ', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI EVO SEL 5dr DSG', 'mileage': 4227, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-06-10', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8cd79e3-986b-59c0-ba4b-eacb6b59e520 with identifier: 117563859
2025-12-02 19:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8cd79e3-986b-59c0-ba4b-eacb6b59e520 with scrape type 1
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d8cd79e3-986b-59c0-ba4b-eacb6b59e520
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d8cd79e3-986b-59c0-ba4b-eacb6b59e520
2025-12-02 19:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d8cd79e3-986b-59c0-ba4b-eacb6b59e520, identifier: 117563859
2025-12-02 19:07:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117605936, 'registration': 'DC23CAU', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 18672, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117605936, 'registration': 'DC23CAU', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 18672, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04e65398-38b6-5296-b253-63de2b47aee5 with identifier: 117605936
2025-12-02 19:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04e65398-38b6-5296-b253-63de2b47aee5 with scrape type 2
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04e65398-38b6-5296-b253-63de2b47aee5 with scrape type 2
2025-12-02 19:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 04e65398-38b6-5296-b253-63de2b47aee5, identifier: 117605936
2025-12-02 19:07:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117359649, 'registration': 'WV20RWJ', 'account': 'RCI014', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr EAT8', 'mileage': 35962, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-03-17', 'fuel': 'Petrol', 'motExpiry': '2025-10-31', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 15K 17K 26K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60855ae5-eb34-4231-9d8b-d1d87d72c5ca.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117359649, 'registration': 'WV20RWJ', 'account': 'RCI014', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr EAT8', 'mileage': 35962, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-03-17', 'fuel': 'Petrol', 'motExpiry': '2025-10-31', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 15K 17K 26K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60855ae5-eb34-4231-9d8b-d1d87d72c5ca.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb42295b-4fe8-5810-b394-cd3464bdd3e6 with identifier: 117359649
2025-12-02 19:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb42295b-4fe8-5810-b394-cd3464bdd3e6 with scrape type 1
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item eb42295b-4fe8-5810-b394-cd3464bdd3e6
2025-12-02 19:07:58 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item eb42295b-4fe8-5810-b394-cd3464bdd3e6
2025-12-02 19:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eb42295b-4fe8-5810-b394-cd3464bdd3e6, identifier: 117359649
2025-12-02 19:07:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117681164, 'registration': 'VO67NXP', 'account': 'WBA001', 'make': 'VOLKSWAGEN', 'model': 'GOLF SV HATCHBACK', 'derivative': '1.4 TSI SE 5dr DSG', 'mileage': 67221, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2017-11-08', 'fuel': 'Petrol', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VO67NXP/2025-12-02/image/fd33ef5b-530d-4ce0-8fc1-4ff81adae70d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/11ddaa2a-6de3-495b-b054-be039973a3e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/af24107d-a2c2-4b73-bd97-6a85cebadcc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/16a69795-4644-40f2-a7eb-e3c3ff5db697_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/db5a9102-a9d6-4c9b-b088-870805a2152d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/44fb9012-7a42-4a38-a9e2-562e942b1652_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/9f87016b-c273-419e-b0f1-b25e4395383e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/6db987c6-adc7-48ec-93a5-218b114f85e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/33167b3d-fc50-4052-8b64-6c7050ac9d45_removebg.jpg?w=600'], 'colour': 'GOLD', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 59K, 63K, 65K, 67K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a0c497f0-92c4-4d2c-bd98-4bd504873c16.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117681164, 'registration': 'VO67NXP', 'account': 'WBA001', 'make': 'VOLKSWAGEN', 'model': 'GOLF SV HATCHBACK', 'derivative': '1.4 TSI SE 5dr DSG', 'mileage': 67221, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2017-11-08', 'fuel': 'Petrol', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VO67NXP/2025-12-02/image/fd33ef5b-530d-4ce0-8fc1-4ff81adae70d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/11ddaa2a-6de3-495b-b054-be039973a3e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/af24107d-a2c2-4b73-bd97-6a85cebadcc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/16a69795-4644-40f2-a7eb-e3c3ff5db697_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/db5a9102-a9d6-4c9b-b088-870805a2152d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/44fb9012-7a42-4a38-a9e2-562e942b1652_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/9f87016b-c273-419e-b0f1-b25e4395383e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/6db987c6-adc7-48ec-93a5-218b114f85e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/33167b3d-fc50-4052-8b64-6c7050ac9d45_removebg.jpg?w=600'], 'colour': 'GOLD', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 59K, 63K, 65K, 67K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a0c497f0-92c4-4d2c-bd98-4bd504873c16.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf6a60e6-eef3-5b2a-a84a-a51967d21dd6 with identifier: 117681164
2025-12-02 19:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6 with scrape type 1
2025-12-02 19:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252Ffd33ef5b-530d-4ce0-8fc1-4ff81adae70d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/fd33ef5b-530d-4ce0-8fc1-4ff81adae70d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117684407, 'registration': 'WU68UBC', 'account': 'MAN037', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.25 GT-line 5dr', 'mileage': 63914, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-10-13', 'fuel': 'Petrol', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 10/19 4K - 01/21 9K - 10/21 11K - 09/22 22K - 11/23 37K - 08/24 50K - 11/25 63K -', 'remarks': 'VOSA STATES 23K - 38K - 53K - 63K -', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0fd46602-98fd-4948-97c7-6b5e42e7d171.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117684407, 'registration': 'WU68UBC', 'account': 'MAN037', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.25 GT-line 5dr', 'mileage': 63914, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-10-13', 'fuel': 'Petrol', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 10/19 4K - 01/21 9K - 10/21 11K - 09/22 22K - 11/23 37K - 08/24 50K - 11/25 63K -', 'remarks': 'VOSA STATES 23K - 38K - 53K - 63K -', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0fd46602-98fd-4948-97c7-6b5e42e7d171.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84229d1c-ede8-5db1-9818-cce8d27e9b23 with identifier: 117684407
2025-12-02 19:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84229d1c-ede8-5db1-9818-cce8d27e9b23 with scrape type 1
2025-12-02 19:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 84229d1c-ede8-5db1-9818-cce8d27e9b23
2025-12-02 19:07:59 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 84229d1c-ede8-5db1-9818-cce8d27e9b23
2025-12-02 19:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 84229d1c-ede8-5db1-9818-cce8d27e9b23, identifier: 117684407
2025-12-02 19:07:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117660985, 'registration': 'YO69XGK', 'account': 'WBA001', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost ST-Line 5dr Auto 2WD', 'mileage': 41305, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-10-25', 'fuel': 'Petrol', 'motExpiry': '2026-08-20', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YO69XGK/2025-12-02/image/4d5e73a3-c5f9-4ed4-aabb-75c8b6fe7995_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/05f3b110-31d9-4384-b1a4-6c5feb9b598f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/5bf41d31-20a7-4039-b3f6-d856c4acfe1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/6863ee1b-d9f4-4e49-a0b6-2481292b981c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/eb7bcb63-347e-4279-910c-a007c504b0eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/00a56978-54df-4406-8100-024556cf6197_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/2bf70190-3b6a-480a-8384-8f5cb171bea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/3ce9a017-d72a-4354-b5ed-7c6ff78386c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/368d7df7-4316-4ce0-afc4-63c3cb78e10d_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 10/20-2k,  10/21-5k,  09/22-9k,  01/23-10k,  08/23-18k,  08/24-28k,  08/25-38k', 'remarks': 'SPARE KEY - VOSA STATES 38k 28k 18k 9k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 206, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4eee9595-3c28-407e-ac10-426b763ac54c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117660985, 'registration': 'YO69XGK', 'account': 'WBA001', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost ST-Line 5dr Auto 2WD', 'mileage': 41305, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-10-25', 'fuel': 'Petrol', 'motExpiry': '2026-08-20', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YO69XGK/2025-12-02/image/4d5e73a3-c5f9-4ed4-aabb-75c8b6fe7995_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/05f3b110-31d9-4384-b1a4-6c5feb9b598f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/5bf41d31-20a7-4039-b3f6-d856c4acfe1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/6863ee1b-d9f4-4e49-a0b6-2481292b981c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/eb7bcb63-347e-4279-910c-a007c504b0eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/00a56978-54df-4406-8100-024556cf6197_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/2bf70190-3b6a-480a-8384-8f5cb171bea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/3ce9a017-d72a-4354-b5ed-7c6ff78386c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/368d7df7-4316-4ce0-afc4-63c3cb78e10d_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 10/20-2k,  10/21-5k,  09/22-9k,  01/23-10k,  08/23-18k,  08/24-28k,  08/25-38k', 'remarks': 'SPARE KEY - VOSA STATES 38k 28k 18k 9k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 206, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4eee9595-3c28-407e-ac10-426b763ac54c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e92ad6a4-aa71-5373-8762-0d685f26e287 with identifier: 117660985
2025-12-02 19:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e92ad6a4-aa71-5373-8762-0d685f26e287 with scrape type 1
2025-12-02 19:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item e92ad6a4-aa71-5373-8762-0d685f26e287
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F4d5e73a3-c5f9-4ed4-aabb-75c8b6fe7995_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/4d5e73a3-c5f9-4ed4-aabb-75c8b6fe7995_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 39bfeb76-2f3f-5085-a62d-22987d9fc25b with identifier: 117651744
2025-12-02 19:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 39bfeb76-2f3f-5085-a62d-22987d9fc25b with identifier: 117651744
2025-12-02 19:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 39bfeb76-2f3f-5085-a62d-22987d9fc25b with identifier: 117651744 to the API
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2739bfeb76-2f3f-5085-a62d-22987d9fc25b%27 HTTP/1.1" 200 None
2025-12-02 19:07:59 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 39bfeb76-2f3f-5085-a62d-22987d9fc25b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117651744?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '39bfeb76-2f3f-5085-a62d-22987d9fc25b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FV18FGE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117651744',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A5 DIESEL SPORTBACK',
 'odometer': 62221,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-10',
 'seller_name': 'MotoNovo Finance',
 'title': 'AUDI A5 DIESEL SPORTBACK 2.0 TDI Ultra S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI Ultra S Line 5dr S Tronic',
 'vin': None,
 'year': 2018}
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117651744%27 HTTP/1.1" 200 None
2025-12-02 19:07:59 [astonbarclay.gb] INFO: Saving data for 117651744: {'created_time': 1764702479.427028, 'last_price_update_time': 1764702479.427038}
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117651744') HTTP/1.1" 204 0
2025-12-02 19:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d8cd79e3-986b-59c0-ba4b-eacb6b59e520 with identifier: 117563859
2025-12-02 19:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d8cd79e3-986b-59c0-ba4b-eacb6b59e520 with identifier: 117563859
2025-12-02 19:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d8cd79e3-986b-59c0-ba4b-eacb6b59e520 with identifier: 117563859 to the API
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d8cd79e3-986b-59c0-ba4b-eacb6b59e520%27 HTTP/1.1" 200 None
2025-12-02 19:07:59 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d8cd79e3-986b-59c0-ba4b-eacb6b59e520: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117563859?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'd8cd79e3-986b-59c0-ba4b-eacb6b59e520',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PK21UWZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117563859',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC HATCHBACK',
 'odometer': 4227,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-10',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN T-ROC HATCHBACK 1.5 TSI EVO SEL 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI EVO SEL 5dr DSG',
 'vin': None,
 'year': 2021}
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563859%27 HTTP/1.1" 200 None
2025-12-02 19:07:59 [astonbarclay.gb] INFO: Saving data for 117563859: {'created_time': 1764702479.716663, 'last_price_update_time': 1764702479.716673}
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117563859') HTTP/1.1" 204 0
2025-12-02 19:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 04e65398-38b6-5296-b253-63de2b47aee5 with identifier: 117605936
2025-12-02 19:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 04e65398-38b6-5296-b253-63de2b47aee5 with identifier: 117605936
2025-12-02 19:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 04e65398-38b6-5296-b253-63de2b47aee5 with identifier: 117605936 to the API
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2704e65398-38b6-5296-b253-63de2b47aee5%27 HTTP/1.1" 200 None
2025-12-02 19:07:59 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 04e65398-38b6-5296-b253-63de2b47aee5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:07:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117605936?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '04e65398-38b6-5296-b253-63de2b47aee5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23CAU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117605936',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 18672,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605936%27 HTTP/1.1" 200 None
2025-12-02 19:08:00 [astonbarclay.gb] INFO: Saving data for 117605936: {'auction_closing_time': 1764670500.0, 'created_time': 1764356489.835678, 'last_price_update_time': 1764702480.020635}
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117605936') HTTP/1.1" 204 0
2025-12-02 19:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eb42295b-4fe8-5810-b394-cd3464bdd3e6 with identifier: 117359649
2025-12-02 19:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eb42295b-4fe8-5810-b394-cd3464bdd3e6 with identifier: 117359649
2025-12-02 19:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: eb42295b-4fe8-5810-b394-cd3464bdd3e6 with identifier: 117359649 to the API
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27eb42295b-4fe8-5810-b394-cd3464bdd3e6%27 HTTP/1.1" 200 None
2025-12-02 19:08:00 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id eb42295b-4fe8-5810-b394-cd3464bdd3e6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:08:00 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117359649?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'eb42295b-4fe8-5810-b394-cd3464bdd3e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WV20RWJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117359649',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'PEUGEOT',
 'model': '3008 ESTATE',
 'odometer': 35962,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-17',
 'seller_name': None,
 'title': 'PEUGEOT 3008 ESTATE 1.2 PureTech Allure 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.2 PureTech Allure 5dr EAT8',
 'vin': None,
 'year': 2020}
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117359649%27 HTTP/1.1" 200 None
2025-12-02 19:08:00 [astonbarclay.gb] INFO: Saving data for 117359649: {'created_time': 1764702480.337412, 'last_price_update_time': 1764702480.337421}
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117359649') HTTP/1.1" 204 0
2025-12-02 19:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 84229d1c-ede8-5db1-9818-cce8d27e9b23 with identifier: 117684407
2025-12-02 19:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 84229d1c-ede8-5db1-9818-cce8d27e9b23 with identifier: 117684407
2025-12-02 19:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 84229d1c-ede8-5db1-9818-cce8d27e9b23 with identifier: 117684407 to the API
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2784229d1c-ede8-5db1-9818-cce8d27e9b23%27 HTTP/1.1" 200 None
2025-12-02 19:08:00 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 84229d1c-ede8-5db1-9818-cce8d27e9b23: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:08:00 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117684407?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '84229d1c-ede8-5db1-9818-cce8d27e9b23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WU68UBC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117684407',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'PICANTO HATCHBACK',
 'odometer': 63914,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-13',
 'seller_name': 'Manamanx Ltd',
 'title': 'KIA PICANTO HATCHBACK 1.25 GT-line 5dr',
 'transmission': 'manual',
 'trim': '1.25 GT-line 5dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117684407%27 HTTP/1.1" 200 None
2025-12-02 19:08:00 [astonbarclay.gb] INFO: Saving data for 117684407: {'created_time': 1764702480.652004, 'last_price_update_time': 1764702480.652015}
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117684407') HTTP/1.1" 204 0
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F11ddaa2a-6de3-495b-b054-be039973a3e0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/11ddaa2a-6de3-495b-b054-be039973a3e0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F05f3b110-31d9-4384-b1a4-6c5feb9b598f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/05f3b110-31d9-4384-b1a4-6c5feb9b598f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117268826?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0373750>
2025-12-02 19:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MTZ%252F2025-11-17%252Fimage%252F62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ecc587c-496b-59ed-8a76-a9db935c478b
2025-12-02 19:08:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ecc587c-496b-59ed-8a76-a9db935c478b, skipping ID generation
2025-12-02 19:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ecc587c-496b-59ed-8a76-a9db935c478b with scrape type 1
2025-12-02 19:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0ecc587c-496b-59ed-8a76-a9db935c478b from tracking dictionaries
2025-12-02 19:08:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ecc587c-496b-59ed-8a76-a9db935c478b sending to next pipeline
2025-12-02 19:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0ecc587c-496b-59ed-8a76-a9db935c478b, identifier: 117260567
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252Faf24107d-a2c2-4b73-bd97-6a85cebadcc1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/af24107d-a2c2-4b73-bd97-6a85cebadcc1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F5bf41d31-20a7-4039-b3f6-d856c4acfe1d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/5bf41d31-20a7-4039-b3f6-d856c4acfe1d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0ecc587c-496b-59ed-8a76-a9db935c478b with identifier: 117260567
2025-12-02 19:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0ecc587c-496b-59ed-8a76-a9db935c478b with identifier: 117260567
2025-12-02 19:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 9, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'polestar 2 fastback 170kw 78kwh long range single motor 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'polestar', 'model': '2 fastback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 51482, 'odometer_reading_unit': 'mi', 'registration_date': '2022-06-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117260567', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '170kw 78kwh long range single motor 5dr auto', 'license_plate': 'oe22mtz', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '0ecc587c-496b-59ed-8a76-a9db935c478b', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 37782}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36712}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33108}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/acb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 24956}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50473}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48314}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/ffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59962}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/a33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49060}], 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'polestar 2 fastback', 'sanitized_make': 'polestar', 'odometer_in_km': 82852}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 41,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': '0ecc587c-496b-59ed-8a76-a9db935c478b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'oe22mtz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117260567',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'polestar',
     'make_model': 'polestar 2 fastback',
     'model': '2 fastback',
     'odometer': 51482,
     'odometer_in_km': 82852,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37782,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36712,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33108,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33670,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/acb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24956,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50473,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48314,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59962,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/ffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49060,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/a33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-06-28',
     'sanitized_make': 'polestar',
     'seller_name': 'kinto',
     'title': 'polestar 2 fastback 170kw 78kwh long range single motor 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '170kw 78kwh long range single motor 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 0ecc587c-496b-59ed-8a76-a9db935c478b spider: astonbarclay.gb
2025-12-02 19:08:01 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0ecc587c-496b-59ed-8a76-a9db935c478b due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 9, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'polestar 2 fastback 170kw 78kwh long range single motor 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'polestar', 'model': '2 fastback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 51482, 'odometer_reading_unit': 'mi', 'registration_date': '2022-06-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117260567', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '170kw 78kwh long range single motor 5dr auto', 'license_plate': 'oe22mtz', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '0ecc587c-496b-59ed-8a76-a9db935c478b', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 37782}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36712}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33108}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/acb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 24956}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50473}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48314}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/ffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59962}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/a33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49060}], 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'polestar 2 fastback', 'sanitized_make': 'polestar', 'odometer_in_km': 82852}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 41,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': '0ecc587c-496b-59ed-8a76-a9db935c478b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'oe22mtz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117260567',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'polestar',
     'make_model': 'polestar 2 fastback',
     'model': '2 fastback',
     'odometer': 51482,
     'odometer_in_km': 82852,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37782,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36712,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33108,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33670,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/acb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24956,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50473,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48314,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59962,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/ffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49060,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/a33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-06-28',
     'sanitized_make': 'polestar',
     'seller_name': 'kinto',
     'title': 'polestar 2 fastback 170kw 78kwh long range single motor 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '170kw 78kwh long range single motor 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '0ecc587c-496b-59ed-8a76-a9db935c478b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OE22MTZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117260567',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'POLESTAR',
 'model': '2 FASTBACK',
 'odometer': 51482,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37782,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/62f101e0-745a-4ac0-bba0-981c4ede03b9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36712,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/4aa20048-ac45-4cac-9c3c-5237a5ba1549_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33108,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f55f0fa4-b1eb-4296-9fb3-2d9bd3214033_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33670,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/acb2c5ad-9867-4a48-8837-baaa146021f8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24956,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/1254802d-978c-4dae-a05f-2b7b14a59791_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50473,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/569b7c34-5b33-4fb9-999e-903159fe67d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48314,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/f91eff4a-d234-4ddf-b288-451b5b598739_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59962,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/ffe70a17-0cd3-4bd9-9229-a5ac3d33e85b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ecc587c-496b-59ed-8a76-a9db935c478b/0ecc587c-496b-59ed-8a76-a9db935c478b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49060,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MTZ/2025-11-17/image/a33eabd1-ad11-4e2e-a633-fe395e79f552_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-28',
 'seller_name': 'Kinto',
 'title': 'POLESTAR 2 FASTBACK 170kW 78kWh Long Range Single motor 5dr Auto',
 'transmission': 'automatic',
 'trim': '170kW 78kWh Long Range Single motor 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117260567%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [astonbarclay.gb] INFO: Saving data for 117260567: {'created_time': 1764702481.253234, 'last_price_update_time': 1764702481.253244, 'auction_closing_time': 1765532700.0}
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117260567') HTTP/1.1" 204 0
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F16a69795-4644-40f2-a7eb-e3c3ff5db697_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/16a69795-4644-40f2-a7eb-e3c3ff5db697_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F6863ee1b-d9f4-4e49-a0b6-2481292b981c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/6863ee1b-d9f4-4e49-a0b6-2481292b981c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252Fdb5a9102-a9d6-4c9b-b088-870805a2152d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/db5a9102-a9d6-4c9b-b088-870805a2152d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252Feb7bcb63-347e-4279-910c-a007c504b0eb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/eb7bcb63-347e-4279-910c-a007c504b0eb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117268826, 'registration': 'YN70PVF', 'account': 'ANG002', 'make': 'VOLVO', 'model': 'XC40 DIESEL ESTATE', 'derivative': '2.0 D3 Momentum 5dr Geartronic', 'mileage': 40903, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-12-30', 'fuel': 'Diesel', 'motExpiry': '2026-11-14', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN70PVF/2025-11-18/image/39fa3f1d-6843-4137-b86c-a7f2e23cf3dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/67ed5e2a-f75d-4dcf-be6e-869e813a49ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/0928159d-bc7e-44d8-bab7-484e291176e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/5479f724-3c23-4a27-ac46-f4d20852e1bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/e841ce41-1798-4100-841e-fc3294eeb386_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/158180c4-9dbb-4fe1-be5b-73142804e26d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/7085626d-b1fd-4cb8-afa4-da2f99e372df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/3876acf5-3fb9-4c9f-84e1-216a9bf8b4b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/8169df42-91fb-4361-b867-3d6ba683d648_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/00bebcc5-059b-413f-ae92-c7e8df50cf1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/b31bb996-1e9b-4764-8764-b917bb9ff1ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/53c2fc23-fa43-4135-b555-13c7728503bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/0ebbe959-2e0e-4826-b8dc-29f356bdefa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/e953d73c-f39a-4cd6-b11c-e3fbc2156e42_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/783402b7-bafe-4ce1-adc0-4dca47f7128c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/3276aa89-3896-47ca-9b3a-5b97c1f8d938_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/963dee8d-07b9-474e-bae4-857e2ccd7f0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/656834ba-39a0-4198-98b8-9637658e6921_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/4d601409-38e2-47a0-83c2-a7d9b0c278d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/33b38c42-84a6-4e29-b4dc-95f95522e373_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'vosa @ 36k 37k 40k', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31620af6-e1d9-4b8b-b868-fa9c3bb5b01b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117268826, 'registration': 'YN70PVF', 'account': 'ANG002', 'make': 'VOLVO', 'model': 'XC40 DIESEL ESTATE', 'derivative': '2.0 D3 Momentum 5dr Geartronic', 'mileage': 40903, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-12-30', 'fuel': 'Diesel', 'motExpiry': '2026-11-14', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN70PVF/2025-11-18/image/39fa3f1d-6843-4137-b86c-a7f2e23cf3dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/67ed5e2a-f75d-4dcf-be6e-869e813a49ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/0928159d-bc7e-44d8-bab7-484e291176e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/5479f724-3c23-4a27-ac46-f4d20852e1bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/e841ce41-1798-4100-841e-fc3294eeb386_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/158180c4-9dbb-4fe1-be5b-73142804e26d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/7085626d-b1fd-4cb8-afa4-da2f99e372df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/3876acf5-3fb9-4c9f-84e1-216a9bf8b4b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/8169df42-91fb-4361-b867-3d6ba683d648_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/00bebcc5-059b-413f-ae92-c7e8df50cf1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/b31bb996-1e9b-4764-8764-b917bb9ff1ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/53c2fc23-fa43-4135-b555-13c7728503bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/0ebbe959-2e0e-4826-b8dc-29f356bdefa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/e953d73c-f39a-4cd6-b11c-e3fbc2156e42_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/783402b7-bafe-4ce1-adc0-4dca47f7128c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/3276aa89-3896-47ca-9b3a-5b97c1f8d938_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/963dee8d-07b9-474e-bae4-857e2ccd7f0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/656834ba-39a0-4198-98b8-9637658e6921_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/4d601409-38e2-47a0-83c2-a7d9b0c278d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/33b38c42-84a6-4e29-b4dc-95f95522e373_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'vosa @ 36k 37k 40k', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31620af6-e1d9-4b8b-b868-fa9c3bb5b01b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b3c050f-9b41-5e6d-bccf-a592ef416561 with identifier: 117268826
2025-12-02 19:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b3c050f-9b41-5e6d-bccf-a592ef416561 with scrape type 2
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b3c050f-9b41-5e6d-bccf-a592ef416561 with scrape type 2
2025-12-02 19:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5b3c050f-9b41-5e6d-bccf-a592ef416561, identifier: 117268826
2025-12-02 19:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5b3c050f-9b41-5e6d-bccf-a592ef416561 with identifier: 117268826
2025-12-02 19:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5b3c050f-9b41-5e6d-bccf-a592ef416561 with identifier: 117268826
2025-12-02 19:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5b3c050f-9b41-5e6d-bccf-a592ef416561 with identifier: 117268826 to the API
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275b3c050f-9b41-5e6d-bccf-a592ef416561%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5b3c050f-9b41-5e6d-bccf-a592ef416561: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:08:01 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117268826?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '5b3c050f-9b41-5e6d-bccf-a592ef416561',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YN70PVF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117268826',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VOLVO',
 'model': 'XC40 DIESEL ESTATE',
 'odometer': 40903,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-30',
 'seller_name': 'Local Dealer Group',
 'title': 'VOLVO XC40 DIESEL ESTATE 2.0 D3 Momentum 5dr Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 D3 Momentum 5dr Geartronic',
 'vin': None,
 'year': 2020}
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117268826%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [astonbarclay.gb] INFO: Saving data for 117268826: {'auction_closing_time': 1764334800.0, 'created_time': 1763406113.753452, 'last_price_update_time': 1764702481.720092}
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117268826') HTTP/1.1" 204 0
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F44fb9012-7a42-4a38-a9e2-562e942b1652_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/44fb9012-7a42-4a38-a9e2-562e942b1652_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F00a56978-54df-4406-8100-024556cf6197_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/00a56978-54df-4406-8100-024556cf6197_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YO69XGK/2025-12-02/image/05f3b110-31d9-4384-b1a4-6c5feb9b598f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660985?view=catalogue)
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F9f87016b-c273-419e-b0f1-b25e4395383e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/9f87016b-c273-419e-b0f1-b25e4395383e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F2bf70190-3b6a-480a-8384-8f5cb171bea5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/2bf70190-3b6a-480a-8384-8f5cb171bea5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F6db987c6-adc7-48ec-93a5-218b114f85e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/6db987c6-adc7-48ec-93a5-218b114f85e7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F3ce9a017-d72a-4354-b5ed-7c6ff78386c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/3ce9a017-d72a-4354-b5ed-7c6ff78386c2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F33167b3d-fc50-4052-8b64-6c7050ac9d45_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/33167b3d-fc50-4052-8b64-6c7050ac9d45_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F368d7df7-4316-4ce0-afc4-63c3cb78e10d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/368d7df7-4316-4ce0-afc4-63c3cb78e10d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b25d0>
2025-12-02 19:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F05f3b110-31d9-4384-b1a4-6c5feb9b598f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/05f3b110-31d9-4384-b1a4-6c5feb9b598f_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e92ad6a4-aa71-5373-8762-0d685f26e287
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YO69XGK/2025-12-02/image/eb7bcb63-347e-4279-910c-a007c504b0eb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660985?view=catalogue)
2025-12-02 19:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06a2d10>
2025-12-02 19:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252Feb7bcb63-347e-4279-910c-a007c504b0eb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/eb7bcb63-347e-4279-910c-a007c504b0eb_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e92ad6a4-aa71-5373-8762-0d685f26e287
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117239774?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YO69XGK/2025-12-02/image/368d7df7-4316-4ce0-afc4-63c3cb78e10d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660985?view=catalogue)
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117691830?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117086159?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO67NXP/2025-12-02/image/33167b3d-fc50-4052-8b64-6c7050ac9d45_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681164?view=catalogue)
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO67NXP/2025-12-02/image/6db987c6-adc7-48ec-93a5-218b114f85e7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681164?view=catalogue)
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO67NXP/2025-12-02/image/9f87016b-c273-419e-b0f1-b25e4395383e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681164?view=catalogue)
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO67NXP/2025-12-02/image/44fb9012-7a42-4a38-a9e2-562e942b1652_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681164?view=catalogue)
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO67NXP/2025-12-02/image/db5a9102-a9d6-4c9b-b088-870805a2152d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681164?view=catalogue)
2025-12-02 19:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO67NXP/2025-12-02/image/16a69795-4644-40f2-a7eb-e3c3ff5db697_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681164?view=catalogue)
2025-12-02 19:08:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117080670, 'registration': 'LX73WOH', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI R-Line 5dr', 'mileage': 24778, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-09-22', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX73WOH/2025-11-12/image/b6a7fa27-0937-4ff3-8d91-e4b2bb5130d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/6be52a8c-6c4e-4b01-baf7-ffe57b26864f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/776351df-9ca4-451e-b0c9-d49c1a035615_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/297cf991-9b8e-4ec8-855d-da5f4de84bfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/a2788cd7-85ad-4861-b146-c6dd9637c0ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1aa2008d-b6f7-4728-a5aa-2bac1d7a31a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1cf49a13-1c13-45ef-b1ce-5a8a7c1a5708_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb300b4c-adb3-4a28-a652-603e10241439_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/c4a878bd-782c-42f0-91ba-2574458510a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb864b5a-6a54-4e10-a564-f6303ceacd1a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/25 22k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3aa67c8c-5f8d-43ff-944f-5cdbd18333aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117080670, 'registration': 'LX73WOH', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI R-Line 5dr', 'mileage': 24778, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-09-22', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX73WOH/2025-11-12/image/b6a7fa27-0937-4ff3-8d91-e4b2bb5130d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/6be52a8c-6c4e-4b01-baf7-ffe57b26864f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/776351df-9ca4-451e-b0c9-d49c1a035615_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/297cf991-9b8e-4ec8-855d-da5f4de84bfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/a2788cd7-85ad-4861-b146-c6dd9637c0ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1aa2008d-b6f7-4728-a5aa-2bac1d7a31a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1cf49a13-1c13-45ef-b1ce-5a8a7c1a5708_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb300b4c-adb3-4a28-a652-603e10241439_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/c4a878bd-782c-42f0-91ba-2574458510a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb864b5a-6a54-4e10-a564-f6303ceacd1a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/25 22k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3aa67c8c-5f8d-43ff-944f-5cdbd18333aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1a8361b-a960-5c0c-86a5-26eec748d1ec with identifier: 117080670
2025-12-02 19:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1a8361b-a960-5c0c-86a5-26eec748d1ec with scrape type 2
2025-12-02 19:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1a8361b-a960-5c0c-86a5-26eec748d1ec with scrape type 2
2025-12-02 19:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a1a8361b-a960-5c0c-86a5-26eec748d1ec, identifier: 117080670
2025-12-02 19:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a1a8361b-a960-5c0c-86a5-26eec748d1ec with identifier: 117080670
2025-12-02 19:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a1a8361b-a960-5c0c-86a5-26eec748d1ec with identifier: 117080670
2025-12-02 19:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a1a8361b-a960-5c0c-86a5-26eec748d1ec with identifier: 117080670 to the API
2025-12-02 19:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a1a8361b-a960-5c0c-86a5-26eec748d1ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX73WOH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117080670',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'POLO HATCHBACK',
 'odometer': 24778,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-22',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN POLO HATCHBACK 1.0 TSI R-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI R-Line 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117080670%27 HTTP/1.1" 200 None
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Saving data for 117080670: {'auction_closing_time': 1765792800.0, 'created_time': 1764615781.644514, 'last_price_update_time': 1764702483.118101}
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117080670') HTTP/1.1" 204 0
2025-12-02 19:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO67NXP/2025-12-02/image/af24107d-a2c2-4b73-bd97-6a85cebadcc1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681164?view=catalogue)
2025-12-02 19:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YO69XGK/2025-12-02/image/4d5e73a3-c5f9-4ed4-aabb-75c8b6fe7995_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660985?view=catalogue)
2025-12-02 19:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO67NXP/2025-12-02/image/11ddaa2a-6de3-495b-b054-be039973a3e0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681164?view=catalogue)
2025-12-02 19:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YO69XGK/2025-12-02/image/5bf41d31-20a7-4039-b3f6-d856c4acfe1d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660985?view=catalogue)
2025-12-02 19:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YO69XGK/2025-12-02/image/3ce9a017-d72a-4354-b5ed-7c6ff78386c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660985?view=catalogue)
2025-12-02 19:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YO69XGK/2025-12-02/image/6863ee1b-d9f4-4e49-a0b6-2481292b981c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660985?view=catalogue)
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117394487, 'registration': 'AP74FTD', 'account': 'MOT070', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 241 PHEV GT-Line 5dr Auto AWD', 'mileage': 16218, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AP74FTD/2025-11-21/image/e100cf27-028c-41a5-8b00-2a23162381fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/071fdd9e-b2f0-4ee5-92f3-5c36034febfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/01f5b861-641a-4d01-96fa-d725b39b2f1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/da028012-3e27-4e83-bc3d-471d864f6ab2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/b130b72f-71c1-4c32-9e77-298a592c3f67_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/be9f1ba6-ef7e-4818-abb3-cd4c4f0958d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/a5ff6f6f-ec51-4f61-9b17-11d20da18da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/cbba9733-326e-48d6-aabc-83083fdfab0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/20030a71-fa87-49db-99ec-df66757c4dea_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/d76f266c-28b8-409f-a1a2-c5d55d942696_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 08/25 10k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 27, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dedfe391-9033-4f97-9b4d-697db0220075.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117394487, 'registration': 'AP74FTD', 'account': 'MOT070', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 241 PHEV GT-Line 5dr Auto AWD', 'mileage': 16218, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AP74FTD/2025-11-21/image/e100cf27-028c-41a5-8b00-2a23162381fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/071fdd9e-b2f0-4ee5-92f3-5c36034febfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/01f5b861-641a-4d01-96fa-d725b39b2f1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/da028012-3e27-4e83-bc3d-471d864f6ab2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/b130b72f-71c1-4c32-9e77-298a592c3f67_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/be9f1ba6-ef7e-4818-abb3-cd4c4f0958d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/a5ff6f6f-ec51-4f61-9b17-11d20da18da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/cbba9733-326e-48d6-aabc-83083fdfab0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/20030a71-fa87-49db-99ec-df66757c4dea_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/d76f266c-28b8-409f-a1a2-c5d55d942696_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 08/25 10k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 27, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dedfe391-9033-4f97-9b4d-697db0220075.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with identifier: 117394487
2025-12-02 19:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with scrape type 2
2025-12-02 19:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with scrape type 2
2025-12-02 19:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aee9ea4a-1d35-54dd-ac37-06a67c77e6ec, identifier: 117394487
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117239774, 'registration': 'LL24KHO', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6T Plug-in Hybrid N Line S 5dr 4WD Auto', 'mileage': 20278, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-06-07', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LL24KHO/2025-11-17/image/70265343-d4d1-4e42-9bd0-5e285f918a3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/cab45c43-660d-46dd-a64f-946c07e29725_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/7af3f875-d323-4f5d-b10e-151f8dd02256_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/22771766-6317-4193-a02e-ae5ffc3d6f4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/17f8f48e-6e36-4670-8164-c7bf4e35d01d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/ce0e2db0-a9fe-40e8-8418-3b2b2f08bcb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/2715668c-035d-4137-bf85-3a05ce4c105d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/e7d9885d-c7bf-40ba-a007-315271f935b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/306b8827-3cd1-4e3d-b827-07a73d112b86_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/a48aba6b-f0b0-4813-957c-9f1e994977f7_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/25 9K - 10/25 ??', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/82771c7e-d96b-4fa8-9081-96bdabb4cf33.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117239774, 'registration': 'LL24KHO', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6T Plug-in Hybrid N Line S 5dr 4WD Auto', 'mileage': 20278, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-06-07', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LL24KHO/2025-11-17/image/70265343-d4d1-4e42-9bd0-5e285f918a3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/cab45c43-660d-46dd-a64f-946c07e29725_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/7af3f875-d323-4f5d-b10e-151f8dd02256_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/22771766-6317-4193-a02e-ae5ffc3d6f4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/17f8f48e-6e36-4670-8164-c7bf4e35d01d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/ce0e2db0-a9fe-40e8-8418-3b2b2f08bcb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/2715668c-035d-4137-bf85-3a05ce4c105d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/e7d9885d-c7bf-40ba-a007-315271f935b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/306b8827-3cd1-4e3d-b827-07a73d112b86_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24KHO/2025-11-17/image/a48aba6b-f0b0-4813-957c-9f1e994977f7_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/25 9K - 10/25 ??', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/82771c7e-d96b-4fa8-9081-96bdabb4cf33.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61744950-dad1-5af0-8314-983da8058227 with identifier: 117239774
2025-12-02 19:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61744950-dad1-5af0-8314-983da8058227 with scrape type 2
2025-12-02 19:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61744950-dad1-5af0-8314-983da8058227 with scrape type 2
2025-12-02 19:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 61744950-dad1-5af0-8314-983da8058227, identifier: 117239774
2025-12-02 19:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117360572, 'registration': 'EA22LMF', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto', 'mileage': 37613, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-04-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-05-27', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA22LMF/2025-11-25/image/64d7028f-57ba-41f9-ab78-8c4ca293b44d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/091deb6a-081a-45c0-b663-78520bfc5de3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/5edd55b9-8391-4b7a-815c-90f37d9022b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/ae69f1f2-33a1-4b7b-84d2-66e956a65723_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/35a16fbf-67d3-46e9-9086-9f914d67cc30_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/cc0eab91-5f1b-4f73-b376-2a71ecf9d74a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/abba97c3-044c-4fa7-a26e-1db022543274_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/e8519c3c-fa46-4b6b-855a-350ded7253d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/85b9e472-5d81-415a-a9fc-f89f07f3faf9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/23 19k - 05/25 33k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e0420431-2121-4f42-8eea-19b0982987ed.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117360572, 'registration': 'EA22LMF', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto', 'mileage': 37613, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-04-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-05-27', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA22LMF/2025-11-25/image/64d7028f-57ba-41f9-ab78-8c4ca293b44d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/091deb6a-081a-45c0-b663-78520bfc5de3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/5edd55b9-8391-4b7a-815c-90f37d9022b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/ae69f1f2-33a1-4b7b-84d2-66e956a65723_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/35a16fbf-67d3-46e9-9086-9f914d67cc30_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/cc0eab91-5f1b-4f73-b376-2a71ecf9d74a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/abba97c3-044c-4fa7-a26e-1db022543274_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/e8519c3c-fa46-4b6b-855a-350ded7253d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/85b9e472-5d81-415a-a9fc-f89f07f3faf9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/23 19k - 05/25 33k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e0420431-2121-4f42-8eea-19b0982987ed.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with identifier: 117360572
2025-12-02 19:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with scrape type 2
2025-12-02 19:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with scrape type 2
2025-12-02 19:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1, identifier: 117360572
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117395964, 'registration': 'LT74PGO', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 24771, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-10-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT74PGO/2025-11-21/image/fc78be48-d16a-4b51-ba5f-462c2fc036cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/ba76bcc3-8a4c-43f8-b0f0-616c1d383259_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/5fd5ef5a-fab7-42ae-9738-5351c6cc472f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/e4d68599-532a-4bbe-884f-f4a88f9ac699_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/3873d6cd-5063-4a36-9827-7b9cd03323a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/750b4384-eafe-48a6-9ee1-51482c8077a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/f63042ba-0c73-4d2b-a2ed-e278b8e2b06f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/91017f22-9fea-4e74-b8e8-8a1b002cbc9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/443f35c6-b669-43bb-b5f5-b6a21fc9df5f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bc4c020-64b7-4f9c-a3ba-036ce8ce556e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117395964, 'registration': 'LT74PGO', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 24771, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-10-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT74PGO/2025-11-21/image/fc78be48-d16a-4b51-ba5f-462c2fc036cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/ba76bcc3-8a4c-43f8-b0f0-616c1d383259_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/5fd5ef5a-fab7-42ae-9738-5351c6cc472f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/e4d68599-532a-4bbe-884f-f4a88f9ac699_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/3873d6cd-5063-4a36-9827-7b9cd03323a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/750b4384-eafe-48a6-9ee1-51482c8077a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/f63042ba-0c73-4d2b-a2ed-e278b8e2b06f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/91017f22-9fea-4e74-b8e8-8a1b002cbc9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/443f35c6-b669-43bb-b5f5-b6a21fc9df5f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bc4c020-64b7-4f9c-a3ba-036ce8ce556e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ff7ec9-3cc9-5036-b785-6abff98081d3 with identifier: 117395964
2025-12-02 19:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ff7ec9-3cc9-5036-b785-6abff98081d3 with scrape type 2
2025-12-02 19:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6ff7ec9-3cc9-5036-b785-6abff98081d3 with scrape type 2
2025-12-02 19:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a6ff7ec9-3cc9-5036-b785-6abff98081d3, identifier: 117395964
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117406754, 'registration': 'LB72MJE', 'account': 'MOT071', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '109kW Life Pure 52kWh 5dr Auto', 'mileage': 12018, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-30', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a1d408a1-da06-4902-9169-2e8f8ab616f4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117406754, 'registration': 'LB72MJE', 'account': 'MOT071', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '109kW Life Pure 52kWh 5dr Auto', 'mileage': 12018, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-30', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a1d408a1-da06-4902-9169-2e8f8ab616f4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b54e961e-8138-5db1-80ff-a71013059b82 with identifier: 117406754
2025-12-02 19:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b54e961e-8138-5db1-80ff-a71013059b82 with scrape type 2
2025-12-02 19:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b54e961e-8138-5db1-80ff-a71013059b82 with scrape type 2
2025-12-02 19:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b54e961e-8138-5db1-80ff-a71013059b82, identifier: 117406754
2025-12-02 19:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a83810>
2025-12-02 19:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F368d7df7-4316-4ce0-afc4-63c3cb78e10d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/368d7df7-4316-4ce0-afc4-63c3cb78e10d_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e92ad6a4-aa71-5373-8762-0d685f26e287
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117691830, 'registration': 'WR72DBY', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 GT LINE PURETECH S/S', 'derivative': None, 'mileage': 9788, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2022-10-31', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117691830, 'registration': 'WR72DBY', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 GT LINE PURETECH S/S', 'derivative': None, 'mileage': 9788, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2022-10-31', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57aae93f-49fd-5d40-aa95-c2b6c19d33c5 with identifier: 117691830
2025-12-02 19:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57aae93f-49fd-5d40-aa95-c2b6c19d33c5 with scrape type 1
2025-12-02 19:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 57aae93f-49fd-5d40-aa95-c2b6c19d33c5
2025-12-02 19:08:03 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 57aae93f-49fd-5d40-aa95-c2b6c19d33c5
2025-12-02 19:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 57aae93f-49fd-5d40-aa95-c2b6c19d33c5, identifier: 117691830
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117086159, 'registration': 'EX75XPS', 'account': 'MOT070', 'make': 'FIAT', 'model': '600 HATCHBACK', 'derivative': '1.2 Hybrid 48V 5dr eDCT-6', 'mileage': 1845, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-09-22', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ab8329dd-8848-4112-9e88-af9c4f3875ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cef6c1e8-d17d-442b-85f5-48726819d6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/24b95ed9-aa5b-4219-9107-14ebe5a6a862_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/391d4949-1912-4335-80e5-e4b6c01e37ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/9e78d511-a5d2-4fd7-9087-1653bd1704fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ea09524a-2ee5-4844-b24c-c3eee26fa064_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cc16b2ce-e92a-4f75-b3eb-fcf6091b4188_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/717c3857-ecc0-495c-9106-1f4981935b92_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1743d3ef-0bd3-48bc-aa4c-9f73f0991a5d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117086159, 'registration': 'EX75XPS', 'account': 'MOT070', 'make': 'FIAT', 'model': '600 HATCHBACK', 'derivative': '1.2 Hybrid 48V 5dr eDCT-6', 'mileage': 1845, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-09-22', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ab8329dd-8848-4112-9e88-af9c4f3875ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cef6c1e8-d17d-442b-85f5-48726819d6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/24b95ed9-aa5b-4219-9107-14ebe5a6a862_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/391d4949-1912-4335-80e5-e4b6c01e37ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/9e78d511-a5d2-4fd7-9087-1653bd1704fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ea09524a-2ee5-4844-b24c-c3eee26fa064_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cc16b2ce-e92a-4f75-b3eb-fcf6091b4188_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/717c3857-ecc0-495c-9106-1f4981935b92_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1743d3ef-0bd3-48bc-aa4c-9f73f0991a5d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with identifier: 117086159
2025-12-02 19:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with scrape type 2
2025-12-02 19:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with scrape type 2
2025-12-02 19:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 40fa02b3-6433-5a93-94dd-bccc5a18ed40, identifier: 117086159
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0957810>
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F33167b3d-fc50-4052-8b64-6c7050ac9d45_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/33167b3d-fc50-4052-8b64-6c7050ac9d45_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b7050>
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F6db987c6-adc7-48ec-93a5-218b114f85e7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/6db987c6-adc7-48ec-93a5-218b114f85e7_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf075b9d0>
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F9f87016b-c273-419e-b0f1-b25e4395383e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/9f87016b-c273-419e-b0f1-b25e4395383e_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a80650>
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F44fb9012-7a42-4a38-a9e2-562e942b1652_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/44fb9012-7a42-4a38-a9e2-562e942b1652_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d33dd0>
2025-12-02 19:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252Fdb5a9102-a9d6-4c9b-b088-870805a2152d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/db5a9102-a9d6-4c9b-b088-870805a2152d_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6
2025-12-02 19:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf046ac10>
2025-12-02 19:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F16a69795-4644-40f2-a7eb-e3c3ff5db697_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/16a69795-4644-40f2-a7eb-e3c3ff5db697_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6
2025-12-02 19:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YO69XGK/2025-12-02/image/00a56978-54df-4406-8100-024556cf6197_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660985?view=catalogue)
2025-12-02 19:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with identifier: 117394487
2025-12-02 19:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with identifier: 117394487
2025-12-02 19:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with identifier: 117394487 to the API
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 27,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'aee9ea4a-1d35-54dd-ac37-06a67c77e6ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AP74FTD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117394487',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 16218,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-28',
 'seller_name': 'Motability Operations',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi 241 PHEV GT-Line 5dr Auto AWD',
 'transmission': 'automatic',
 'trim': '1.6T GDi 241 PHEV GT-Line 5dr Auto AWD',
 'vin': None,
 'year': 2025}
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394487%27 HTTP/1.1" 200 None
2025-12-02 19:08:05 [astonbarclay.gb] INFO: Saving data for 117394487: {'auction_closing_time': 1765792800.0, 'created_time': 1764615816.216916, 'last_price_update_time': 1764702485.667052}
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117394487') HTTP/1.1" 204 0
2025-12-02 19:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 61744950-dad1-5af0-8314-983da8058227 with identifier: 117239774
2025-12-02 19:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 61744950-dad1-5af0-8314-983da8058227 with identifier: 117239774
2025-12-02 19:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 61744950-dad1-5af0-8314-983da8058227 with identifier: 117239774 to the API
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117239774?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '61744950-dad1-5af0-8314-983da8058227',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL24KHO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117239774',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 20278,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-07',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI TUCSON ESTATE 1.6T Plug-in Hybrid N Line S 5dr 4WD Auto',
 'transmission': 'automatic',
 'trim': '1.6T Plug-in Hybrid N Line S 5dr 4WD Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117239774%27 HTTP/1.1" 200 None
2025-12-02 19:08:06 [astonbarclay.gb] INFO: Saving data for 117239774: {'auction_closing_time': 1765792800.0, 'created_time': 1763542888.925313, 'last_price_update_time': 1764702486.012474}
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117239774') HTTP/1.1" 204 0
2025-12-02 19:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with identifier: 117360572
2025-12-02 19:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with identifier: 117360572
2025-12-02 19:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with identifier: 117360572 to the API
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA22LMF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117360572',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'ARKANA ESTATE',
 'odometer': 37613,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-20',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT ARKANA ESTATE 1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117360572%27 HTTP/1.1" 200 None
2025-12-02 19:08:06 [astonbarclay.gb] INFO: Saving data for 117360572: {'auction_closing_time': 1765792800.0, 'created_time': 1764615753.077162, 'last_price_update_time': 1764702486.293418}
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117360572') HTTP/1.1" 204 0
2025-12-02 19:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a6ff7ec9-3cc9-5036-b785-6abff98081d3 with identifier: 117395964
2025-12-02 19:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a6ff7ec9-3cc9-5036-b785-6abff98081d3 with identifier: 117395964
2025-12-02 19:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a6ff7ec9-3cc9-5036-b785-6abff98081d3 with identifier: 117395964 to the API
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a6ff7ec9-3cc9-5036-b785-6abff98081d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT74PGO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117395964',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK',
 'odometer': 24771,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-18',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 200 AMG Line Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 200 AMG Line Premium 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117395964%27 HTTP/1.1" 200 None
2025-12-02 19:08:06 [astonbarclay.gb] INFO: Saving data for 117395964: {'auction_closing_time': 1765792800.0, 'created_time': 1764615811.914763, 'last_price_update_time': 1764702486.566961}
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117395964') HTTP/1.1" 204 0
2025-12-02 19:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b54e961e-8138-5db1-80ff-a71013059b82 with identifier: 117406754
2025-12-02 19:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b54e961e-8138-5db1-80ff-a71013059b82 with identifier: 117406754
2025-12-02 19:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 12018, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406754', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '109kw life pure 52kwh 5dr auto', 'license_plate': 'lb72mje', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b54e961e-8138-5db1-80ff-a71013059b82', 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 19341} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': 'b54e961e-8138-5db1-80ff-a71013059b82',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lb72mje',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406754',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate',
     'model': 'id.4 estate',
     'odometer': 12018,
     'odometer_in_km': 19341,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-12-30',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '109kw life pure 52kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: b54e961e-8138-5db1-80ff-a71013059b82 spider: astonbarclay.gb
2025-12-02 19:08:06 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b54e961e-8138-5db1-80ff-a71013059b82 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 12018, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406754', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '109kw life pure 52kwh 5dr auto', 'license_plate': 'lb72mje', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b54e961e-8138-5db1-80ff-a71013059b82', 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 19341} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': 'b54e961e-8138-5db1-80ff-a71013059b82',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lb72mje',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406754',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate',
     'model': 'id.4 estate',
     'odometer': 12018,
     'odometer_in_km': 19341,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-12-30',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '109kw life pure 52kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'b54e961e-8138-5db1-80ff-a71013059b82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LB72MJE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406754',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'ID.4 ESTATE',
 'odometer': 12018,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-30',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN ID.4 ESTATE 109kW Life Pure 52kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '109kW Life Pure 52kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406754%27 HTTP/1.1" 200 None
2025-12-02 19:08:06 [astonbarclay.gb] INFO: Saving data for 117406754: {'auction_closing_time': 1765792800.0, 'created_time': 1764615756.267644, 'last_price_update_time': 1764702486.779251}
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117406754') HTTP/1.1" 204 0
2025-12-02 19:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 57aae93f-49fd-5d40-aa95-c2b6c19d33c5 with identifier: 117691830
2025-12-02 19:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 57aae93f-49fd-5d40-aa95-c2b6c19d33c5 with identifier: 117691830
2025-12-02 19:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 57aae93f-49fd-5d40-aa95-c2b6c19d33c5 with identifier: 117691830 to the API
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:08:07 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 57aae93f-49fd-5d40-aa95-c2b6c19d33c5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"Trim","ErrorMessage":"car trim can\u0027t be null","ErrorCode":0}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:08:06 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117691830?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '57aae93f-49fd-5d40-aa95-c2b6c19d33c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WR72DBY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117691830',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'PEUGEOT',
 'model': '3008 GT LINE PURETECH S/S',
 'odometer': 9788,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 3008 GT LINE PURETECH S/S None',
 'transmission': 'manual',
 'trim': None,
 'vin': None,
 'year': 2022}
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117691830%27 HTTP/1.1" 200 None
2025-12-02 19:08:07 [astonbarclay.gb] INFO: Saving data for 117691830: {'created_time': 1764702487.061176, 'last_price_update_time': 1764702487.061186}
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117691830') HTTP/1.1" 204 0
2025-12-02 19:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with identifier: 117086159
2025-12-02 19:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with identifier: 117086159
2025-12-02 19:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with identifier: 117086159 to the API
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117086159?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '40fa02b3-6433-5a93-94dd-bccc5a18ed40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EX75XPS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117086159',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FIAT',
 'model': '600 HATCHBACK',
 'odometer': 1845,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-09-22',
 'seller_name': 'Motability Operations',
 'title': 'FIAT 600 HATCHBACK 1.2 Hybrid 48V 5dr eDCT-6',
 'transmission': 'automatic',
 'trim': '1.2 Hybrid 48V 5dr eDCT-6',
 'vin': None,
 'year': 2025}
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117086159%27 HTTP/1.1" 200 None
2025-12-02 19:08:07 [astonbarclay.gb] INFO: Saving data for 117086159: {'auction_closing_time': 1765792800.0, 'created_time': 1764615755.109705, 'last_price_update_time': 1764702487.393123}
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117086159') HTTP/1.1" 204 0
2025-12-02 19:08:07 [scrapy.extensions.logstats] INFO: Crawled 385 pages (at 48 pages/min), scraped 250 items (at 37 items/min)
2025-12-02 19:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO67NXP/2025-12-02/image/fd33ef5b-530d-4ce0-8fc1-4ff81adae70d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117681164?view=catalogue)
2025-12-02 19:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YO69XGK/2025-12-02/image/2bf70190-3b6a-480a-8384-8f5cb171bea5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117660985?view=catalogue)
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066da50>
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252Faf24107d-a2c2-4b73-bd97-6a85cebadcc1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/af24107d-a2c2-4b73-bd97-6a85cebadcc1_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf091f890>
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F4d5e73a3-c5f9-4ed4-aabb-75c8b6fe7995_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/4d5e73a3-c5f9-4ed4-aabb-75c8b6fe7995_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e92ad6a4-aa71-5373-8762-0d685f26e287
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066cfd0>
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252F11ddaa2a-6de3-495b-b054-be039973a3e0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/11ddaa2a-6de3-495b-b054-be039973a3e0_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf037a210>
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F5bf41d31-20a7-4039-b3f6-d856c4acfe1d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/5bf41d31-20a7-4039-b3f6-d856c4acfe1d_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e92ad6a4-aa71-5373-8762-0d685f26e287
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf054b750>
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F3ce9a017-d72a-4354-b5ed-7c6ff78386c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/3ce9a017-d72a-4354-b5ed-7c6ff78386c2_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e92ad6a4-aa71-5373-8762-0d685f26e287
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf3644c10>
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F6863ee1b-d9f4-4e49-a0b6-2481292b981c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/6863ee1b-d9f4-4e49-a0b6-2481292b981c_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e92ad6a4-aa71-5373-8762-0d685f26e287
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0999ed0>
2025-12-02 19:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F00a56978-54df-4406-8100-024556cf6197_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/00a56978-54df-4406-8100-024556cf6197_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e92ad6a4-aa71-5373-8762-0d685f26e287
2025-12-02 19:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116412555?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116258586?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116420630?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117460295?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116013920?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116188432?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0830f90>
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO67NXP%252F2025-12-02%252Fimage%252Ffd33ef5b-530d-4ce0-8fc1-4ff81adae70d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO67NXP/2025-12-02/image/fd33ef5b-530d-4ce0-8fc1-4ff81adae70d_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6
2025-12-02 19:08:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf6a60e6-eef3-5b2a-a84a-a51967d21dd6, skipping ID generation
2025-12-02 19:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6 with scrape type 1
2025-12-02 19:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6 from tracking dictionaries
2025-12-02 19:08:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf6a60e6-eef3-5b2a-a84a-a51967d21dd6 sending to next pipeline
2025-12-02 19:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cf6a60e6-eef3-5b2a-a84a-a51967d21dd6, identifier: 117681164
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a7e0d0>
2025-12-02 19:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYO69XGK%252F2025-12-02%252Fimage%252F2bf70190-3b6a-480a-8384-8f5cb171bea5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YO69XGK/2025-12-02/image/2bf70190-3b6a-480a-8384-8f5cb171bea5_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e92ad6a4-aa71-5373-8762-0d685f26e287
2025-12-02 19:08:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e92ad6a4-aa71-5373-8762-0d685f26e287, skipping ID generation
2025-12-02 19:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e92ad6a4-aa71-5373-8762-0d685f26e287 with scrape type 1
2025-12-02 19:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e92ad6a4-aa71-5373-8762-0d685f26e287 from tracking dictionaries
2025-12-02 19:08:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e92ad6a4-aa71-5373-8762-0d685f26e287 sending to next pipeline
2025-12-02 19:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e92ad6a4-aa71-5373-8762-0d685f26e287, identifier: 117660985
2025-12-02 19:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cf6a60e6-eef3-5b2a-a84a-a51967d21dd6 with identifier: 117681164
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GOLD HTTP/1.1" 200 None
2025-12-02 19:08:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 19:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cf6a60e6-eef3-5b2a-a84a-a51967d21dd6 with identifier: 117681164
2025-12-02 19:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cf6a60e6-eef3-5b2a-a84a-a51967d21dd6 with identifier: 117681164 to the API
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/VO67NXP/2025-12-02/image/fd33ef5b-530d-4ce0-8fc1-4ff81adae70d_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'GOLD',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'cf6a60e6-eef3-5b2a-a84a-a51967d21dd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VO67NXP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117681164',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF SV HATCHBACK',
 'odometer': 67221,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35904,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/fd33ef5b-530d-4ce0-8fc1-4ff81adae70d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36557,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/11ddaa2a-6de3-495b-b054-be039973a3e0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41373,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/af24107d-a2c2-4b73-bd97-6a85cebadcc1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37826,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/16a69795-4644-40f2-a7eb-e3c3ff5db697_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49628,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/db5a9102-a9d6-4c9b-b088-870805a2152d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51554,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/44fb9012-7a42-4a38-a9e2-562e942b1652_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42364,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/9f87016b-c273-419e-b0f1-b25e4395383e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54896,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/6db987c6-adc7-48ec-93a5-218b114f85e7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6a60e6-eef3-5b2a-a84a-a51967d21dd6/cf6a60e6-eef3-5b2a-a84a-a51967d21dd6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54873,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO67NXP/2025-12-02/image/33167b3d-fc50-4052-8b64-6c7050ac9d45_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-08',
 'seller_name': 'UKCGR',
 'title': 'VOLKSWAGEN GOLF SV HATCHBACK 1.4 TSI SE 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI SE 5dr DSG',
 'vin': None,
 'year': 2017}
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681164%27 HTTP/1.1" 200 None
2025-12-02 19:08:10 [astonbarclay.gb] INFO: Saving data for 117681164: {'created_time': 1764702490.650435, 'last_price_update_time': 1764702490.650444}
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117681164') HTTP/1.1" 204 0
2025-12-02 19:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e92ad6a4-aa71-5373-8762-0d685f26e287 with identifier: 117660985
2025-12-02 19:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e92ad6a4-aa71-5373-8762-0d685f26e287 with identifier: 117660985
2025-12-02 19:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e92ad6a4-aa71-5373-8762-0d685f26e287 with identifier: 117660985 to the API
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YO69XGK/2025-12-02/image/2bf70190-3b6a-480a-8384-8f5cb171bea5_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'e92ad6a4-aa71-5373-8762-0d685f26e287',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YO69XGK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117660985',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 41305,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29371,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/4d5e73a3-c5f9-4ed4-aabb-75c8b6fe7995_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30690,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/05f3b110-31d9-4384-b1a4-6c5feb9b598f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26690,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/5bf41d31-20a7-4039-b3f6-d856c4acfe1d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26623,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/6863ee1b-d9f4-4e49-a0b6-2481292b981c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47055,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/eb7bcb63-347e-4279-910c-a007c504b0eb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96075,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/00a56978-54df-4406-8100-024556cf6197_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89494,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/2bf70190-3b6a-480a-8384-8f5cb171bea5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48031,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/3ce9a017-d72a-4354-b5ed-7c6ff78386c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92ad6a4-aa71-5373-8762-0d685f26e287/e92ad6a4-aa71-5373-8762-0d685f26e287_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35162,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YO69XGK/2025-12-02/image/368d7df7-4316-4ce0-afc4-63c3cb78e10d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-25',
 'seller_name': 'UKCGR',
 'title': 'FORD KUGA ESTATE 1.5 EcoBoost ST-Line 5dr Auto 2WD',
 'transmission': 'automatic',
 'trim': '1.5 EcoBoost ST-Line 5dr Auto 2WD',
 'vin': None,
 'year': 2019}
2025-12-02 19:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660985%27 HTTP/1.1" 200 None
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Saving data for 117660985: {'created_time': 1764702491.047387, 'last_price_update_time': 1764702491.047398}
2025-12-02 19:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117660985') HTTP/1.1" 204 0
2025-12-02 19:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117581450?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116412555, 'registration': 'GF74DHA', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 6701, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-10-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF74DHA/2025-10-21/image/f0e6eaeb-312b-4434-91b5-f54114fde662_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/965e4f6b-f875-4e5b-be5f-af9bf7fc8bf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/2affd71c-13d5-47ad-9ff1-fdd5f494ba06_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/cdb21cfa-e1d8-4210-ab2f-14b1a490cc64_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/a18c943f-b7f9-4425-921c-0dbb1ee8389f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/f79d7e5f-d5fa-44db-b877-d4df06d2a38a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/c7fcde37-3809-40de-bc00-0717a5420330_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/2308e294-eea5-43b3-91c8-889c4fb236cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/a026724c-449b-43df-9093-b0c985d086eb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - V5 Document Reference Number Available Upon Purchase"', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1a16579e-6d8a-4b48-b20f-5ab64d366f19.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116412555, 'registration': 'GF74DHA', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 6701, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-10-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF74DHA/2025-10-21/image/f0e6eaeb-312b-4434-91b5-f54114fde662_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/965e4f6b-f875-4e5b-be5f-af9bf7fc8bf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/2affd71c-13d5-47ad-9ff1-fdd5f494ba06_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/cdb21cfa-e1d8-4210-ab2f-14b1a490cc64_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/a18c943f-b7f9-4425-921c-0dbb1ee8389f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/f79d7e5f-d5fa-44db-b877-d4df06d2a38a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/c7fcde37-3809-40de-bc00-0717a5420330_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/2308e294-eea5-43b3-91c8-889c4fb236cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF74DHA/2025-10-21/image/a026724c-449b-43df-9093-b0c985d086eb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - V5 Document Reference Number Available Upon Purchase"', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1a16579e-6d8a-4b48-b20f-5ab64d366f19.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3532cde6-e0cb-5788-b10c-798d2a2562ef with identifier: 116412555
2025-12-02 19:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3532cde6-e0cb-5788-b10c-798d2a2562ef with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3532cde6-e0cb-5788-b10c-798d2a2562ef with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3532cde6-e0cb-5788-b10c-798d2a2562ef, identifier: 116412555
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116258586, 'registration': 'LL74ZTP', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH N-Connecta 5dr', 'mileage': 10496, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-12-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/3e80401d-5b30-4e28-9e7d-622daf2a4837_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/5d5347ee-42ef-4b7d-b649-a30e14413f93_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/58afb96b-3d2b-4e7c-99e1-6dbad4b19263_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/5464fbfc-b7ef-4330-bf19-3e8b40335a1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/4168ebb9-cc54-48b9-8a7a-e010d57e1adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/77d912d0-5c17-47cb-b890-3575e0e519b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/36d03a01-acb7-4d6f-bec5-50e02eeb27ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/508ff39c-d447-441e-9a41-9d01c0cab952_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a9ff96bc-b9b0-493d-95b6-476b34dec0ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116258586, 'registration': 'LL74ZTP', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH N-Connecta 5dr', 'mileage': 10496, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-12-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/3e80401d-5b30-4e28-9e7d-622daf2a4837_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/5d5347ee-42ef-4b7d-b649-a30e14413f93_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/58afb96b-3d2b-4e7c-99e1-6dbad4b19263_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/5464fbfc-b7ef-4330-bf19-3e8b40335a1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/4168ebb9-cc54-48b9-8a7a-e010d57e1adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/77d912d0-5c17-47cb-b890-3575e0e519b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/36d03a01-acb7-4d6f-bec5-50e02eeb27ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/508ff39c-d447-441e-9a41-9d01c0cab952_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a9ff96bc-b9b0-493d-95b6-476b34dec0ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bbb4108-9119-5dcf-a063-7c20f6cad248 with identifier: 116258586
2025-12-02 19:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bbb4108-9119-5dcf-a063-7c20f6cad248 with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bbb4108-9119-5dcf-a063-7c20f6cad248 with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0bbb4108-9119-5dcf-a063-7c20f6cad248, identifier: 116258586
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116420630, 'registration': 'EF74LNO', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'MEGANE E-TECH HATCHBACK', 'derivative': 'EV60 160kW Techno Comfort Range 60kWh 5dr Auto', 'mileage': 15301, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-16', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF74LNO/2025-10-21/image/5ed88015-16d7-4b4c-9b10-4a1e6ee96397_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/4dd3186b-e918-4bf6-a096-32f63cf93d0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/712c6ec1-ddf6-4423-81ae-cf4e0b6afad3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/fabd6529-7149-40d6-95eb-0b2dcbc94285_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/b300d978-344b-48d6-b6a9-6f094282035c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/3691f9b3-a449-4630-b847-44eaa2686d57_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/bd3dc7b3-5be4-46a9-8ac9-d570b648c609_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/5779beca-ad8f-4522-84d7-73846e9a6d00_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/aa717b55-96b6-457e-b603-b16d99205c23_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40ed33e5-0f09-45b1-b601-6318482a1037.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116420630, 'registration': 'EF74LNO', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'MEGANE E-TECH HATCHBACK', 'derivative': 'EV60 160kW Techno Comfort Range 60kWh 5dr Auto', 'mileage': 15301, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-16', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF74LNO/2025-10-21/image/5ed88015-16d7-4b4c-9b10-4a1e6ee96397_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/4dd3186b-e918-4bf6-a096-32f63cf93d0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/712c6ec1-ddf6-4423-81ae-cf4e0b6afad3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/fabd6529-7149-40d6-95eb-0b2dcbc94285_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/b300d978-344b-48d6-b6a9-6f094282035c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/3691f9b3-a449-4630-b847-44eaa2686d57_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/bd3dc7b3-5be4-46a9-8ac9-d570b648c609_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/5779beca-ad8f-4522-84d7-73846e9a6d00_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74LNO/2025-10-21/image/aa717b55-96b6-457e-b603-b16d99205c23_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40ed33e5-0f09-45b1-b601-6318482a1037.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 253a3ffd-1fcb-5b89-b385-7c2671581ead with identifier: 116420630
2025-12-02 19:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 253a3ffd-1fcb-5b89-b385-7c2671581ead with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 253a3ffd-1fcb-5b89-b385-7c2671581ead with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 253a3ffd-1fcb-5b89-b385-7c2671581ead, identifier: 116420630
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117460295, 'registration': 'EN22FTY', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Ultimate 5dr 2WD', 'mileage': 52371, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-07-26', 'fuel': 'Petrol', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EN22FTY/2025-11-25/image/b16d4a74-acd0-4313-a4f0-9585793a16b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/953b0b66-b3d0-43d8-be64-e0f309a66705_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/b54cec96-fdba-4583-a081-14e619ba5016_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/4a18edaf-916c-4510-b614-98369bc8e879_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/9f9f89fc-667b-4d3f-a8e3-8af754182fa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/f38ee506-b208-42d2-86be-c5cc64f8ce0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/ffd94651-79a3-4586-85e0-c6ea67b33f3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/73268ece-a8d6-4ffe-a865-277184b6866c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/2aa72dbd-89cd-41f1-b8b9-1aeddac2c084_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/4fc72216-a47b-472c-b2ef-9dc166dd7389_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 04/23 13K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 50K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1cc7763c-b676-49c8-932a-8e79cb1865bb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117460295, 'registration': 'EN22FTY', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Ultimate 5dr 2WD', 'mileage': 52371, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-07-26', 'fuel': 'Petrol', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EN22FTY/2025-11-25/image/b16d4a74-acd0-4313-a4f0-9585793a16b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/953b0b66-b3d0-43d8-be64-e0f309a66705_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/b54cec96-fdba-4583-a081-14e619ba5016_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/4a18edaf-916c-4510-b614-98369bc8e879_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/9f9f89fc-667b-4d3f-a8e3-8af754182fa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/f38ee506-b208-42d2-86be-c5cc64f8ce0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/ffd94651-79a3-4586-85e0-c6ea67b33f3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/73268ece-a8d6-4ffe-a865-277184b6866c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/2aa72dbd-89cd-41f1-b8b9-1aeddac2c084_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22FTY/2025-11-25/image/4fc72216-a47b-472c-b2ef-9dc166dd7389_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 04/23 13K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 50K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1cc7763c-b676-49c8-932a-8e79cb1865bb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b03bf31-1b37-57a4-8d11-2cdd54d8b54e with identifier: 117460295
2025-12-02 19:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b03bf31-1b37-57a4-8d11-2cdd54d8b54e with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b03bf31-1b37-57a4-8d11-2cdd54d8b54e with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4b03bf31-1b37-57a4-8d11-2cdd54d8b54e, identifier: 117460295
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117023136, 'registration': 'LY74DXW', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 2143, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY74DXW/2025-11-10/image/df9ad979-7c37-4b10-92f0-fe7e54c7045c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ec2f2cf0-02c5-4798-90dc-ab567ad265db_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/56739470-ba08-4f64-985d-cec7b10b6ed0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/4977023c-527b-4d14-9124-770879b828a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/53d10d18-a2e9-4433-9d71-d104163cd4c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ce74b827-ea4f-4c56-965e-aa8d2f11a5f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/6cfe5c9f-f441-42a1-8969-c3b953eefa2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/e5867b0b-c2c6-4b63-8993-f59574ebccd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/eca87a04-82a3-4493-87ff-0fe616ed978e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad9d285a-09c0-4ef1-a29f-1cd99517e26e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117023136, 'registration': 'LY74DXW', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 2143, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY74DXW/2025-11-10/image/df9ad979-7c37-4b10-92f0-fe7e54c7045c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ec2f2cf0-02c5-4798-90dc-ab567ad265db_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/56739470-ba08-4f64-985d-cec7b10b6ed0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/4977023c-527b-4d14-9124-770879b828a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/53d10d18-a2e9-4433-9d71-d104163cd4c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ce74b827-ea4f-4c56-965e-aa8d2f11a5f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/6cfe5c9f-f441-42a1-8969-c3b953eefa2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/e5867b0b-c2c6-4b63-8993-f59574ebccd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/eca87a04-82a3-4493-87ff-0fe616ed978e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad9d285a-09c0-4ef1-a29f-1cd99517e26e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with identifier: 117023136
2025-12-02 19:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cc3d0ce7-7a35-5a36-9894-7cc131d3a49b, identifier: 117023136
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116013920, 'registration': 'LJ74HUH', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 5761, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-11-29', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/c0065550-735e-47b3-b62e-2019f8aacb53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/624aadb1-de94-40cf-9a53-ee2dbab5e0f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/c099eefe-0dd9-411b-a2ff-842ad07949e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/e3f038b2-fc34-4c23-9a16-1f9eae6a3322_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/6a05dd7d-4622-40ae-a51e-4a1ee2cdcfe5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/6f247ab0-9ac5-45ef-8b70-b92db35525d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/89bbaa13-11ba-4d86-856e-4fabc8ec758b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/24dc8c02-a23c-460b-973c-cfceefe4bd20_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/51cb5a2a-ffe6-436d-b14d-25ab16159678_removebg.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fb2cc56f-94ab-4eb5-bb16-db167be208ea.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116013920, 'registration': 'LJ74HUH', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 5761, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-11-29', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/c0065550-735e-47b3-b62e-2019f8aacb53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/624aadb1-de94-40cf-9a53-ee2dbab5e0f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/c099eefe-0dd9-411b-a2ff-842ad07949e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/e3f038b2-fc34-4c23-9a16-1f9eae6a3322_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/6a05dd7d-4622-40ae-a51e-4a1ee2cdcfe5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/6f247ab0-9ac5-45ef-8b70-b92db35525d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/89bbaa13-11ba-4d86-856e-4fabc8ec758b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/24dc8c02-a23c-460b-973c-cfceefe4bd20_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74HUH/2025-10-02/image/51cb5a2a-ffe6-436d-b14d-25ab16159678_removebg.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fb2cc56f-94ab-4eb5-bb16-db167be208ea.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e8e69a0-d3da-5161-9e84-bba707a2b898 with identifier: 116013920
2025-12-02 19:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e8e69a0-d3da-5161-9e84-bba707a2b898 with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e8e69a0-d3da-5161-9e84-bba707a2b898 with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7e8e69a0-d3da-5161-9e84-bba707a2b898, identifier: 116013920
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116188432, 'registration': 'OV25UVS', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr', 'mileage': 12573, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-03-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OV25UVS/2025-10-08/image/e1d1b789-3464-44b1-9771-d3b215232f7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/c72fc554-9019-4835-82bd-ffa3f13d5c24_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/037edc62-a6a7-4646-a1cb-eaa90ec3e3ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/b64a53c7-c62f-4bbb-bb24-014dcd804e51_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/06ac3904-509d-4507-bbaa-315f1d797038_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/e2fb4ecf-ff70-4fb9-9f17-160f8d5ac0fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/11823db3-2fb6-4114-b852-a0053d8ce2fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/5878528f-aebf-4b66-a864-c92349ed3a8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/e69b1620-b22f-4887-9094-3c3cb7fb8f7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/ff51d0f7-e074-4ca6-8171-ea6c0298100c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/b27eb97b-3090-49ec-b3c6-67fd280bfbfa_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f8586878-8d70-4122-bb32-4c1e867b8662.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116188432, 'registration': 'OV25UVS', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr', 'mileage': 12573, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-03-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OV25UVS/2025-10-08/image/e1d1b789-3464-44b1-9771-d3b215232f7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/c72fc554-9019-4835-82bd-ffa3f13d5c24_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/037edc62-a6a7-4646-a1cb-eaa90ec3e3ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/b64a53c7-c62f-4bbb-bb24-014dcd804e51_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/06ac3904-509d-4507-bbaa-315f1d797038_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/e2fb4ecf-ff70-4fb9-9f17-160f8d5ac0fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/11823db3-2fb6-4114-b852-a0053d8ce2fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/5878528f-aebf-4b66-a864-c92349ed3a8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/e69b1620-b22f-4887-9094-3c3cb7fb8f7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/ff51d0f7-e074-4ca6-8171-ea6c0298100c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV25UVS/2025-10-08/image/b27eb97b-3090-49ec-b3c6-67fd280bfbfa_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f8586878-8d70-4122-bb32-4c1e867b8662.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bf5f6f4-5c0c-5ad4-891b-ba282cbefc5d with identifier: 116188432
2025-12-02 19:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf5f6f4-5c0c-5ad4-891b-ba282cbefc5d with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bf5f6f4-5c0c-5ad4-891b-ba282cbefc5d with scrape type 2
2025-12-02 19:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8bf5f6f4-5c0c-5ad4-891b-ba282cbefc5d, identifier: 116188432
2025-12-02 19:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3532cde6-e0cb-5788-b10c-798d2a2562ef with identifier: 116412555
2025-12-02 19:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3532cde6-e0cb-5788-b10c-798d2a2562ef with identifier: 116412555
2025-12-02 19:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3532cde6-e0cb-5788-b10c-798d2a2562ef with identifier: 116412555 to the API
2025-12-02 19:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116412555?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3532cde6-e0cb-5788-b10c-798d2a2562ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GF74DHA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116412555',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'AVENGER HATCHBACK',
 'odometer': 6701,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-25',
 'seller_name': 'Motability Operations',
 'title': 'JEEP AVENGER HATCHBACK 1.2 e-Hybrid Summit 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.2 e-Hybrid Summit 5dr DCT',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116412555%27 HTTP/1.1" 200 None
2025-12-02 19:08:12 [astonbarclay.gb] INFO: Saving data for 116412555: {'auction_closing_time': 1765792800.0, 'created_time': 1764184023.8459, 'last_price_update_time': 1764702492.001813}
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116412555') HTTP/1.1" 204 0
2025-12-02 19:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0bbb4108-9119-5dcf-a063-7c20f6cad248 with identifier: 116258586
2025-12-02 19:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0bbb4108-9119-5dcf-a063-7c20f6cad248 with identifier: 116258586
2025-12-02 19:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0bbb4108-9119-5dcf-a063-7c20f6cad248 with identifier: 116258586 to the API
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116258586?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0bbb4108-9119-5dcf-a063-7c20f6cad248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL74ZTP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116258586',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 10496,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-19',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH N-Connecta 5dr',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116258586%27 HTTP/1.1" 200 None
2025-12-02 19:08:12 [astonbarclay.gb] INFO: Saving data for 116258586: {'auction_closing_time': 1765792800.0, 'created_time': 1761160143.995101, 'last_price_update_time': 1764702492.308208}
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116258586') HTTP/1.1" 204 0
2025-12-02 19:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 253a3ffd-1fcb-5b89-b385-7c2671581ead with identifier: 116420630
2025-12-02 19:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 253a3ffd-1fcb-5b89-b385-7c2671581ead with identifier: 116420630
2025-12-02 19:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'renault megane e-tech hatchback ev60 160kw techno comfort range 60kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'megane e-tech hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15301, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-16', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116420630', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': 'ev60 160kw techno comfort range 60kwh 5dr auto', 'license_plate': 'ef74lno', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '253a3ffd-1fcb-5b89-b385-7c2671581ead', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'renault megane e-tech hatchback', 'sanitized_make': 'renault', 'odometer_in_km': 24624} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '253a3ffd-1fcb-5b89-b385-7c2671581ead',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ef74lno',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116420630',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'renault',
     'make_model': 'renault megane e-tech hatchback',
     'model': 'megane e-tech hatchback',
     'odometer': 15301,
     'odometer_in_km': 24624,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-16',
     'sanitized_make': 'renault',
     'seller_name': 'motability operations',
     'title': 'renault megane e-tech hatchback ev60 160kw techno comfort '
              'range 60kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'ev60 160kw techno comfort range 60kwh 5dr auto',
     'vin': None,
     'year': 2024}
2025-12-02 19:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 253a3ffd-1fcb-5b89-b385-7c2671581ead spider: astonbarclay.gb
2025-12-02 19:08:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 253a3ffd-1fcb-5b89-b385-7c2671581ead due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'renault megane e-tech hatchback ev60 160kw techno comfort range 60kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'megane e-tech hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15301, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-16', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116420630', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': 'ev60 160kw techno comfort range 60kwh 5dr auto', 'license_plate': 'ef74lno', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '253a3ffd-1fcb-5b89-b385-7c2671581ead', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'renault megane e-tech hatchback', 'sanitized_make': 'renault', 'odometer_in_km': 24624} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '253a3ffd-1fcb-5b89-b385-7c2671581ead',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ef74lno',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116420630',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'renault',
     'make_model': 'renault megane e-tech hatchback',
     'model': 'megane e-tech hatchback',
     'odometer': 15301,
     'odometer_in_km': 24624,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-16',
     'sanitized_make': 'renault',
     'seller_name': 'motability operations',
     'title': 'renault megane e-tech hatchback ev60 160kw techno comfort '
              'range 60kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'ev60 160kw techno comfort range 60kwh 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '253a3ffd-1fcb-5b89-b385-7c2671581ead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EF74LNO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116420630',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'MEGANE E-TECH HATCHBACK',
 'odometer': 15301,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-16',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT MEGANE E-TECH HATCHBACK EV60 160kW Techno Comfort Range '
          '60kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EV60 160kW Techno Comfort Range 60kWh 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116420630%27 HTTP/1.1" 200 None
2025-12-02 19:08:12 [astonbarclay.gb] INFO: Saving data for 116420630: {'auction_closing_time': 1765792800.0, 'created_time': 1764356658.136355, 'last_price_update_time': 1764702492.554878}
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116420630') HTTP/1.1" 204 0
2025-12-02 19:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4b03bf31-1b37-57a4-8d11-2cdd54d8b54e with identifier: 117460295
2025-12-02 19:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4b03bf31-1b37-57a4-8d11-2cdd54d8b54e with identifier: 117460295
2025-12-02 19:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4b03bf31-1b37-57a4-8d11-2cdd54d8b54e with identifier: 117460295 to the API
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117460295?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4b03bf31-1b37-57a4-8d11-2cdd54d8b54e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN22FTY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117460295',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 52371,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi Ultimate 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 TGDi Ultimate 5dr 2WD',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117460295%27 HTTP/1.1" 200 None
2025-12-02 19:08:12 [astonbarclay.gb] INFO: Saving data for 117460295: {'auction_closing_time': 1765792800.0, 'created_time': 1764579729.054484, 'last_price_update_time': 1764702492.849504}
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117460295') HTTP/1.1" 204 0
2025-12-02 19:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with identifier: 117023136
2025-12-02 19:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with identifier: 117023136
2025-12-02 19:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with identifier: 117023136 to the API
2025-12-02 19:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cc3d0ce7-7a35-5a36-9894-7cc131d3a49b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LY74DXW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117023136',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'AVENGER HATCHBACK',
 'odometer': 2143,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-12',
 'seller_name': 'Motability Operations',
 'title': 'JEEP AVENGER HATCHBACK 1.2 e-Hybrid Summit 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.2 e-Hybrid Summit 5dr DCT',
 'vin': None,
 'year': 2025}
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023136%27 HTTP/1.1" 200 None
2025-12-02 19:08:13 [astonbarclay.gb] INFO: Saving data for 117023136: {'auction_closing_time': 1765792800.0, 'created_time': 1764615764.281568, 'last_price_update_time': 1764702493.129011}
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117023136') HTTP/1.1" 204 0
2025-12-02 19:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7e8e69a0-d3da-5161-9e84-bba707a2b898 with identifier: 116013920
2025-12-02 19:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7e8e69a0-d3da-5161-9e84-bba707a2b898 with identifier: 116013920
2025-12-02 19:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7e8e69a0-d3da-5161-9e84-bba707a2b898 with identifier: 116013920 to the API
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116013920?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': '7e8e69a0-d3da-5161-9e84-bba707a2b898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LJ74HUH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116013920',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'AVENGER HATCHBACK',
 'odometer': 5761,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-29',
 'seller_name': 'Motability Operations',
 'title': 'JEEP AVENGER HATCHBACK 1.2 e-Hybrid Summit 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.2 e-Hybrid Summit 5dr DCT',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116013920%27 HTTP/1.1" 200 None
2025-12-02 19:08:13 [astonbarclay.gb] INFO: Saving data for 116013920: {'auction_closing_time': 1765792800.0, 'created_time': 1764356663.019002, 'last_price_update_time': 1764702493.406115}
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116013920') HTTP/1.1" 204 0
2025-12-02 19:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8bf5f6f4-5c0c-5ad4-891b-ba282cbefc5d with identifier: 116188432
2025-12-02 19:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8bf5f6f4-5c0c-5ad4-891b-ba282cbefc5d with identifier: 116188432
2025-12-02 19:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8bf5f6f4-5c0c-5ad4-891b-ba282cbefc5d with identifier: 116188432 to the API
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116188432?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8bf5f6f4-5c0c-5ad4-891b-ba282cbefc5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OV25UVS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116188432',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK',
 'odometer': 12573,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-24',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL CORSA HATCHBACK 1.2 Turbo Ultimate 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo Ultimate 5dr',
 'vin': None,
 'year': 2025}
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116188432%27 HTTP/1.1" 200 None
2025-12-02 19:08:13 [astonbarclay.gb] INFO: Saving data for 116188432: {'auction_closing_time': 1765792800.0, 'created_time': 1764356662.506932, 'last_price_update_time': 1764702493.683039}
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116188432') HTTP/1.1" 204 0
2025-12-02 19:08:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117581450, 'registration': 'EK72XTT', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr DCT', 'mileage': 23748, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-26', 'fuel': 'Petrol', 'motExpiry': '2026-08-07', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK72XTT/2025-11-28/image/10b5849d-2021-4707-b022-6652bb7d2b4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/ae465af3-fc67-4243-b7e3-b537835331a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/01c5863c-d108-4830-85fb-0316ebc91926_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/c228cca8-ce38-49c1-a09b-614517816138_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/02264ae3-f5b8-41b9-8ecc-4de94e37d359_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/c1f3d22f-bdf5-4d64-a981-b0e8e17773bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/c2f3e100-0fba-42db-89d3-9e18ae3ef644_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/d079f6a8-4d7f-48bb-8063-fe22affeecca_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/f82a1639-2d06-47fe-b515-ee87827f403b_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23 8K - 11/24 15K-', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fab1ae11-3415-49c1-9605-da1df0fc7807.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117581450, 'registration': 'EK72XTT', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr DCT', 'mileage': 23748, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-26', 'fuel': 'Petrol', 'motExpiry': '2026-08-07', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK72XTT/2025-11-28/image/10b5849d-2021-4707-b022-6652bb7d2b4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/ae465af3-fc67-4243-b7e3-b537835331a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/01c5863c-d108-4830-85fb-0316ebc91926_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/c228cca8-ce38-49c1-a09b-614517816138_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/02264ae3-f5b8-41b9-8ecc-4de94e37d359_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/c1f3d22f-bdf5-4d64-a981-b0e8e17773bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/c2f3e100-0fba-42db-89d3-9e18ae3ef644_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/d079f6a8-4d7f-48bb-8063-fe22affeecca_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72XTT/2025-11-28/image/f82a1639-2d06-47fe-b515-ee87827f403b_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23 8K - 11/24 15K-', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fab1ae11-3415-49c1-9605-da1df0fc7807.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba6334ba-9d4f-5b81-8ac0-d54605d57bed with identifier: 117581450
2025-12-02 19:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba6334ba-9d4f-5b81-8ac0-d54605d57bed with scrape type 2
2025-12-02 19:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba6334ba-9d4f-5b81-8ac0-d54605d57bed with scrape type 2
2025-12-02 19:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ba6334ba-9d4f-5b81-8ac0-d54605d57bed, identifier: 117581450
2025-12-02 19:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ba6334ba-9d4f-5b81-8ac0-d54605d57bed with identifier: 117581450
2025-12-02 19:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ba6334ba-9d4f-5b81-8ac0-d54605d57bed with identifier: 117581450
2025-12-02 19:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ba6334ba-9d4f-5b81-8ac0-d54605d57bed with identifier: 117581450 to the API
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117581450?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ba6334ba-9d4f-5b81-8ac0-d54605d57bed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK72XTT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117581450',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 23748,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-26',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Exclusive 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.5 T-GDI Exclusive 5dr DCT',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581450%27 HTTP/1.1" 200 None
2025-12-02 19:08:14 [astonbarclay.gb] INFO: Saving data for 117581450: {'auction_closing_time': 1765792800.0, 'created_time': 1764356706.057459, 'last_price_update_time': 1764702494.089534}
2025-12-02 19:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117581450') HTTP/1.1" 204 0
2025-12-02 19:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116752111?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117591412?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115990741?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116798984?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116752111, 'registration': 'EO25PPV', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'I20 HATCHBACK', 'derivative': '1.0T GDi Premium 5dr', 'mileage': 5232, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-06-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO25PPV/2025-11-25/image/6994241a-e96a-4613-8ffc-bcebeefbd376_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/253bc434-57a4-449b-83f0-3c1251ccde0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/bfd3624b-d63b-4c03-b5f8-f7d28c7388ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/8d8aaadb-43a8-460c-aeaa-79d482385fe6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/af0d1cf3-d72a-4890-ade8-e29de13a29bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/757633ce-cb06-4181-a10d-25fdf25bb8c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/61227c09-6a1e-4fd4-9b5b-e821f0ba95a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/11002f9a-b8f6-45b5-8ec4-28662540de4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/0b34c1e5-0d08-42aa-850c-af90747d31c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/3c7dc4fe-1113-45bc-b900-df043fccfb42_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dfd52790-de08-46e7-9446-0cb3daf589fa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116752111, 'registration': 'EO25PPV', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'I20 HATCHBACK', 'derivative': '1.0T GDi Premium 5dr', 'mileage': 5232, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-06-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO25PPV/2025-11-25/image/6994241a-e96a-4613-8ffc-bcebeefbd376_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/253bc434-57a4-449b-83f0-3c1251ccde0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/bfd3624b-d63b-4c03-b5f8-f7d28c7388ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/8d8aaadb-43a8-460c-aeaa-79d482385fe6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/af0d1cf3-d72a-4890-ade8-e29de13a29bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/757633ce-cb06-4181-a10d-25fdf25bb8c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/61227c09-6a1e-4fd4-9b5b-e821f0ba95a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/11002f9a-b8f6-45b5-8ec4-28662540de4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/0b34c1e5-0d08-42aa-850c-af90747d31c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25PPV/2025-11-25/image/3c7dc4fe-1113-45bc-b900-df043fccfb42_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dfd52790-de08-46e7-9446-0cb3daf589fa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 535f5e2b-2a8c-585a-a279-3bdd937c4d4c with identifier: 116752111
2025-12-02 19:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 535f5e2b-2a8c-585a-a279-3bdd937c4d4c with scrape type 2
2025-12-02 19:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 535f5e2b-2a8c-585a-a279-3bdd937c4d4c with scrape type 2
2025-12-02 19:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 535f5e2b-2a8c-585a-a279-3bdd937c4d4c, identifier: 116752111
2025-12-02 19:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 535f5e2b-2a8c-585a-a279-3bdd937c4d4c with identifier: 116752111
2025-12-02 19:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 535f5e2b-2a8c-585a-a279-3bdd937c4d4c with identifier: 116752111
2025-12-02 19:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 535f5e2b-2a8c-585a-a279-3bdd937c4d4c with identifier: 116752111 to the API
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116752111?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '535f5e2b-2a8c-585a-a279-3bdd937c4d4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO25PPV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116752111',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'I20 HATCHBACK',
 'odometer': 5232,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-24',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI I20 HATCHBACK 1.0T GDi Premium 5dr',
 'transmission': 'manual',
 'trim': '1.0T GDi Premium 5dr',
 'vin': None,
 'year': 2025}
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116752111%27 HTTP/1.1" 200 None
2025-12-02 19:08:15 [astonbarclay.gb] INFO: Saving data for 116752111: {'auction_closing_time': 1765792800.0, 'created_time': 1764097410.662999, 'last_price_update_time': 1764702495.445857}
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116752111') HTTP/1.1" 204 0
2025-12-02 19:08:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117591412, 'registration': 'EO72SLU', 'account': 'MOT071', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 FHEV ST-Line X Edition 5dr CVT', 'mileage': 27349, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-02', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO72SLU/2025-11-28/image/28c33c1d-274b-4bf1-b128-33f95097c00e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/e6303a32-06b8-4098-8cf9-ad91e9a111e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/41b265b6-182d-4373-9bc3-ccaf60e0cac6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/f36e684d-ad3b-4fe2-8c6c-657baed3c615_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/69fe8dd7-74b8-40a7-acd5-37700df013ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/bfa7da66-12d5-4aef-b96f-8f1e03b30556_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/d4f3e009-1980-414d-a5a6-da85e7e2e33b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/993ede2d-e8e5-4fc5-a26d-cf963ff55fb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/56d116cb-46e0-4911-85a4-594dc02a9cd3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a303f3a5-2459-453d-9473-7f681da77d49.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117591412, 'registration': 'EO72SLU', 'account': 'MOT071', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 FHEV ST-Line X Edition 5dr CVT', 'mileage': 27349, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-02', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO72SLU/2025-11-28/image/28c33c1d-274b-4bf1-b128-33f95097c00e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/e6303a32-06b8-4098-8cf9-ad91e9a111e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/41b265b6-182d-4373-9bc3-ccaf60e0cac6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/f36e684d-ad3b-4fe2-8c6c-657baed3c615_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/69fe8dd7-74b8-40a7-acd5-37700df013ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/bfa7da66-12d5-4aef-b96f-8f1e03b30556_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/d4f3e009-1980-414d-a5a6-da85e7e2e33b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/993ede2d-e8e5-4fc5-a26d-cf963ff55fb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72SLU/2025-11-28/image/56d116cb-46e0-4911-85a4-594dc02a9cd3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a303f3a5-2459-453d-9473-7f681da77d49.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6eaade-12ba-5492-a12f-9261f4f227d5 with identifier: 117591412
2025-12-02 19:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6eaade-12ba-5492-a12f-9261f4f227d5 with scrape type 2
2025-12-02 19:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6eaade-12ba-5492-a12f-9261f4f227d5 with scrape type 2
2025-12-02 19:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bc6eaade-12ba-5492-a12f-9261f4f227d5, identifier: 117591412
2025-12-02 19:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116759189?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116643961?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/114698400?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bc6eaade-12ba-5492-a12f-9261f4f227d5 with identifier: 117591412
2025-12-02 19:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bc6eaade-12ba-5492-a12f-9261f4f227d5 with identifier: 117591412
2025-12-02 19:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bc6eaade-12ba-5492-a12f-9261f4f227d5 with identifier: 117591412 to the API
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117591412?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'bc6eaade-12ba-5492-a12f-9261f4f227d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO72SLU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117591412',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 27349,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-02',
 'seller_name': 'Motability Operations',
 'title': 'FORD KUGA ESTATE 2.5 FHEV ST-Line X Edition 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 FHEV ST-Line X Edition 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117591412%27 HTTP/1.1" 200 None
2025-12-02 19:08:15 [astonbarclay.gb] INFO: Saving data for 117591412: {'auction_closing_time': 1765792800.0, 'created_time': 1764356678.1682, 'last_price_update_time': 1764702495.904433}
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117591412') HTTP/1.1" 204 0
2025-12-02 19:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/114700069?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 115990741, 'registration': 'GY24RZS', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'KONA ELECTRIC HATCHBACK', 'derivative': '160kW N Line 65kWh 5dr Auto', 'mileage': 22689, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-20', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY24RZS/2025-10-01/image/c2330afb-f76c-46fa-93ec-3297901b9801_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/c54aaa3e-5622-4c9c-8900-cf425bd0b681_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/3b85ec47-98d3-4386-837f-d0908343139b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/6872f5bc-116c-4d41-b8b7-c659fcf735d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/de635eef-2ec1-4f15-b4fb-a9a63dd63673_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/f6d9b7a6-987d-4ebb-9736-0fdd221133ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/9c0ff118-51fc-46a8-86e6-589e7fba1e67_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/814bd550-b55c-4b37-97ba-25bbea8cec6c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/25 18K', 'remarks': 'SPARE KEY BLADE ONLY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eb79a0b8-52ac-4946-b4ac-996d02d4c10d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 115990741, 'registration': 'GY24RZS', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'KONA ELECTRIC HATCHBACK', 'derivative': '160kW N Line 65kWh 5dr Auto', 'mileage': 22689, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-20', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY24RZS/2025-10-01/image/c2330afb-f76c-46fa-93ec-3297901b9801_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/c54aaa3e-5622-4c9c-8900-cf425bd0b681_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/3b85ec47-98d3-4386-837f-d0908343139b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/6872f5bc-116c-4d41-b8b7-c659fcf735d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/de635eef-2ec1-4f15-b4fb-a9a63dd63673_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/f6d9b7a6-987d-4ebb-9736-0fdd221133ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/9c0ff118-51fc-46a8-86e6-589e7fba1e67_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY24RZS/2025-10-01/image/814bd550-b55c-4b37-97ba-25bbea8cec6c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/25 18K', 'remarks': 'SPARE KEY BLADE ONLY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eb79a0b8-52ac-4946-b4ac-996d02d4c10d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b4cdc8a-6853-59a8-b2d7-352170a5a7f9 with identifier: 115990741
2025-12-02 19:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b4cdc8a-6853-59a8-b2d7-352170a5a7f9 with scrape type 2
2025-12-02 19:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b4cdc8a-6853-59a8-b2d7-352170a5a7f9 with scrape type 2
2025-12-02 19:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6b4cdc8a-6853-59a8-b2d7-352170a5a7f9, identifier: 115990741
2025-12-02 19:08:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116798984, 'registration': 'EN74UEU', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI R-Line 5dr DSG', 'mileage': 23763, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN74UEU/2025-11-06/image/b8aa37cc-25a3-4fd2-a85a-16790f021c80_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/357f79c5-84c7-4c79-804a-ef2f9be06a8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/13d8fc2f-7d95-4ae3-917d-7643fd1fab12_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/45c9e719-8c2e-4570-a860-16080c837dd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/d108d33d-5474-449d-b056-fd0cfa90013b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/95c0560b-e333-4d8a-bf76-68e5143d42f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/40d33196-6f7b-42cf-b74b-7871498770ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/4c4893c2-76f6-4a38-a1fa-a2b580120c4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/88168fc8-c0c9-425b-8463-73c290ab56c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/8192028b-6927-4a44-b107-c83065ae1c48_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5df9d02b-99da-47c2-908f-cbd84915a412.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116798984, 'registration': 'EN74UEU', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI R-Line 5dr DSG', 'mileage': 23763, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN74UEU/2025-11-06/image/b8aa37cc-25a3-4fd2-a85a-16790f021c80_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/357f79c5-84c7-4c79-804a-ef2f9be06a8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/13d8fc2f-7d95-4ae3-917d-7643fd1fab12_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/45c9e719-8c2e-4570-a860-16080c837dd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/d108d33d-5474-449d-b056-fd0cfa90013b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/95c0560b-e333-4d8a-bf76-68e5143d42f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/40d33196-6f7b-42cf-b74b-7871498770ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/4c4893c2-76f6-4a38-a1fa-a2b580120c4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/88168fc8-c0c9-425b-8463-73c290ab56c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/8192028b-6927-4a44-b107-c83065ae1c48_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5df9d02b-99da-47c2-908f-cbd84915a412.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1345b979-45fe-5d85-95c7-051531f48040 with identifier: 116798984
2025-12-02 19:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1345b979-45fe-5d85-95c7-051531f48040 with scrape type 2
2025-12-02 19:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1345b979-45fe-5d85-95c7-051531f48040 with scrape type 2
2025-12-02 19:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1345b979-45fe-5d85-95c7-051531f48040, identifier: 116798984
2025-12-02 19:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6b4cdc8a-6853-59a8-b2d7-352170a5a7f9 with identifier: 115990741
2025-12-02 19:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6b4cdc8a-6853-59a8-b2d7-352170a5a7f9 with identifier: 115990741
2025-12-02 19:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'hyundai kona electric hatchback 160kw n line 65kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 22689, 'odometer_reading_unit': 'mi', 'registration_date': '2024-04-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115990741', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '160kw n line 65kwh 5dr auto', 'license_plate': 'gy24rzs', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '6b4cdc8a-6853-59a8-b2d7-352170a5a7f9', 'current_year_diff': 1, 'age_in_months': 19, 'make_model': 'hyundai kona electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 36514} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 19,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '6b4cdc8a-6853-59a8-b2d7-352170a5a7f9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gy24rzs',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115990741',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'hyundai',
     'make_model': 'hyundai kona electric hatchback',
     'model': 'kona electric hatchback',
     'odometer': 22689,
     'odometer_in_km': 36514,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-04-20',
     'sanitized_make': 'hyundai',
     'seller_name': 'motability operations',
     'title': 'hyundai kona electric hatchback 160kw n line 65kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '160kw n line 65kwh 5dr auto',
     'vin': None,
     'year': 2024}
2025-12-02 19:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 6b4cdc8a-6853-59a8-b2d7-352170a5a7f9 spider: astonbarclay.gb
2025-12-02 19:08:16 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6b4cdc8a-6853-59a8-b2d7-352170a5a7f9 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'hyundai kona electric hatchback 160kw n line 65kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 22689, 'odometer_reading_unit': 'mi', 'registration_date': '2024-04-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115990741', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '160kw n line 65kwh 5dr auto', 'license_plate': 'gy24rzs', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '6b4cdc8a-6853-59a8-b2d7-352170a5a7f9', 'current_year_diff': 1, 'age_in_months': 19, 'make_model': 'hyundai kona electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 36514} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 19,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '6b4cdc8a-6853-59a8-b2d7-352170a5a7f9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gy24rzs',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115990741',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'hyundai',
     'make_model': 'hyundai kona electric hatchback',
     'model': 'kona electric hatchback',
     'odometer': 22689,
     'odometer_in_km': 36514,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-04-20',
     'sanitized_make': 'hyundai',
     'seller_name': 'motability operations',
     'title': 'hyundai kona electric hatchback 160kw n line 65kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '160kw n line 65kwh 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '6b4cdc8a-6853-59a8-b2d7-352170a5a7f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GY24RZS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115990741',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'KONA ELECTRIC HATCHBACK',
 'odometer': 22689,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-20',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI KONA ELECTRIC HATCHBACK 160kW N Line 65kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '160kW N Line 65kWh 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115990741%27 HTTP/1.1" 200 None
2025-12-02 19:08:16 [astonbarclay.gb] INFO: Saving data for 115990741: {'auction_closing_time': 1765792800.0, 'created_time': 1764356662.063154, 'last_price_update_time': 1764702496.338537}
2025-12-02 19:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115990741') HTTP/1.1" 204 0
2025-12-02 19:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1345b979-45fe-5d85-95c7-051531f48040 with identifier: 116798984
2025-12-02 19:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1345b979-45fe-5d85-95c7-051531f48040 with identifier: 116798984
2025-12-02 19:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1345b979-45fe-5d85-95c7-051531f48040 with identifier: 116798984 to the API
2025-12-02 19:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116798984?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1345b979-45fe-5d85-95c7-051531f48040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN74UEU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116798984',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC HATCHBACK',
 'odometer': 23763,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-28',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN T-ROC HATCHBACK 1.5 TSI R-Line 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI R-Line 5dr DSG',
 'vin': None,
 'year': 2025}
2025-12-02 19:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116798984%27 HTTP/1.1" 200 None
2025-12-02 19:08:16 [astonbarclay.gb] INFO: Saving data for 116798984: {'auction_closing_time': 1765792800.0, 'created_time': 1763579017.782867, 'last_price_update_time': 1764702496.629393}
2025-12-02 19:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116798984') HTTP/1.1" 204 0
2025-12-02 19:08:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116759189, 'registration': 'EO25NNC', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 3719, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-03-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO25NNC/2025-10-30/image/0980b010-5490-4bc8-8ac1-d8cf281279df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/52bcb8b8-e71f-43e4-b0d4-9508c1491be8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/e34caf49-45e8-4428-ac9f-24de0e6aa9f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/39220d34-7c72-4131-bd39-45dcfdfd09ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/9fb0a8ad-087b-4a9f-96e4-d4420f8e9ae8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/e4b501c9-2d88-441f-ae6c-27829aa65758_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/df92f791-8cf4-4dbe-afe0-55001047399b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/3d8026d6-bd33-4536-a5f9-2f8428a24859_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/eb531688-0cab-404a-a18c-a21e706e3ea1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/f2865e8e-2e55-46a2-98ba-86cdfb9d5dd5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2e049e12-ed42-4814-bf8b-cebb1f5fe668.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116759189, 'registration': 'EO25NNC', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 3719, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-03-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO25NNC/2025-10-30/image/0980b010-5490-4bc8-8ac1-d8cf281279df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/52bcb8b8-e71f-43e4-b0d4-9508c1491be8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/e34caf49-45e8-4428-ac9f-24de0e6aa9f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/39220d34-7c72-4131-bd39-45dcfdfd09ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/9fb0a8ad-087b-4a9f-96e4-d4420f8e9ae8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/e4b501c9-2d88-441f-ae6c-27829aa65758_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/df92f791-8cf4-4dbe-afe0-55001047399b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/3d8026d6-bd33-4536-a5f9-2f8428a24859_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/eb531688-0cab-404a-a18c-a21e706e3ea1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/f2865e8e-2e55-46a2-98ba-86cdfb9d5dd5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2e049e12-ed42-4814-bf8b-cebb1f5fe668.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6e0595-5fac-5e70-ad80-f82d5682930b with identifier: 116759189
2025-12-02 19:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6e0595-5fac-5e70-ad80-f82d5682930b with scrape type 2
2025-12-02 19:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6e0595-5fac-5e70-ad80-f82d5682930b with scrape type 2
2025-12-02 19:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bc6e0595-5fac-5e70-ad80-f82d5682930b, identifier: 116759189
2025-12-02 19:08:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116643961, 'registration': 'LX24UCV', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 25563, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LX24UCV/2025-11-25/image/61307134-4b62-48ff-beb2-bae27fb7b0c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/fd0b40e0-c087-4c19-9845-8462a0e544ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/ea1de0d2-afd2-49cd-862c-b5d1697adce7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/de71cfa1-5d16-4c0b-b67c-7e1967c1dc2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/8565dc0c-56a2-41a6-839d-ec93083b7526_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/f535dd16-7044-42e2-9c81-3e1274986ef0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/b6366db6-e3ca-44dc-a433-b66f10183ea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/65954ad4-141f-4088-8242-395842100083_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/aa6f7793-17af-4626-a8ac-6499a1f61f7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/d725bb07-c6a3-41da-9214-b1c9d4e2fbff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/cbdf989d-4958-4a9a-975e-e1ed6874951d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/25 15K - 09/25 23K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c489eca5-8c0e-46a3-9194-360b9612fa4d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116643961, 'registration': 'LX24UCV', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 25563, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LX24UCV/2025-11-25/image/61307134-4b62-48ff-beb2-bae27fb7b0c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/fd0b40e0-c087-4c19-9845-8462a0e544ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/ea1de0d2-afd2-49cd-862c-b5d1697adce7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/de71cfa1-5d16-4c0b-b67c-7e1967c1dc2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/8565dc0c-56a2-41a6-839d-ec93083b7526_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/f535dd16-7044-42e2-9c81-3e1274986ef0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/b6366db6-e3ca-44dc-a433-b66f10183ea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/65954ad4-141f-4088-8242-395842100083_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/aa6f7793-17af-4626-a8ac-6499a1f61f7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/d725bb07-c6a3-41da-9214-b1c9d4e2fbff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/cbdf989d-4958-4a9a-975e-e1ed6874951d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/25 15K - 09/25 23K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c489eca5-8c0e-46a3-9194-360b9612fa4d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 348a8a38-e382-5b13-868e-184dbcfe0f74 with identifier: 116643961
2025-12-02 19:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 348a8a38-e382-5b13-868e-184dbcfe0f74 with scrape type 2
2025-12-02 19:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 348a8a38-e382-5b13-868e-184dbcfe0f74 with scrape type 2
2025-12-02 19:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 348a8a38-e382-5b13-868e-184dbcfe0f74, identifier: 116643961
2025-12-02 19:08:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 114698400, 'registration': 'LO74PYD', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 8405, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-31', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO74PYD/2025-10-29/image/1f603865-42dc-4b7e-993d-11a5581be78c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/62f88c6b-1ef3-438a-b279-f7de1be8a4fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/1bbd6cd0-9e1a-4cc7-bc38-b31f40144b21_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/36792922-3c5c-422c-aca4-484ff4a5a7a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/0e5e1e3e-83f7-4765-8630-3da735f6f511_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/55fa444c-3bce-43e1-9bcb-e95b643db12f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/587ddf5b-2186-4856-abbd-acca8a3f0270_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/56beadd5-05ed-4f79-b23e-53309e012d81_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/fc2872da-142d-4b5f-bd56-64a1db5545e2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b9e88e5-77c2-4fae-9ad2-4b8baa4be4dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 114698400, 'registration': 'LO74PYD', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 8405, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-31', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO74PYD/2025-10-29/image/1f603865-42dc-4b7e-993d-11a5581be78c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/62f88c6b-1ef3-438a-b279-f7de1be8a4fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/1bbd6cd0-9e1a-4cc7-bc38-b31f40144b21_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/36792922-3c5c-422c-aca4-484ff4a5a7a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/0e5e1e3e-83f7-4765-8630-3da735f6f511_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/55fa444c-3bce-43e1-9bcb-e95b643db12f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/587ddf5b-2186-4856-abbd-acca8a3f0270_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/56beadd5-05ed-4f79-b23e-53309e012d81_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO74PYD/2025-10-29/image/fc2872da-142d-4b5f-bd56-64a1db5545e2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b9e88e5-77c2-4fae-9ad2-4b8baa4be4dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a70687db-8397-59f1-9ecf-3352b281cb29 with identifier: 114698400
2025-12-02 19:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a70687db-8397-59f1-9ecf-3352b281cb29 with scrape type 2
2025-12-02 19:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a70687db-8397-59f1-9ecf-3352b281cb29 with scrape type 2
2025-12-02 19:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a70687db-8397-59f1-9ecf-3352b281cb29, identifier: 114698400
2025-12-02 19:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bc6e0595-5fac-5e70-ad80-f82d5682930b with identifier: 116759189
2025-12-02 19:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bc6e0595-5fac-5e70-ad80-f82d5682930b with identifier: 116759189
2025-12-02 19:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bc6e0595-5fac-5e70-ad80-f82d5682930b with identifier: 116759189 to the API
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116759189?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'bc6e0595-5fac-5e70-ad80-f82d5682930b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO25NNC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116759189',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK',
 'odometer': 3719,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-03',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 200 AMG Line Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 200 AMG Line Premium 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116759189%27 HTTP/1.1" 200 None
2025-12-02 19:08:17 [astonbarclay.gb] INFO: Saving data for 116759189: {'auction_closing_time': 1765792800.0, 'created_time': 1763579073.707863, 'last_price_update_time': 1764702497.197761}
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116759189') HTTP/1.1" 204 0
2025-12-02 19:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 348a8a38-e382-5b13-868e-184dbcfe0f74 with identifier: 116643961
2025-12-02 19:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 348a8a38-e382-5b13-868e-184dbcfe0f74 with identifier: 116643961
2025-12-02 19:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 348a8a38-e382-5b13-868e-184dbcfe0f74 with identifier: 116643961 to the API
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116643961?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '348a8a38-e382-5b13-868e-184dbcfe0f74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX24UCV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116643961',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 25563,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-21',
 'seller_name': 'Motability Operations',
 'title': 'AUDI Q2 ESTATE 35 TFSI S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI S Line 5dr S Tronic',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116643961%27 HTTP/1.1" 200 None
2025-12-02 19:08:17 [astonbarclay.gb] INFO: Saving data for 116643961: {'auction_closing_time': 1765792800.0, 'created_time': 1763579002.774518, 'last_price_update_time': 1764702497.515826}
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116643961') HTTP/1.1" 204 0
2025-12-02 19:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a70687db-8397-59f1-9ecf-3352b281cb29 with identifier: 114698400
2025-12-02 19:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a70687db-8397-59f1-9ecf-3352b281cb29 with identifier: 114698400
2025-12-02 19:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a70687db-8397-59f1-9ecf-3352b281cb29 with identifier: 114698400 to the API
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/114698400?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a70687db-8397-59f1-9ecf-3352b281cb29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LO74PYD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/114698400',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'AVENGER HATCHBACK',
 'odometer': 8405,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-31',
 'seller_name': 'Motability Operations',
 'title': 'JEEP AVENGER HATCHBACK 1.2 e-Hybrid Summit 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.2 e-Hybrid Summit 5dr DCT',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114698400%27 HTTP/1.1" 200 None
2025-12-02 19:08:17 [astonbarclay.gb] INFO: Saving data for 114698400: {'auction_closing_time': 1765792800.0, 'created_time': 1764356705.658856, 'last_price_update_time': 1764702497.812363}
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='114698400') HTTP/1.1" 204 0
2025-12-02 19:08:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 114700069, 'registration': 'LL73NYM', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 4233, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-10-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LL73NYM/2025-10-16/image/a25ac9a7-7157-4cb3-9bb1-e457fbfccd04_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/bb410393-d0d8-4381-86d7-61eb362e010e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/48ee511c-7a50-4d67-bceb-b93da7a205b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/6a890694-dbe4-4b1a-ab8e-b538049d17df_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/58d2090f-c11e-465c-aac8-b7a08d649faa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/31838ec6-12df-49b3-9c75-b5df8d95ff0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/9e1da236-13dc-4899-a207-eaf287afa5de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/444d61f8-0b7d-497d-bca4-d03152f7a21c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/85890d62-ad62-4340-bbff-fc6699982c36_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/058c21e2-dc2f-417c-acc6-469ecbfdc2e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 114700069, 'registration': 'LL73NYM', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 4233, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-10-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LL73NYM/2025-10-16/image/a25ac9a7-7157-4cb3-9bb1-e457fbfccd04_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/bb410393-d0d8-4381-86d7-61eb362e010e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/48ee511c-7a50-4d67-bceb-b93da7a205b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/6a890694-dbe4-4b1a-ab8e-b538049d17df_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/58d2090f-c11e-465c-aac8-b7a08d649faa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/31838ec6-12df-49b3-9c75-b5df8d95ff0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/9e1da236-13dc-4899-a207-eaf287afa5de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/444d61f8-0b7d-497d-bca4-d03152f7a21c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL73NYM/2025-10-16/image/85890d62-ad62-4340-bbff-fc6699982c36_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/058c21e2-dc2f-417c-acc6-469ecbfdc2e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3743eaee-eb61-5a61-abbb-29019719d65e with identifier: 114700069
2025-12-02 19:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3743eaee-eb61-5a61-abbb-29019719d65e with scrape type 2
2025-12-02 19:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3743eaee-eb61-5a61-abbb-29019719d65e with scrape type 2
2025-12-02 19:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3743eaee-eb61-5a61-abbb-29019719d65e, identifier: 114700069
2025-12-02 19:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115926008?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3743eaee-eb61-5a61-abbb-29019719d65e with identifier: 114700069
2025-12-02 19:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3743eaee-eb61-5a61-abbb-29019719d65e with identifier: 114700069
2025-12-02 19:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3743eaee-eb61-5a61-abbb-29019719d65e with identifier: 114700069 to the API
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/114700069?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3743eaee-eb61-5a61-abbb-29019719d65e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL73NYM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/114700069',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 4233,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-25',
 'seller_name': 'Motability Operations',
 'title': 'AUDI Q2 ESTATE 35 TFSI S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI S Line 5dr S Tronic',
 'vin': None,
 'year': 2023}
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114700069%27 HTTP/1.1" 200 None
2025-12-02 19:08:18 [astonbarclay.gb] INFO: Saving data for 114700069: {'auction_closing_time': 1765792800.0, 'created_time': 1764356672.049677, 'last_price_update_time': 1764702498.186359}
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='114700069') HTTP/1.1" 204 0
2025-12-02 19:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117538127?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116806926?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116378959?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 115926008, 'registration': 'RF73HKW', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 Altitude+ 5dr', 'mileage': 13067, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-02-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF73HKW/2025-10-27/image/6dcebdf9-8fb6-44ba-9a5a-d03430e70a60_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/4984ec81-d2c2-40e5-9c5d-dc095789fc30_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/fc083a48-710e-4344-b96a-841807200278_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/60147215-f5e2-4ee9-8904-3ace92144cf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/e9f453ab-d88b-4d39-9cda-4ce92562aba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/5a7dd1a0-f86d-4794-b34a-376dac703aae_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/e7cc31b6-9ba6-4ee4-a120-e5969549bfc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/8ec0a3fa-a18c-403c-887d-10dcc760d708_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'BOOT DOES NOT OPEN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bbd1110e-f8fa-425b-b632-9dbb0a155f5c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 115926008, 'registration': 'RF73HKW', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 Altitude+ 5dr', 'mileage': 13067, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-02-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF73HKW/2025-10-27/image/6dcebdf9-8fb6-44ba-9a5a-d03430e70a60_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/4984ec81-d2c2-40e5-9c5d-dc095789fc30_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/fc083a48-710e-4344-b96a-841807200278_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/60147215-f5e2-4ee9-8904-3ace92144cf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/e9f453ab-d88b-4d39-9cda-4ce92562aba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/5a7dd1a0-f86d-4794-b34a-376dac703aae_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/e7cc31b6-9ba6-4ee4-a120-e5969549bfc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF73HKW/2025-10-27/image/8ec0a3fa-a18c-403c-887d-10dcc760d708_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'BOOT DOES NOT OPEN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bbd1110e-f8fa-425b-b632-9dbb0a155f5c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63246ade-69ee-559b-98d9-da2d4ee2cb0a with identifier: 115926008
2025-12-02 19:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63246ade-69ee-559b-98d9-da2d4ee2cb0a with scrape type 2
2025-12-02 19:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63246ade-69ee-559b-98d9-da2d4ee2cb0a with scrape type 2
2025-12-02 19:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 63246ade-69ee-559b-98d9-da2d4ee2cb0a, identifier: 115926008
2025-12-02 19:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 63246ade-69ee-559b-98d9-da2d4ee2cb0a with identifier: 115926008
2025-12-02 19:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 63246ade-69ee-559b-98d9-da2d4ee2cb0a with identifier: 115926008
2025-12-02 19:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 63246ade-69ee-559b-98d9-da2d4ee2cb0a with identifier: 115926008 to the API
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115926008?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '63246ade-69ee-559b-98d9-da2d4ee2cb0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RF73HKW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115926008',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'AVENGER HATCHBACK',
 'odometer': 13067,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-13',
 'seller_name': 'Motability Operations',
 'title': 'JEEP AVENGER HATCHBACK 1.2 Altitude+ 5dr',
 'transmission': 'manual',
 'trim': '1.2 Altitude+ 5dr',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115926008%27 HTTP/1.1" 200 None
2025-12-02 19:08:18 [astonbarclay.gb] INFO: Saving data for 115926008: {'auction_closing_time': 1765792800.0, 'created_time': 1764356701.494852, 'last_price_update_time': 1764702498.561418}
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115926008') HTTP/1.1" 204 0
2025-12-02 19:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/a49c3110-2c2b-4997-917f-8b093624393c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117410407?view=catalogue)
2025-12-02 19:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TKY/2025-12-01/image/1cfc8608-ac3e-4fdc-ac2a-7954a0c7bddb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549752?view=catalogue)
2025-12-02 19:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71FXV/2025-11-28/image/a3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590494?view=catalogue)
2025-12-02 19:08:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117538127, 'registration': 'GD72JWK', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'TAIGO HATCHBACK', 'derivative': '1.0 TSI 110 R-Line 5dr DSG', 'mileage': 88851, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-02-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GD72JWK/2025-11-26/image/ea85191f-2b91-4734-9341-043b0f1d0860_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/920a6d5d-1256-4430-87a6-d2b9e216c220_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/306b5941-0d03-4b8d-a00b-825dc5ec5f91_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/ff094777-8aa4-4863-a47c-893212d7f647_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/337cebd6-4206-4e32-957e-2f04d603181b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/0c21f96e-3f60-4daa-9d67-124dffcfb6ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/1e545aa6-da35-4def-a03a-cead693246f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/5b949fad-27c2-4f52-ae05-f2135f2c32ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/72cd6802-5067-4623-8ef7-da774f10e9ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/12549ad5-bcaf-46b6-a523-c9a434c93611_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/37c5f998-56b8-4a8b-948d-8e69315dc7a3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117538127, 'registration': 'GD72JWK', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'TAIGO HATCHBACK', 'derivative': '1.0 TSI 110 R-Line 5dr DSG', 'mileage': 88851, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-02-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GD72JWK/2025-11-26/image/ea85191f-2b91-4734-9341-043b0f1d0860_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/920a6d5d-1256-4430-87a6-d2b9e216c220_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/306b5941-0d03-4b8d-a00b-825dc5ec5f91_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/ff094777-8aa4-4863-a47c-893212d7f647_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/337cebd6-4206-4e32-957e-2f04d603181b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/0c21f96e-3f60-4daa-9d67-124dffcfb6ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/1e545aa6-da35-4def-a03a-cead693246f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/5b949fad-27c2-4f52-ae05-f2135f2c32ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/72cd6802-5067-4623-8ef7-da774f10e9ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD72JWK/2025-11-26/image/12549ad5-bcaf-46b6-a523-c9a434c93611_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/37c5f998-56b8-4a8b-948d-8e69315dc7a3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b547c9c1-189b-5bab-8762-2996ad959a9f with identifier: 117538127
2025-12-02 19:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b547c9c1-189b-5bab-8762-2996ad959a9f with scrape type 2
2025-12-02 19:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b547c9c1-189b-5bab-8762-2996ad959a9f with scrape type 2
2025-12-02 19:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b547c9c1-189b-5bab-8762-2996ad959a9f, identifier: 117538127
2025-12-02 19:08:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116806926, 'registration': 'YS24UWR', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.5 TSI EVO Xperience 5dr DSG', 'mileage': 38744, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YS24UWR/2025-10-31/image/0ddb5364-7027-4f2e-822c-4fd2bd0118df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/e6c72461-f424-4ef8-87a7-37161335c3c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/7f97e2e5-31c5-4cc9-a691-54db7f471f24_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/3f0969fb-274d-4066-869f-2133b4b812cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/d566eab5-7e85-4fdf-83f0-5f53703cb374_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/45e0bea6-3a63-43f2-8712-3da64037803f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/e1503e49-499d-402e-ad34-abecac7ea18d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/7c222871-b778-42cc-afac-477a95dbce3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/fbd546d1-caca-4059-a85b-9dc7a4854e36_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/df5badaa-10f6-4bcb-97da-94b49ba70e2d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/25 26K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a2dfa4a-571c-4b9b-803c-cd1651107f73.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116806926, 'registration': 'YS24UWR', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.5 TSI EVO Xperience 5dr DSG', 'mileage': 38744, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YS24UWR/2025-10-31/image/0ddb5364-7027-4f2e-822c-4fd2bd0118df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/e6c72461-f424-4ef8-87a7-37161335c3c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/7f97e2e5-31c5-4cc9-a691-54db7f471f24_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/3f0969fb-274d-4066-869f-2133b4b812cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/d566eab5-7e85-4fdf-83f0-5f53703cb374_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/45e0bea6-3a63-43f2-8712-3da64037803f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/e1503e49-499d-402e-ad34-abecac7ea18d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/7c222871-b778-42cc-afac-477a95dbce3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/fbd546d1-caca-4059-a85b-9dc7a4854e36_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/df5badaa-10f6-4bcb-97da-94b49ba70e2d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/25 26K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a2dfa4a-571c-4b9b-803c-cd1651107f73.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with identifier: 116806926
2025-12-02 19:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with scrape type 2
2025-12-02 19:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with scrape type 2
2025-12-02 19:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0a0182ff-ce23-5245-b563-6ff4f95b5d1a, identifier: 116806926
2025-12-02 19:08:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116378959, 'registration': 'KU74VXW', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Tekna 5dr Auto', 'mileage': 10028, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-13', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KU74VXW/2025-10-15/image/1132abe7-0d1f-4815-afce-b168e1bf3830_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/95d072d4-6b70-4155-b2a1-72e4319fddd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/552df097-8942-4e79-9f0e-c480292fb20a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/971a9a32-6139-4da0-b1a6-17d77cf62dbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/ab0f4024-206e-4548-bdfa-1d8bc44b5c00_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/f6ef9d9c-3aec-4322-bb4d-fd975cd43323_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/715faf00-2335-4cd0-b3e1-c661514c455d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/c8e29185-5460-4e75-8215-e0ac9dbda2ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/4a3cf7bc-55d8-4a21-b783-1b57fb7a6c63_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'EMPTY SERVICE BOOK', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a23933ac-004a-48da-adc7-7a4ff13c4ae5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116378959, 'registration': 'KU74VXW', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Tekna 5dr Auto', 'mileage': 10028, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-13', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KU74VXW/2025-10-15/image/1132abe7-0d1f-4815-afce-b168e1bf3830_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/95d072d4-6b70-4155-b2a1-72e4319fddd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/552df097-8942-4e79-9f0e-c480292fb20a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/971a9a32-6139-4da0-b1a6-17d77cf62dbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/ab0f4024-206e-4548-bdfa-1d8bc44b5c00_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/f6ef9d9c-3aec-4322-bb4d-fd975cd43323_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/715faf00-2335-4cd0-b3e1-c661514c455d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/c8e29185-5460-4e75-8215-e0ac9dbda2ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/KU74VXW/2025-10-15/image/4a3cf7bc-55d8-4a21-b783-1b57fb7a6c63_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'EMPTY SERVICE BOOK', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a23933ac-004a-48da-adc7-7a4ff13c4ae5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2ab32a7-9868-5ec2-b0da-4e9a5b07171c with identifier: 116378959
2025-12-02 19:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2ab32a7-9868-5ec2-b0da-4e9a5b07171c with scrape type 2
2025-12-02 19:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2ab32a7-9868-5ec2-b0da-4e9a5b07171c with scrape type 2
2025-12-02 19:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c2ab32a7-9868-5ec2-b0da-4e9a5b07171c, identifier: 116378959
2025-12-02 19:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b547c9c1-189b-5bab-8762-2996ad959a9f with identifier: 117538127
2025-12-02 19:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b547c9c1-189b-5bab-8762-2996ad959a9f with identifier: 117538127
2025-12-02 19:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b547c9c1-189b-5bab-8762-2996ad959a9f with identifier: 117538127 to the API
2025-12-02 19:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117538127?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b547c9c1-189b-5bab-8762-2996ad959a9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GD72JWK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117538127',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'TAIGO HATCHBACK',
 'odometer': 88851,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN TAIGO HATCHBACK 1.0 TSI 110 R-Line 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI 110 R-Line 5dr DSG',
 'vin': None,
 'year': 2023}
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117538127%27 HTTP/1.1" 200 None
2025-12-02 19:08:20 [astonbarclay.gb] INFO: Saving data for 117538127: {'auction_closing_time': 1765792800.0, 'created_time': 1764184088.782391, 'last_price_update_time': 1764702500.009128}
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117538127') HTTP/1.1" 204 0
2025-12-02 19:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with identifier: 116806926
2025-12-02 19:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with identifier: 116806926
2025-12-02 19:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with identifier: 116806926 to the API
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116806926?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0a0182ff-ce23-5245-b563-6ff4f95b5d1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YS24UWR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116806926',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SEAT',
 'model': 'ATECA ESTATE',
 'odometer': 38744,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-15',
 'seller_name': 'Motability Operations',
 'title': 'SEAT ATECA ESTATE 1.5 TSI EVO Xperience 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI EVO Xperience 5dr DSG',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116806926%27 HTTP/1.1" 200 None
2025-12-02 19:08:20 [astonbarclay.gb] INFO: Saving data for 116806926: {'auction_closing_time': 1765792800.0, 'created_time': 1763579029.309191, 'last_price_update_time': 1764702500.319149}
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116806926') HTTP/1.1" 204 0
2025-12-02 19:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c2ab32a7-9868-5ec2-b0da-4e9a5b07171c with identifier: 116378959
2025-12-02 19:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c2ab32a7-9868-5ec2-b0da-4e9a5b07171c with identifier: 116378959
2025-12-02 19:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c2ab32a7-9868-5ec2-b0da-4e9a5b07171c with identifier: 116378959 to the API
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116378959?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'c2ab32a7-9868-5ec2-b0da-4e9a5b07171c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KU74VXW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116378959',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 10028,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-13',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN QASHQAI HATCHBACK 1.5 E-Power Tekna 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 E-Power Tekna 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116378959%27 HTTP/1.1" 200 None
2025-12-02 19:08:20 [astonbarclay.gb] INFO: Saving data for 116378959: {'auction_closing_time': 1765792800.0, 'created_time': 1764356665.056068, 'last_price_update_time': 1764702500.59373}
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116378959') HTTP/1.1" 204 0
2025-12-02 19:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO70YEC/2025-11-27/image/cb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116859206?view=catalogue)
2025-12-02 19:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF71HVO/2025-12-02/image/15e417da-1c54-4986-acba-d7628ef7a179_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508326?view=catalogue)
2025-12-02 19:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07cf890>
2025-12-02 19:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252Fa49c3110-2c2b-4997-917f-8b093624393c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/a49c3110-2c2b-4997-917f-8b093624393c_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7
2025-12-02 19:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf095a510>
2025-12-02 19:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TKY%252F2025-12-01%252Fimage%252F1cfc8608-ac3e-4fdc-ac2a-7954a0c7bddb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TKY/2025-12-01/image/1cfc8608-ac3e-4fdc-ac2a-7954a0c7bddb_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1314f952-262f-57cb-ab7a-86b3d7339e20
2025-12-02 19:08:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1314f952-262f-57cb-ab7a-86b3d7339e20, skipping ID generation
2025-12-02 19:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1314f952-262f-57cb-ab7a-86b3d7339e20 with scrape type 1
2025-12-02 19:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1314f952-262f-57cb-ab7a-86b3d7339e20 from tracking dictionaries
2025-12-02 19:08:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1314f952-262f-57cb-ab7a-86b3d7339e20 sending to next pipeline
2025-12-02 19:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1314f952-262f-57cb-ab7a-86b3d7339e20, identifier: 117549752
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0462650>
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71FXV%252F2025-11-28%252Fimage%252Fa3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71FXV/2025-11-28/image/a3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be9d4895-6ef7-5e03-84b2-90915f3aff98
2025-12-02 19:08:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be9d4895-6ef7-5e03-84b2-90915f3aff98, skipping ID generation
2025-12-02 19:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be9d4895-6ef7-5e03-84b2-90915f3aff98 with scrape type 1
2025-12-02 19:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item be9d4895-6ef7-5e03-84b2-90915f3aff98 from tracking dictionaries
2025-12-02 19:08:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be9d4895-6ef7-5e03-84b2-90915f3aff98 sending to next pipeline
2025-12-02 19:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: be9d4895-6ef7-5e03-84b2-90915f3aff98, identifier: 117590494
2025-12-02 19:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117598315?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117537741?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117599669?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117601597?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1314f952-262f-57cb-ab7a-86b3d7339e20 with identifier: 117549752
2025-12-02 19:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1314f952-262f-57cb-ab7a-86b3d7339e20 with identifier: 117549752
2025-12-02 19:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 189935 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189935
2025-12-02 19:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1314f952-262f-57cb-ab7a-86b3d7339e20 spider: astonbarclay.gb
2025-12-02 19:08:21 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1314f952-262f-57cb-ab7a-86b3d7339e20 due to rule: high_mileage_for_country.json, error: 189935 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189935
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '1314f952-262f-57cb-ab7a-86b3d7339e20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YG20TKY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117549752',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 118021,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29107,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/9a73c87c-bed8-4576-a41f-f1d4d491a281_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29941,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/ac6492bf-9d6e-4cb4-8ae3-c33322e893b6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25175,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/1cfc8608-ac3e-4fdc-ac2a-7954a0c7bddb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26572,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/34d7c4f7-4e78-46f4-bc89-2030849c0bfc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48428,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/b77f7ba9-a36f-43e2-8d1e-738fc7bcb25d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49235,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/dc147456-f8dc-490c-9329-707be9b5b2e6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54500,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/02843cc7-2ce0-416f-984e-e11be69626e2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52989,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/455e72ec-2eeb-4ba4-9fe0-64a895efcbdd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63783,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/811fe0f8-964f-4a89-ac5b-c2a1061d17a0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45118,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/f9c3e0a6-c33a-4f0c-bf9b-8278e3f283e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48802,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/db4a8c0c-b52e-427e-a284-09be0daca296_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52073,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/96678bcc-df19-44fe-8aeb-4242196ef4ab_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33267,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/03dce60b-8f9f-4eff-8776-1fd5a7414cce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1314f952-262f-57cb-ab7a-86b3d7339e20/1314f952-262f-57cb-ab7a-86b3d7339e20_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33903,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TKY/2025-12-01/image/8e4c409c-bce9-4e07-b52a-0b3d6fa98543_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': 'Zenith',
 'title': 'BMW 3 SERIES SALOON 330e M Sport 4dr Auto',
 'transmission': 'automatic',
 'trim': '330e M Sport 4dr Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549752%27 HTTP/1.1" 200 None
2025-12-02 19:08:21 [astonbarclay.gb] INFO: Saving data for 117549752: {'created_time': 1764702501.721195, 'last_price_update_time': 1764702501.721205, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117549752') HTTP/1.1" 204 0
2025-12-02 19:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: be9d4895-6ef7-5e03-84b2-90915f3aff98 with identifier: 117590494
2025-12-02 19:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: be9d4895-6ef7-5e03-84b2-90915f3aff98 with identifier: 117590494
2025-12-02 19:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 10, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'ford mustang mach-e estate 198kw standard range 68kwh rwd 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 'mustang mach-e estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 41206, 'odometer_reading_unit': 'mi', 'registration_date': '2021-09-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117590494', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '198kw standard range 68kwh rwd 5dr auto', 'license_plate': 'ld71fxv', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'be9d4895-6ef7-5e03-84b2-90915f3aff98', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25434}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/e08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24551}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 27396}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 26196}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/a3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 28780}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/cc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 41635}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 43922}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 31497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/d14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 40809}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 45354}], 'current_year_diff': 4, 'age_in_months': 50, 'make_model': 'ford mustang mach-e estate', 'sanitized_make': 'ford', 'odometer_in_km': 66314} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'be9d4895-6ef7-5e03-84b2-90915f3aff98',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ld71fxv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117590494',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'ford',
     'make_model': 'ford mustang mach-e estate',
     'model': 'mustang mach-e estate',
     'odometer': 41206,
     'odometer_in_km': 66314,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25434,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24551,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/e08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27396,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26196,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28780,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/a3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41635,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/cc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43922,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31497,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40809,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/d14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45354,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-30',
     'sanitized_make': 'ford',
     'seller_name': 'zenith',
     'title': 'ford mustang mach-e estate 198kw standard range 68kwh rwd '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '198kw standard range 68kwh rwd 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: be9d4895-6ef7-5e03-84b2-90915f3aff98 spider: astonbarclay.gb
2025-12-02 19:08:21 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: be9d4895-6ef7-5e03-84b2-90915f3aff98 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 10, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'ford mustang mach-e estate 198kw standard range 68kwh rwd 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 'mustang mach-e estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 41206, 'odometer_reading_unit': 'mi', 'registration_date': '2021-09-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117590494', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '198kw standard range 68kwh rwd 5dr auto', 'license_plate': 'ld71fxv', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'be9d4895-6ef7-5e03-84b2-90915f3aff98', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25434}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/e08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24551}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 27396}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 26196}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/a3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 28780}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/cc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 41635}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 43922}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 31497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/d14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 40809}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 45354}], 'current_year_diff': 4, 'age_in_months': 50, 'make_model': 'ford mustang mach-e estate', 'sanitized_make': 'ford', 'odometer_in_km': 66314} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'be9d4895-6ef7-5e03-84b2-90915f3aff98',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ld71fxv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117590494',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'ford',
     'make_model': 'ford mustang mach-e estate',
     'model': 'mustang mach-e estate',
     'odometer': 41206,
     'odometer_in_km': 66314,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25434,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24551,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/e08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27396,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26196,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28780,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/a3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41635,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/cc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43922,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31497,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40809,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/d14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45354,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-30',
     'sanitized_make': 'ford',
     'seller_name': 'zenith',
     'title': 'ford mustang mach-e estate 198kw standard range 68kwh rwd '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '198kw standard range 68kwh rwd 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'be9d4895-6ef7-5e03-84b2-90915f3aff98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LD71FXV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117590494',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'MUSTANG MACH-E ESTATE',
 'odometer': 41206,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25434,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/3a4e4eac-ed57-4b02-a956-99fe42d2cb2b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24551,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/e08ad8d2-5b2f-4056-9ea7-ddbeec05f0d9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27396,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/6866e353-64ec-43a1-9d14-47ad3cea97d1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26196,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/43376b52-7422-4e3d-841e-0d542db77cb4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28780,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/a3affc5c-7474-495b-ac24-3a7b667b3adc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41635,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/cc2beb42-c317-42be-9fb8-b2d70cb285b1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43922,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/14e891ee-e49e-4faa-9c90-1271320288a3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31497,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/53b25316-f7d7-4cd9-a843-456488784208_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40809,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/d14de991-24ae-4904-9900-0c225d95f30e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be9d4895-6ef7-5e03-84b2-90915f3aff98/be9d4895-6ef7-5e03-84b2-90915f3aff98_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45354,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/LD71FXV/2025-11-28/image/0073ca6d-6101-44d9-967d-0b9fcbb06f3a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seller_name': 'Zenith',
 'title': 'FORD MUSTANG MACH-E ESTATE 198kW Standard Range 68kWh RWD 5dr Auto',
 'transmission': 'automatic',
 'trim': '198kW Standard Range 68kWh RWD 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590494%27 HTTP/1.1" 200 None
2025-12-02 19:08:21 [astonbarclay.gb] INFO: Saving data for 117590494: {'created_time': 1764702501.958892, 'last_price_update_time': 1764702501.958902, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117590494') HTTP/1.1" 204 0
2025-12-02 19:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117359464?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117626788?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117021986?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0884d50>
2025-12-02 19:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252Fcb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/cb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c05dfe48-04df-50d0-bcd0-70853b464265
2025-12-02 19:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0399550>
2025-12-02 19:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF71HVO%252F2025-12-02%252Fimage%252F15e417da-1c54-4986-acba-d7628ef7a179_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF71HVO/2025-12-02/image/15e417da-1c54-4986-acba-d7628ef7a179_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afc55445-065d-5656-a413-94c60897ffb6
2025-12-02 19:08:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afc55445-065d-5656-a413-94c60897ffb6, skipping ID generation
2025-12-02 19:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc55445-065d-5656-a413-94c60897ffb6 with scrape type 1
2025-12-02 19:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item afc55445-065d-5656-a413-94c60897ffb6 from tracking dictionaries
2025-12-02 19:08:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afc55445-065d-5656-a413-94c60897ffb6 sending to next pipeline
2025-12-02 19:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: afc55445-065d-5656-a413-94c60897ffb6, identifier: 117508326
2025-12-02 19:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: afc55445-065d-5656-a413-94c60897ffb6 with identifier: 117508326
2025-12-02 19:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: afc55445-065d-5656-a413-94c60897ffb6 with identifier: 117508326
2025-12-02 19:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: afc55445-065d-5656-a413-94c60897ffb6 with identifier: 117508326 to the API
2025-12-02 19:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YF71HVO/2025-12-02/image/15e417da-1c54-4986-acba-d7628ef7a179_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'afc55445-065d-5656-a413-94c60897ffb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YF71HVO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117508326',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS ESTATE SPECIAL EDITION',
 'odometer': 15164,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25622,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/d6324c42-5365-4338-82e1-5bb3a22788e0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24371,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/877d51bf-37ae-4779-887b-61362789eee9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23347,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/8ee385b5-cf6e-4c21-94ec-8f19c1a9b4e7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25452,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/cfcd1567-3674-4f57-a6f9-4aaab87f4e39_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44492,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/43ec6dc9-12ea-4dcd-9edf-d0d8d0770214_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48256,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/15e417da-1c54-4986-acba-d7628ef7a179_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39599,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/90d87e9d-8236-4a73-a528-944ec02675a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46697,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/c3911f7f-2693-468b-a529-406832ab98ab_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc55445-065d-5656-a413-94c60897ffb6/afc55445-065d-5656-a413-94c60897ffb6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37762,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YF71HVO/2025-12-02/image/a7561868-2bf4-43e0-be00-aec50e17e106_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN T-CROSS ESTATE SPECIAL EDITION 1.0 TSI 110 Active 5dr '
          'DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI 110 Active 5dr DSG',
 'vin': None,
 'year': 2021}
2025-12-02 19:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508326%27 HTTP/1.1" 200 None
2025-12-02 19:08:23 [astonbarclay.gb] INFO: Saving data for 117508326: {'created_time': 1764702503.407188, 'last_price_update_time': 1764702503.407198, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117508326') HTTP/1.1" 204 0
2025-12-02 19:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/d95fc9a2-ea9e-466c-a755-37d4fe231ca1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117410407?view=catalogue)
2025-12-02 19:08:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117598315, 'registration': 'LL24CCO', 'account': 'MOT070', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 ePHEV Advance Tech 5dr eCVT', 'mileage': 23881, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-26', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LL24CCO/2025-11-29/image/50bd35e1-3cd0-4d54-a9e7-7240d3e7846e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/aa6f6e07-7e5e-4e1c-b60c-3435ffe40b13_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/616b753f-a8b6-4e40-8a55-ecc7d9b8d42f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/ecfe2bf7-7fdc-4054-a573-99a12f14a61b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/04877787-02f6-46bd-81fa-767a94e11883_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/e1274c83-dcfb-4e45-8b49-0b0296d4dfdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/97894058-71b1-4579-946e-9d5d370da670_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/3f58a663-6356-419f-ac34-92d175981ea6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/7e1656e5-b7b1-42ee-9517-f1ad10e221a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/4d33c5e3-ecb1-4643-b87d-8c867745baa6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 19, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/282503e4-785a-42a1-992f-353c34d15d08.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117598315, 'registration': 'LL24CCO', 'account': 'MOT070', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 ePHEV Advance Tech 5dr eCVT', 'mileage': 23881, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-26', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LL24CCO/2025-11-29/image/50bd35e1-3cd0-4d54-a9e7-7240d3e7846e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/aa6f6e07-7e5e-4e1c-b60c-3435ffe40b13_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/616b753f-a8b6-4e40-8a55-ecc7d9b8d42f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/ecfe2bf7-7fdc-4054-a573-99a12f14a61b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/04877787-02f6-46bd-81fa-767a94e11883_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/e1274c83-dcfb-4e45-8b49-0b0296d4dfdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/97894058-71b1-4579-946e-9d5d370da670_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/3f58a663-6356-419f-ac34-92d175981ea6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/7e1656e5-b7b1-42ee-9517-f1ad10e221a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL24CCO/2025-11-29/image/4d33c5e3-ecb1-4643-b87d-8c867745baa6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 19, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/282503e4-785a-42a1-992f-353c34d15d08.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b33fdc-f167-57fb-b096-e8598eb70d70 with identifier: 117598315
2025-12-02 19:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b33fdc-f167-57fb-b096-e8598eb70d70 with scrape type 2
2025-12-02 19:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b33fdc-f167-57fb-b096-e8598eb70d70 with scrape type 2
2025-12-02 19:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 46b33fdc-f167-57fb-b096-e8598eb70d70, identifier: 117598315
2025-12-02 19:08:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117537741, 'registration': 'PY74LVD', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 Hybrid 136 GT 5dr e-DSC6', 'mileage': 11782, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PY74LVD/2025-11-26/image/f2c75b41-bd61-4cc7-a6cd-0a7a1aa983ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/f39e9117-4db6-4091-842b-d0d3fed657f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/2fea749e-0f95-478a-b839-be806898a09a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/378874e4-0d58-4ff7-9a18-601e631f9d4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/6d24aaf4-cd74-445f-9896-00167ba08ea7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/892cda3b-5107-4eef-ac61-ccb36b245c52_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/658865d1-a10d-4ba7-aabf-ce7fae7bf8e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/6cea33c4-9eb4-4269-a4d3-1f715123bbab_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/476acaf3-bddf-44fe-8655-e5bb75a8a61d_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/30f463f2-8daa-4987-8217-bec60e3b430a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - DOCUMENT FEF NUMBER AVAILABLE ON REQUEST - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c00edeb3-9a65-44ed-99a2-92948d0aea8d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117537741, 'registration': 'PY74LVD', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 Hybrid 136 GT 5dr e-DSC6', 'mileage': 11782, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PY74LVD/2025-11-26/image/f2c75b41-bd61-4cc7-a6cd-0a7a1aa983ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/f39e9117-4db6-4091-842b-d0d3fed657f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/2fea749e-0f95-478a-b839-be806898a09a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/378874e4-0d58-4ff7-9a18-601e631f9d4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/6d24aaf4-cd74-445f-9896-00167ba08ea7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/892cda3b-5107-4eef-ac61-ccb36b245c52_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/658865d1-a10d-4ba7-aabf-ce7fae7bf8e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/6cea33c4-9eb4-4269-a4d3-1f715123bbab_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/476acaf3-bddf-44fe-8655-e5bb75a8a61d_removebg.jpg?w=600', 'https://abimg003.imgix.net/PY74LVD/2025-11-26/image/30f463f2-8daa-4987-8217-bec60e3b430a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - DOCUMENT FEF NUMBER AVAILABLE ON REQUEST - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c00edeb3-9a65-44ed-99a2-92948d0aea8d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2894132b-0ba4-565e-aa4c-1d3d1ee628e6 with identifier: 117537741
2025-12-02 19:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2894132b-0ba4-565e-aa4c-1d3d1ee628e6 with scrape type 2
2025-12-02 19:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2894132b-0ba4-565e-aa4c-1d3d1ee628e6 with scrape type 2
2025-12-02 19:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2894132b-0ba4-565e-aa4c-1d3d1ee628e6, identifier: 117537741
2025-12-02 19:08:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117599669, 'registration': 'LO24XLH', 'account': 'MOT070', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 ePHEV Advance Tech 5dr eCVT', 'mileage': 13512, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-06-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LO24XLH/2025-11-29/image/e6413b11-8716-4cd4-93b5-894311103eb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/906bd571-d913-40be-8e43-647233f9c45b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/d43223ef-d28d-4d8b-8710-001ba52726b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/93b4f1cf-4688-497d-94c5-8b4b279b60dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/160ad000-a7d9-4d30-bef9-640ea24b6889_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/d9652a2e-158f-48c8-8221-0d02810a6130_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/22b046e5-7c01-4ea7-9b2d-43dbea7b57b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/713be9b6-655d-46cb-8c93-bcd6489474c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/1f92c436-448d-48d3-b0d2-498aab00d2b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/03b5df01-031e-4e59-8628-b66aabc58617_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 19, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/90ee9599-1425-4bdf-81fd-c2eb774f5b8e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117599669, 'registration': 'LO24XLH', 'account': 'MOT070', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 ePHEV Advance Tech 5dr eCVT', 'mileage': 13512, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-06-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LO24XLH/2025-11-29/image/e6413b11-8716-4cd4-93b5-894311103eb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/906bd571-d913-40be-8e43-647233f9c45b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/d43223ef-d28d-4d8b-8710-001ba52726b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/93b4f1cf-4688-497d-94c5-8b4b279b60dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/160ad000-a7d9-4d30-bef9-640ea24b6889_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/d9652a2e-158f-48c8-8221-0d02810a6130_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/22b046e5-7c01-4ea7-9b2d-43dbea7b57b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/713be9b6-655d-46cb-8c93-bcd6489474c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/1f92c436-448d-48d3-b0d2-498aab00d2b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO24XLH/2025-11-29/image/03b5df01-031e-4e59-8628-b66aabc58617_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 19, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/90ee9599-1425-4bdf-81fd-c2eb774f5b8e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c9da9a-7d2c-5278-bfe9-3b45ec2ca02a with identifier: 117599669
2025-12-02 19:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c9da9a-7d2c-5278-bfe9-3b45ec2ca02a with scrape type 2
2025-12-02 19:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39c9da9a-7d2c-5278-bfe9-3b45ec2ca02a with scrape type 2
2025-12-02 19:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 39c9da9a-7d2c-5278-bfe9-3b45ec2ca02a, identifier: 117599669
2025-12-02 19:08:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117601597, 'registration': 'EF73HLX', 'account': 'MOT070', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 FHEV ST-Line X Edition 5dr CVT', 'mileage': 35637, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-11-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EF73HLX/2025-12-01/image/6a7824d8-ec8e-402c-aaf4-b0f1c2f7e5c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/840eafb4-0731-49ce-a428-e76e59f715c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/8eeff74b-40d0-437b-88a8-61c8add8b01a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/146f5e2e-455b-48d2-b2e7-86917bfddabf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/41809c8f-a8b4-4f5f-96ff-ca9267e8d218_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/da1a8ca3-5ac9-4959-9b5c-76e3763342ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/83a8844f-67f8-418f-abb0-8c7ea862f37c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/67c65c46-cd33-4978-b1a7-938a5c4ffa0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/c99cab69-d122-45b6-8095-39321e1b6008_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/dd540a37-8886-4ad5-b6c7-246c608b9de0_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/69d49e9e-d777-40a0-a6bb-936199fcf315.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117601597, 'registration': 'EF73HLX', 'account': 'MOT070', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 FHEV ST-Line X Edition 5dr CVT', 'mileage': 35637, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-11-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EF73HLX/2025-12-01/image/6a7824d8-ec8e-402c-aaf4-b0f1c2f7e5c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/840eafb4-0731-49ce-a428-e76e59f715c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/8eeff74b-40d0-437b-88a8-61c8add8b01a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/146f5e2e-455b-48d2-b2e7-86917bfddabf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/41809c8f-a8b4-4f5f-96ff-ca9267e8d218_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/da1a8ca3-5ac9-4959-9b5c-76e3763342ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/83a8844f-67f8-418f-abb0-8c7ea862f37c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/67c65c46-cd33-4978-b1a7-938a5c4ffa0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/c99cab69-d122-45b6-8095-39321e1b6008_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF73HLX/2025-12-01/image/dd540a37-8886-4ad5-b6c7-246c608b9de0_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/69d49e9e-d777-40a0-a6bb-936199fcf315.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 583691df-a6c6-5643-b264-97a53d88438d with identifier: 117601597
2025-12-02 19:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 583691df-a6c6-5643-b264-97a53d88438d with scrape type 2
2025-12-02 19:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 583691df-a6c6-5643-b264-97a53d88438d with scrape type 2
2025-12-02 19:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 583691df-a6c6-5643-b264-97a53d88438d, identifier: 117601597
2025-12-02 19:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116859206?view=catalogue)
2025-12-02 19:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YD73NZH/2025-12-01/image/078c62a4-5182-45a3-b149-a3af85ccbcb3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue)
2025-12-02 19:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML72VFN/2025-11-28/image/7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116637669?view=catalogue)
2025-12-02 19:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 46b33fdc-f167-57fb-b096-e8598eb70d70 with identifier: 117598315
2025-12-02 19:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 46b33fdc-f167-57fb-b096-e8598eb70d70 with identifier: 117598315
2025-12-02 19:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 46b33fdc-f167-57fb-b096-e8598eb70d70 with identifier: 117598315 to the API
2025-12-02 19:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2746b33fdc-f167-57fb-b096-e8598eb70d70%27 HTTP/1.1" 200 None
2025-12-02 19:08:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 46b33fdc-f167-57fb-b096-e8598eb70d70: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:08:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117598315?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 19,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '46b33fdc-f167-57fb-b096-e8598eb70d70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LL24CCO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117598315',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'CR-V ESTATE',
 'odometer': 23881,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-26',
 'seller_name': 'Motability Operations',
 'title': 'HONDA CR-V ESTATE 2.0 ePHEV Advance Tech 5dr eCVT',
 'transmission': 'automatic',
 'trim': '2.0 ePHEV Advance Tech 5dr eCVT',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598315%27 HTTP/1.1" 200 None
2025-12-02 19:08:24 [astonbarclay.gb] INFO: Saving data for 117598315: {'auction_closing_time': 1765792800.0, 'created_time': 1764356714.044089, 'last_price_update_time': 1764702504.098099}
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117598315') HTTP/1.1" 204 0
2025-12-02 19:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2894132b-0ba4-565e-aa4c-1d3d1ee628e6 with identifier: 117537741
2025-12-02 19:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2894132b-0ba4-565e-aa4c-1d3d1ee628e6 with identifier: 117537741
2025-12-02 19:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2894132b-0ba4-565e-aa4c-1d3d1ee628e6 with identifier: 117537741 to the API
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117537741?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2894132b-0ba4-565e-aa4c-1d3d1ee628e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PY74LVD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117537741',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '3008 ESTATE',
 'odometer': 11782,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-24',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 3008 ESTATE 1.2 Hybrid 136 GT 5dr e-DSC6',
 'transmission': 'automatic',
 'trim': '1.2 Hybrid 136 GT 5dr e-DSC6',
 'vin': None,
 'year': 2025}
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537741%27 HTTP/1.1" 200 None
2025-12-02 19:08:24 [astonbarclay.gb] INFO: Saving data for 117537741: {'auction_closing_time': 1765792800.0, 'created_time': 1764184088.423849, 'last_price_update_time': 1764702504.406353}
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117537741') HTTP/1.1" 204 0
2025-12-02 19:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 39c9da9a-7d2c-5278-bfe9-3b45ec2ca02a with identifier: 117599669
2025-12-02 19:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 39c9da9a-7d2c-5278-bfe9-3b45ec2ca02a with identifier: 117599669
2025-12-02 19:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 39c9da9a-7d2c-5278-bfe9-3b45ec2ca02a with identifier: 117599669 to the API
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2739c9da9a-7d2c-5278-bfe9-3b45ec2ca02a%27 HTTP/1.1" 200 None
2025-12-02 19:08:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 39c9da9a-7d2c-5278-bfe9-3b45ec2ca02a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:08:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117599669?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 19,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '39c9da9a-7d2c-5278-bfe9-3b45ec2ca02a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LO24XLH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599669',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'CR-V ESTATE',
 'odometer': 13512,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-28',
 'seller_name': 'Motability Operations',
 'title': 'HONDA CR-V ESTATE 2.0 ePHEV Advance Tech 5dr eCVT',
 'transmission': 'automatic',
 'trim': '2.0 ePHEV Advance Tech 5dr eCVT',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599669%27 HTTP/1.1" 200 None
2025-12-02 19:08:24 [astonbarclay.gb] INFO: Saving data for 117599669: {'auction_closing_time': 1765792800.0, 'created_time': 1764356713.761344, 'last_price_update_time': 1764702504.691533}
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117599669') HTTP/1.1" 204 0
2025-12-02 19:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 583691df-a6c6-5643-b264-97a53d88438d with identifier: 117601597
2025-12-02 19:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 583691df-a6c6-5643-b264-97a53d88438d with identifier: 117601597
2025-12-02 19:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 583691df-a6c6-5643-b264-97a53d88438d with identifier: 117601597 to the API
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27583691df-a6c6-5643-b264-97a53d88438d%27 HTTP/1.1" 200 None
2025-12-02 19:08:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 583691df-a6c6-5643-b264-97a53d88438d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:08:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117601597?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '583691df-a6c6-5643-b264-97a53d88438d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'EF73HLX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117601597',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 35637,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seller_name': 'Motability Operations',
 'title': 'FORD KUGA ESTATE 2.5 FHEV ST-Line X Edition 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 FHEV ST-Line X Edition 5dr CVT',
 'vin': None,
 'year': 2023}
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601597%27 HTTP/1.1" 200 None
2025-12-02 19:08:24 [astonbarclay.gb] INFO: Saving data for 117601597: {'auction_closing_time': 1765792800.0, 'created_time': 1764356663.324897, 'last_price_update_time': 1764702504.988219}
2025-12-02 19:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117601597') HTTP/1.1" 204 0
2025-12-02 19:08:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117359464, 'registration': 'SD71YTL', 'account': 'KIN032', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Standard Plus 4dr Auto', 'mileage': 60174, 'mileageWarranty': False, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-11-26', 'fuel': 'Electric', 'motExpiry': '2026-11-25', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/SD71YTL/2025-11-20/image/81f46ce4-4b42-4eaa-9623-148eb662c195_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/080a0c5c-b2cd-4f0a-8996-d581bc47c3b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/6e9bce92-62c4-4e0b-a14a-f7432af799b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/32a11743-173f-45f8-aebf-8a3f0ac7a228_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/d87d65c2-3c76-4d91-84ec-2ebf845fc04b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/2f4c97fb-e02f-48da-b564-091def29b5b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/4fe47211-8ad2-47c4-8983-e032609d097d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/edaf10d3-83c0-4a7c-ad6e-bf0a712645f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/124aae53-fbbc-4ad2-9537-bce2f40a48dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/935ce31f-3989-4c9a-a00d-d2851ee934a5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**335**VOSA STATES 47K, 59K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/58394cc9-6ec6-4e35-b675-46fa6bb46125.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117359464, 'registration': 'SD71YTL', 'account': 'KIN032', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Standard Plus 4dr Auto', 'mileage': 60174, 'mileageWarranty': False, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-11-26', 'fuel': 'Electric', 'motExpiry': '2026-11-25', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/SD71YTL/2025-11-20/image/81f46ce4-4b42-4eaa-9623-148eb662c195_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/080a0c5c-b2cd-4f0a-8996-d581bc47c3b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/6e9bce92-62c4-4e0b-a14a-f7432af799b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/32a11743-173f-45f8-aebf-8a3f0ac7a228_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/d87d65c2-3c76-4d91-84ec-2ebf845fc04b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/2f4c97fb-e02f-48da-b564-091def29b5b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/4fe47211-8ad2-47c4-8983-e032609d097d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/edaf10d3-83c0-4a7c-ad6e-bf0a712645f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/124aae53-fbbc-4ad2-9537-bce2f40a48dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/935ce31f-3989-4c9a-a00d-d2851ee934a5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**335**VOSA STATES 47K, 59K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/58394cc9-6ec6-4e35-b675-46fa6bb46125.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d58ba83b-4489-52c5-b56c-2b235c97c8be with identifier: 117359464
2025-12-02 19:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58ba83b-4489-52c5-b56c-2b235c97c8be with scrape type 1
2025-12-02 19:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d58ba83b-4489-52c5-b56c-2b235c97c8be
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F81f46ce4-4b42-4eaa-9623-148eb662c195_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/81f46ce4-4b42-4eaa-9623-148eb662c195_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117626788, 'registration': 'KX72HMJ', 'account': 'STE097', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.0 Mild Hybrid Dolcevita [Part Leather] 3dr', 'mileage': 5508, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-11-22', 'fuel': 'Petrol', 'motExpiry': '2026-11-21', 'doors': 3, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/5e8532b9-d076-4f2a-9972-ce9b6f6ab14a.jpg?w=600', 'https://abimg002.imgix.net/cf80bd86-7ec7-4d72-b2fe-44ceaa7bb3ce.jpg?w=600', 'https://abimg002.imgix.net/a4c605c3-a447-43ab-bf94-8e770c588f8c.jpg?w=600', 'https://abimg002.imgix.net/d5d0acb8-ebc2-4353-9afa-9f114b40daa4.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/364f013e-c1c3-4dde-9a40-a7adddf452d5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117626788, 'registration': 'KX72HMJ', 'account': 'STE097', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.0 Mild Hybrid Dolcevita [Part Leather] 3dr', 'mileage': 5508, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 571}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-11-22', 'fuel': 'Petrol', 'motExpiry': '2026-11-21', 'doors': 3, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/5e8532b9-d076-4f2a-9972-ce9b6f6ab14a.jpg?w=600', 'https://abimg002.imgix.net/cf80bd86-7ec7-4d72-b2fe-44ceaa7bb3ce.jpg?w=600', 'https://abimg002.imgix.net/a4c605c3-a447-43ab-bf94-8e770c588f8c.jpg?w=600', 'https://abimg002.imgix.net/d5d0acb8-ebc2-4353-9afa-9f114b40daa4.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/364f013e-c1c3-4dde-9a40-a7adddf452d5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96 with identifier: 117626788
2025-12-02 19:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96 with scrape type 1
2025-12-02 19:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F5e8532b9-d076-4f2a-9972-ce9b6f6ab14a.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5e8532b9-d076-4f2a-9972-ce9b6f6ab14a.jpg?w=600 not downloaded yet
2025-12-02 19:08:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117398180, 'registration': 'DE71CFO', 'account': 'KIN032', 'make': 'BMW', 'model': '2 SERIES DIESEL GRAN TOURER', 'derivative': '216d SE 5dr Step Auto', 'mileage': 93086, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-10-31', 'fuel': 'Diesel', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e5039b0-53f6-4099-a140-3a38a1e6babe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/731ea754-dbbe-4311-9757-2d8216a99cbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/32220310-e352-4cb1-910c-1759daca1a0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/6f05494d-e744-4744-941d-b42e9bfe9fae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/e0473668-e405-4471-8e53-d1de844387f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1f2dca70-5322-49ea-bd5a-2eed581a0e5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/ad7baace-55eb-46d6-9b4c-d8c0c0d3ee89_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/dca12231-3984-44a4-b4e0-abd7bfa84849_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/33e708b3-92fc-470b-8198-707232509853_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1c1386d4-3a4f-444a-afd2-10909d6fb461_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e990bee-4a00-412f-82a9-9814a37dd698_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/f51925ed-9194-4b1f-9ad0-a4ca23aa122a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/22 - 15K, 02/23 - 30K, 07/23 - 46K, 04/24 - 62K, 06/24 - 66K, 08/24 - 70K, 12/24 - 77K, 11/25 - 93K,', 'remarks': '**208**VOSA STATES 75K, 93K  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3c008f55-01a6-45b8-b123-95d435bc8d7d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117398180, 'registration': 'DE71CFO', 'account': 'KIN032', 'make': 'BMW', 'model': '2 SERIES DIESEL GRAN TOURER', 'derivative': '216d SE 5dr Step Auto', 'mileage': 93086, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-10-31', 'fuel': 'Diesel', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e5039b0-53f6-4099-a140-3a38a1e6babe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/731ea754-dbbe-4311-9757-2d8216a99cbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/32220310-e352-4cb1-910c-1759daca1a0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/6f05494d-e744-4744-941d-b42e9bfe9fae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/e0473668-e405-4471-8e53-d1de844387f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1f2dca70-5322-49ea-bd5a-2eed581a0e5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/ad7baace-55eb-46d6-9b4c-d8c0c0d3ee89_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/dca12231-3984-44a4-b4e0-abd7bfa84849_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/33e708b3-92fc-470b-8198-707232509853_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1c1386d4-3a4f-444a-afd2-10909d6fb461_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e990bee-4a00-412f-82a9-9814a37dd698_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/f51925ed-9194-4b1f-9ad0-a4ca23aa122a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/22 - 15K, 02/23 - 30K, 07/23 - 46K, 04/24 - 62K, 06/24 - 66K, 08/24 - 70K, 12/24 - 77K, 11/25 - 93K,', 'remarks': '**208**VOSA STATES 75K, 93K  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3c008f55-01a6-45b8-b123-95d435bc8d7d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab01a251-29e1-5907-bbdc-2f90aba01bfc with identifier: 117398180
2025-12-02 19:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab01a251-29e1-5907-bbdc-2f90aba01bfc with scrape type 1
2025-12-02 19:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F1e5039b0-53f6-4099-a140-3a38a1e6babe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e5039b0-53f6-4099-a140-3a38a1e6babe_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117021986, 'registration': 'BK22NVG', 'account': 'STE131', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo GS Line 5dr', 'mileage': 13073, 'mileageWarranty': False, 'type': 'car', 'saleId': 17975, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-04-29', 'fuel': 'Petrol', 'motExpiry': '2026-06-04', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK22NVG/2025-11-10/image/0046674e-f5b2-4e4b-8ba7-24546aaeab61_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/8d90a272-0c6b-44c8-9756-2059b6e99a08_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/d781ff05-a803-4db1-bf60-69492dac900c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/024ddff1-1672-40c9-aa42-1f0c25247b0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/920e8e0c-5278-48a0-95bb-e12b9028e060_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/79834318-d85c-4ebc-aa7a-3e608f27f6b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/00661597-330e-4fa6-96c2-4e7075196d81_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/2c170620-e7c5-456e-a989-7db20ce238fe_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/24-7K, 06/25-12K', 'remarks': 'SPARE KEY, VOSA STATES 12K', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc7bb72f-3d52-4d88-8a46-831fa0161713.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117021986, 'registration': 'BK22NVG', 'account': 'STE131', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo GS Line 5dr', 'mileage': 13073, 'mileageWarranty': False, 'type': 'car', 'saleId': 17975, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-04-29', 'fuel': 'Petrol', 'motExpiry': '2026-06-04', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK22NVG/2025-11-10/image/0046674e-f5b2-4e4b-8ba7-24546aaeab61_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/8d90a272-0c6b-44c8-9756-2059b6e99a08_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/d781ff05-a803-4db1-bf60-69492dac900c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/024ddff1-1672-40c9-aa42-1f0c25247b0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/920e8e0c-5278-48a0-95bb-e12b9028e060_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/79834318-d85c-4ebc-aa7a-3e608f27f6b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/00661597-330e-4fa6-96c2-4e7075196d81_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK22NVG/2025-11-10/image/2c170620-e7c5-456e-a989-7db20ce238fe_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/24-7K, 06/25-12K', 'remarks': 'SPARE KEY, VOSA STATES 12K', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc7bb72f-3d52-4d88-8a46-831fa0161713.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa69d358-5379-5274-bb72-9b94b54cc638 with identifier: 117021986
2025-12-02 19:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa69d358-5379-5274-bb72-9b94b54cc638 with scrape type 2
2025-12-02 19:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa69d358-5379-5274-bb72-9b94b54cc638 with scrape type 2
2025-12-02 19:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fa69d358-5379-5274-bb72-9b94b54cc638, identifier: 117021986
2025-12-02 19:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fa69d358-5379-5274-bb72-9b94b54cc638 with identifier: 117021986
2025-12-02 19:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fa69d358-5379-5274-bb72-9b94b54cc638 with identifier: 117021986
2025-12-02 19:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fa69d358-5379-5274-bb72-9b94b54cc638 with identifier: 117021986 to the API
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117021986?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'fa69d358-5379-5274-bb72-9b94b54cc638',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BK22NVG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117021986',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND HATCHBACK',
 'odometer': 13073,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-29',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'VAUXHALL CROSSLAND HATCHBACK 1.2 Turbo GS Line 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo GS Line 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117021986%27 HTTP/1.1" 200 None
2025-12-02 19:08:25 [astonbarclay.gb] INFO: Saving data for 117021986: {'auction_closing_time': 1765447200.0, 'created_time': 1764356705.299817, 'last_price_update_time': 1764702505.701292}
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117021986') HTTP/1.1" 204 0
2025-12-02 19:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b521d0>
2025-12-02 19:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNJ71VMZ%252F2025-11-28%252Fimage%252Fd95fc9a2-ea9e-466c-a755-37d4fe231ca1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/d95fc9a2-ea9e-466c-a755-37d4fe231ca1_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7
2025-12-02 19:08:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7, skipping ID generation
2025-12-02 19:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7 with scrape type 1
2025-12-02 19:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7 from tracking dictionaries
2025-12-02 19:08:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7 sending to next pipeline
2025-12-02 19:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7, identifier: 117410407
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F080a0c5c-b2cd-4f0a-8996-d581bc47c3b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/080a0c5c-b2cd-4f0a-8996-d581bc47c3b9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fcf80bd86-7ec7-4d72-b2fe-44ceaa7bb3ce.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/cf80bd86-7ec7-4d72-b2fe-44ceaa7bb3ce.jpg?w=600 not downloaded yet
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F731ea754-dbbe-4311-9757-2d8216a99cbe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/731ea754-dbbe-4311-9757-2d8216a99cbe_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7 with identifier: 117410407
2025-12-02 19:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7 with identifier: 117410407
2025-12-02 19:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 136504 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    136504
2025-12-02 19:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7 spider: astonbarclay.gb
2025-12-02 19:08:26 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7 due to rule: high_mileage_for_make.json, error: 136504 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    136504
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NJ71VMZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117410407',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 84820,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26853,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/493c1363-c3fe-434f-9a58-941fbc735988_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23834,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/d95fc9a2-ea9e-466c-a755-37d4fe231ca1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29741,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/023c1415-32b1-4687-b756-d22179792078_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26541,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/30031c29-b09e-4ddb-ad62-6c1039b58d68_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36443,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/a49c3110-2c2b-4997-917f-8b093624393c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40464,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/423a81b8-c4f0-40c3-8316-5becabc400bd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46102,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/57ab575b-2b38-4e96-95d3-1ccf8a93df15_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7/3f3b04fe-84a6-5e42-b5cf-627e17d5cfd7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40456,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/NJ71VMZ/2025-11-28/image/dc90d459-73a8-4afe-bd2c-bfc65f5081a9_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-21',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117410407%27 HTTP/1.1" 200 None
2025-12-02 19:08:26 [astonbarclay.gb] INFO: Saving data for 117410407: {'created_time': 1764702506.352037, 'last_price_update_time': 1764702506.352048, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117410407') HTTP/1.1" 204 0
2025-12-02 19:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/3fdcb158-482b-45ca-8f31-7c3126687320_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue)
2025-12-02 19:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY71UNL/2025-11-28/image/c17695d0-fba7-4590-b137-4c0e5d6cef34_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508301?view=catalogue)
2025-12-02 19:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YG20TMU/2025-12-01/image/6d7cae0e-2541-4122-a067-12e3f16b8b8e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549728?view=catalogue)
2025-12-02 19:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS70NVP/2025-12-01/image/487a9a73-2ef3-4f92-975e-592107154aef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446714?view=catalogue)
2025-12-02 19:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML72VFN/2025-11-28/image/2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116637669?view=catalogue)
2025-12-02 19:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YD73NZH/2025-12-01/image/8a6a06ad-21ed-46eb-bc1e-16ad9aa30c3b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117103670?view=catalogue)
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d30c90>
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO70YEC%252F2025-11-27%252Fimage%252F69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c05dfe48-04df-50d0-bcd0-70853b464265
2025-12-02 19:08:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c05dfe48-04df-50d0-bcd0-70853b464265, skipping ID generation
2025-12-02 19:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c05dfe48-04df-50d0-bcd0-70853b464265 with scrape type 1
2025-12-02 19:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c05dfe48-04df-50d0-bcd0-70853b464265 from tracking dictionaries
2025-12-02 19:08:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c05dfe48-04df-50d0-bcd0-70853b464265 sending to next pipeline
2025-12-02 19:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c05dfe48-04df-50d0-bcd0-70853b464265, identifier: 116859206
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d307d0>
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F078c62a4-5182-45a3-b149-a3af85ccbcb3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/078c62a4-5182-45a3-b149-a3af85ccbcb3_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0744390>
2025-12-02 19:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea1aae49-cae9-58ac-87f7-666248b36155
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F6e9bce92-62c4-4e0b-a14a-f7432af799b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/6e9bce92-62c4-4e0b-a14a-f7432af799b0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa4c605c3-a447-43ab-bf94-8e770c588f8c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a4c605c3-a447-43ab-bf94-8e770c588f8c.jpg?w=600 not downloaded yet
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F32220310-e352-4cb1-910c-1759daca1a0a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/32220310-e352-4cb1-910c-1759daca1a0a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c05dfe48-04df-50d0-bcd0-70853b464265 with identifier: 116859206
2025-12-02 19:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c05dfe48-04df-50d0-bcd0-70853b464265 with identifier: 116859206
2025-12-02 19:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen t-cross diesel estate 1.6 tdi se 5dr dsg', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 't-cross diesel estate', 'transmission': 'automatic', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 142303, 'odometer_reading_unit': 'mi', 'registration_date': '2020-11-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116859206', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.6 tdi se 5dr dsg', 'license_plate': 'vo70yec', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 142, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'c05dfe48-04df-50d0-bcd0-70853b464265', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/a0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30613}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30645}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/f17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32839}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/cb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40155}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54954}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/ec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51615}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/db31c692-139c-4873-ade5-932ac328f731_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45016}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50897}], 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'volkswagen t-cross diesel estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 229013}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': 142,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'diesel',
     'id': 'c05dfe48-04df-50d0-bcd0-70853b464265',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vo70yec',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116859206',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'volkswagen',
     'make_model': 'volkswagen t-cross diesel estate',
     'model': 't-cross diesel estate',
     'odometer': 142303,
     'odometer_in_km': 229013,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30613,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/a0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30645,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34065,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/f17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32839,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40155,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/cb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54954,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51615,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/ec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45016,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/db31c692-139c-4873-ade5-932ac328f731_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50897,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-23',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen t-cross diesel estate 1.6 tdi se 5dr dsg',
     'transmission': 'automatic',
     'trim': '1.6 tdi se 5dr dsg',
     'vin': None,
     'year': 2020}
2025-12-02 19:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: c05dfe48-04df-50d0-bcd0-70853b464265 spider: astonbarclay.gb
2025-12-02 19:08:27 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c05dfe48-04df-50d0-bcd0-70853b464265 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen t-cross diesel estate 1.6 tdi se 5dr dsg', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 't-cross diesel estate', 'transmission': 'automatic', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 142303, 'odometer_reading_unit': 'mi', 'registration_date': '2020-11-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116859206', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.6 tdi se 5dr dsg', 'license_plate': 'vo70yec', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 142, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'c05dfe48-04df-50d0-bcd0-70853b464265', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/a0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30613}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30645}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/f17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32839}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/cb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40155}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54954}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/ec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51615}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/db31c692-139c-4873-ade5-932ac328f731_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45016}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50897}], 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'volkswagen t-cross diesel estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 229013}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': 142,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'diesel',
     'id': 'c05dfe48-04df-50d0-bcd0-70853b464265',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vo70yec',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116859206',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'volkswagen',
     'make_model': 'volkswagen t-cross diesel estate',
     'model': 't-cross diesel estate',
     'odometer': 142303,
     'odometer_in_km': 229013,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30613,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/a0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30645,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34065,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/f17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32839,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40155,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/cb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54954,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51615,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/ec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45016,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/db31c692-139c-4873-ade5-932ac328f731_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50897,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-23',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen t-cross diesel estate 1.6 tdi se 5dr dsg',
     'transmission': 'automatic',
     'trim': '1.6 tdi se 5dr dsg',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'c05dfe48-04df-50d0-bcd0-70853b464265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VO70YEC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116859206',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS DIESEL ESTATE',
 'odometer': 142303,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30613,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/a0cbc479-ca64-40ea-a73c-1be95d7ff1dc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30645,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69591f6d-b5a7-4ef5-8b5c-65ec6470d131_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34065,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/f17b6719-1328-4c9f-87dc-a5368d44b15f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32839,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/69125321-1ed0-4d11-a834-a1e4bbcdaca4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40155,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/cb4a5830-810c-4a71-ac19-f36b6aedcfe3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54954,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/27ed2d09-1214-4c69-a6b5-f809c35fcf7b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51615,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/ec80b9c1-848e-4339-b112-cd028e6ad95b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45016,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/db31c692-139c-4873-ade5-932ac328f731_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c05dfe48-04df-50d0-bcd0-70853b464265/c05dfe48-04df-50d0-bcd0-70853b464265_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50897,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VO70YEC/2025-11-27/image/0a460396-3be5-4594-934a-df7e6036f92f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN T-CROSS DIESEL ESTATE 1.6 TDI SE 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.6 TDI SE 5dr DSG',
 'vin': None,
 'year': 2020}
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859206%27 HTTP/1.1" 200 None
2025-12-02 19:08:27 [astonbarclay.gb] INFO: Saving data for 116859206: {'created_time': 1764702507.53786, 'last_price_update_time': 1764702507.537869, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116859206') HTTP/1.1" 204 0
2025-12-02 19:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117524612?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117457056?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F32a11743-173f-45f8-aebf-8a3f0ac7a228_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/32a11743-173f-45f8-aebf-8a3f0ac7a228_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fd5d0acb8-ebc2-4353-9afa-9f114b40daa4.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d5d0acb8-ebc2-4353-9afa-9f114b40daa4.jpg?w=600 not downloaded yet
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F6f05494d-e744-4744-941d-b42e9bfe9fae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/6f05494d-e744-4744-941d-b42e9bfe9fae_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117547832?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117604347?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117702797?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117600051?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03e6ed0>
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F3fdcb158-482b-45ca-8f31-7c3126687320_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/3fdcb158-482b-45ca-8f31-7c3126687320_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05fc6d0>
2025-12-02 19:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252Fc17695d0-fba7-4590-b137-4c0e5d6cef34_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/c17695d0-fba7-4590-b137-4c0e5d6cef34_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ebc548a-8426-52af-a925-2e350152f83b
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0660b50>
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYG20TMU%252F2025-12-01%252Fimage%252F6d7cae0e-2541-4122-a067-12e3f16b8b8e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YG20TMU/2025-12-01/image/6d7cae0e-2541-4122-a067-12e3f16b8b8e_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae5c8ee3-b15a-5859-9a28-809f83112292
2025-12-02 19:08:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae5c8ee3-b15a-5859-9a28-809f83112292, skipping ID generation
2025-12-02 19:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae5c8ee3-b15a-5859-9a28-809f83112292 with scrape type 1
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ae5c8ee3-b15a-5859-9a28-809f83112292 from tracking dictionaries
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae5c8ee3-b15a-5859-9a28-809f83112292 sending to next pipeline
2025-12-02 19:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ae5c8ee3-b15a-5859-9a28-809f83112292, identifier: 117549728
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0438990>
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS70NVP%252F2025-12-01%252Fimage%252F487a9a73-2ef3-4f92-975e-592107154aef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS70NVP/2025-12-01/image/487a9a73-2ef3-4f92-975e-592107154aef_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e767275-5689-5147-bbf2-4bb12fc393f9
2025-12-02 19:08:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e767275-5689-5147-bbf2-4bb12fc393f9, skipping ID generation
2025-12-02 19:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e767275-5689-5147-bbf2-4bb12fc393f9 with scrape type 1
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2e767275-5689-5147-bbf2-4bb12fc393f9 from tracking dictionaries
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e767275-5689-5147-bbf2-4bb12fc393f9 sending to next pipeline
2025-12-02 19:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2e767275-5689-5147-bbf2-4bb12fc393f9, identifier: 117446714
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf072cf90>
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML72VFN%252F2025-11-28%252Fimage%252F2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML72VFN/2025-11-28/image/2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea1aae49-cae9-58ac-87f7-666248b36155
2025-12-02 19:08:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea1aae49-cae9-58ac-87f7-666248b36155, skipping ID generation
2025-12-02 19:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea1aae49-cae9-58ac-87f7-666248b36155 with scrape type 1
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ea1aae49-cae9-58ac-87f7-666248b36155 from tracking dictionaries
2025-12-02 19:08:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea1aae49-cae9-58ac-87f7-666248b36155 sending to next pipeline
2025-12-02 19:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ea1aae49-cae9-58ac-87f7-666248b36155, identifier: 116637669
2025-12-02 19:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07450d0>
2025-12-02 19:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYD73NZH%252F2025-12-01%252Fimage%252F8a6a06ad-21ed-46eb-bc1e-16ad9aa30c3b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YD73NZH/2025-12-01/image/8a6a06ad-21ed-46eb-bc1e-16ad9aa30c3b_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f38991d5-0e23-5762-a62e-4cca8ac5d874
2025-12-02 19:08:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f38991d5-0e23-5762-a62e-4cca8ac5d874, skipping ID generation
2025-12-02 19:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38991d5-0e23-5762-a62e-4cca8ac5d874 with scrape type 1
2025-12-02 19:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f38991d5-0e23-5762-a62e-4cca8ac5d874 from tracking dictionaries
2025-12-02 19:08:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f38991d5-0e23-5762-a62e-4cca8ac5d874 sending to next pipeline
2025-12-02 19:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f38991d5-0e23-5762-a62e-4cca8ac5d874, identifier: 117103670
2025-12-02 19:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ae5c8ee3-b15a-5859-9a28-809f83112292 with identifier: 117549728
2025-12-02 19:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ae5c8ee3-b15a-5859-9a28-809f83112292 with identifier: 117549728
2025-12-02 19:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162721 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162721
2025-12-02 19:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ae5c8ee3-b15a-5859-9a28-809f83112292 spider: astonbarclay.gb
2025-12-02 19:08:29 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ae5c8ee3-b15a-5859-9a28-809f83112292 due to rule: high_mileage_for_country.json, error: 162721 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162721
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'ae5c8ee3-b15a-5859-9a28-809f83112292',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YG20TMU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117549728',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 101111,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32495,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/acfd294e-e777-4e17-b83b-14b86b0e4dfb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33438,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/78ed11f1-b544-4a6b-a7d2-1e522dc189a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31656,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/0d965dc9-937b-4923-a319-5b9a29a7c527_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33168,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/749aa07f-eb30-42db-ba0c-b9e6e93d18ad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56185,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/02c233a7-57dd-446e-b63e-a7f8542979e6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52898,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/2be67f55-8152-4555-8437-545c41f4a418_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51936,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/6d7cae0e-2541-4122-a067-12e3f16b8b8e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62361,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/265d9b34-6dd0-4a6a-900d-a333529a09bf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54007,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/8b656dc8-3a27-49f6-839a-106a97530aab_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54848,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/669870e6-6a05-439e-9791-2cf710919fd4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5c8ee3-b15a-5859-9a28-809f83112292/ae5c8ee3-b15a-5859-9a28-809f83112292_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51266,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YG20TMU/2025-12-01/image/43a0c356-362f-48a7-9bbf-e210c91bc131_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': 'Zenith',
 'title': 'BMW 3 SERIES SALOON 330e M Sport 4dr Auto',
 'transmission': 'automatic',
 'trim': '330e M Sport 4dr Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549728%27 HTTP/1.1" 200 None
2025-12-02 19:08:29 [astonbarclay.gb] INFO: Saving data for 117549728: {'created_time': 1764702509.627553, 'last_price_update_time': 1764702509.627563, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117549728') HTTP/1.1" 204 0
2025-12-02 19:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2e767275-5689-5147-bbf2-4bb12fc393f9 with identifier: 117446714
2025-12-02 19:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2e767275-5689-5147-bbf2-4bb12fc393f9 with identifier: 117446714
2025-12-02 19:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2e767275-5689-5147-bbf2-4bb12fc393f9 with identifier: 117446714 to the API
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YS70NVP/2025-12-01/image/487a9a73-2ef3-4f92-975e-592107154aef_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '2e767275-5689-5147-bbf2-4bb12fc393f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YS70NVP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117446714',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MINI',
 'model': 'COUNTRYMAN HATCHBACK',
 'odometer': 36038,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35266,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3ea2e8d7-781c-45e7-b36c-ecbb192cb55b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34920,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/487a9a73-2ef3-4f92-975e-592107154aef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36577,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e3eed9ea-2c32-4716-9e09-8b7380beedff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35956,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/e941e187-f286-4a87-8235-d3a2660fb856_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47352,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/a7861f7a-c5d8-49c2-9ca8-01cc5c15e62e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49983,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/5b37b9ae-d83b-42dd-a22d-f78f5404a342_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47232,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/351cc696-7efc-443a-a2ab-8ff534ca166d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62401,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/3bd5c16a-f43a-44a7-b82d-df0f7561ab93_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47120,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/0a16a5dd-18c7-44c8-80c3-279d6068f6c3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60174,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/d4a8a223-c5ed-4d22-9d02-73ef1d63523d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55608,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/c4656a57-4503-4e5d-ba94-29a21e2693cb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e767275-5689-5147-bbf2-4bb12fc393f9/2e767275-5689-5147-bbf2-4bb12fc393f9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61842,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS70NVP/2025-12-01/image/ac310f36-e7d2-4b04-851e-d54c9737002a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seller_name': 'Zenith',
 'title': 'MINI COUNTRYMAN HATCHBACK 1.5 Cooper S E Sport ALL4 PHEV 5dr Auto '
          '[Comfort]',
 'transmission': 'automatic',
 'trim': '1.5 Cooper S E Sport ALL4 PHEV 5dr Auto [Comfort]',
 'vin': None,
 'year': 2020}
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446714%27 HTTP/1.1" 200 None
2025-12-02 19:08:29 [astonbarclay.gb] INFO: Saving data for 117446714: {'created_time': 1764702509.987545, 'last_price_update_time': 1764702509.987558, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117446714') HTTP/1.1" 204 0
2025-12-02 19:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ea1aae49-cae9-58ac-87f7-666248b36155 with identifier: 116637669
2025-12-02 19:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ea1aae49-cae9-58ac-87f7-666248b36155 with identifier: 116637669
2025-12-02 19:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 55842, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116637669', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto [c+s]', 'license_plate': 'ml72vfn', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ea1aae49-cae9-58ac-87f7-666248b36155', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25579}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 23269}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24126}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 38631}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/dc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 35519}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 35598}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 34670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/d1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 41088}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 89868} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'ea1aae49-cae9-58ac-87f7-666248b36155',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ml72vfn',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116637669',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 55842,
     'odometer_in_km': 89868,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25579,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 23269,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25141,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24126,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38631,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35519,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/dc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35598,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34670,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41088,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/d1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-10',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto [c+s]',
     'vin': None,
     'year': 2022}
2025-12-02 19:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: ea1aae49-cae9-58ac-87f7-666248b36155 spider: astonbarclay.gb
2025-12-02 19:08:30 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ea1aae49-cae9-58ac-87f7-666248b36155 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 55842, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116637669', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto [c+s]', 'license_plate': 'ml72vfn', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ea1aae49-cae9-58ac-87f7-666248b36155', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25579}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 23269}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 25141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24126}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 38631}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/dc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 35519}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 35598}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 34670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/d1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 41088}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 89868} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'ea1aae49-cae9-58ac-87f7-666248b36155',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ml72vfn',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116637669',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 55842,
     'odometer_in_km': 89868,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25579,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 23269,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25141,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24126,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38631,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35519,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/dc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35598,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34670,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41088,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/d1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-10',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto [c+s]',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'ea1aae49-cae9-58ac-87f7-666248b36155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'ML72VFN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116637669',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q4 E-TRON ESTATE',
 'odometer': 55842,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25579,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/129d218f-5756-4bbd-86d9-c6de86138a28_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23269,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/2955333d-7d11-4dc9-98ce-2b06a2eceeba_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25141,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/49454ed2-c731-4f3b-885b-ee54930a27b6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24126,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/7c763c19-4c48-4e2b-b851-b9e81fd4fbea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38631,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9a83fb1d-d1dd-496e-b91d-5cd4e023e63d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35519,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/dc9e7a3e-b5eb-48a7-8b0d-968643bff134_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35598,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/9e267726-e62d-4679-aa6e-32965ae1f2f2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34670,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/4d658dd5-987c-4608-ab9f-9e3553ee055d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1aae49-cae9-58ac-87f7-666248b36155/ea1aae49-cae9-58ac-87f7-666248b36155_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41088,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML72VFN/2025-11-28/image/d1b17a60-afe7-448f-9393-a495e586ed49_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': 'Zenith',
 'title': 'AUDI Q4 E-TRON ESTATE 150kW 40 82kWh S Line 5dr Auto [C+S]',
 'transmission': 'automatic',
 'trim': '150kW 40 82kWh S Line 5dr Auto [C+S]',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116637669%27 HTTP/1.1" 200 None
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Saving data for 116637669: {'created_time': 1764702510.212692, 'last_price_update_time': 1764702510.212702, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116637669') HTTP/1.1" 204 0
2025-12-02 19:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f38991d5-0e23-5762-a62e-4cca8ac5d874 with identifier: 117103670
2025-12-02 19:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f38991d5-0e23-5762-a62e-4cca8ac5d874 with identifier: 117103670
2025-12-02 19:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f38991d5-0e23-5762-a62e-4cca8ac5d874 with identifier: 117103670 to the API
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YD73NZH/2025-12-01/image/8a6a06ad-21ed-46eb-bc1e-16ad9aa30c3b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'f38991d5-0e23-5762-a62e-4cca8ac5d874',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YD73NZH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117103670',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'TAIGO HATCHBACK',
 'odometer': 15980,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31929,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/6466a23d-33e7-491e-8cdd-bdaf99491800_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34500,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/8a6a06ad-21ed-46eb-bc1e-16ad9aa30c3b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33598,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/4652ff00-3b7e-43b6-8d3d-f6f5337b8788_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33032,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/078c62a4-5182-45a3-b149-a3af85ccbcb3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50763,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/b06919d1-8cce-4ce2-a231-39258fd8fa8d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64730,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/2e0fd6e0-5dce-4453-9eb5-7c5922324e30_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49350,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/7fa464fb-df5b-4ba5-91b2-447ee005dd71_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46661,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/f4a1bb6f-b1eb-435f-abbd-d8f1ca79c567_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46591,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/ef0f789a-1b6a-4ffe-9718-e095a5f6433e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48706,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/029d3e6d-6293-4236-b63c-6ead6efeec90_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f38991d5-0e23-5762-a62e-4cca8ac5d874/f38991d5-0e23-5762-a62e-4cca8ac5d874_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50241,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YD73NZH/2025-12-01/image/1a83dd39-d4e1-438b-9a86-17e070f09183_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-30',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN TAIGO HATCHBACK 1.0 TSI 110 R-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI 110 R-Line 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103670%27 HTTP/1.1" 200 None
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Saving data for 117103670: {'created_time': 1764702510.55692, 'last_price_update_time': 1764702510.556931, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117103670') HTTP/1.1" 204 0
2025-12-02 19:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e5039b0-53f6-4099-a140-3a38a1e6babe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD71YTL/2025-11-20/image/81f46ce4-4b42-4eaa-9623-148eb662c195_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117359464?view=catalogue)
2025-12-02 19:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/f34cd200-8a22-41b2-89d6-1e8b6f0c5228_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446881?view=catalogue)
2025-12-02 19:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72NYL/2025-12-02/image/2df7c900-c65c-4820-a959-3734acfcf56d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117100813?view=catalogue)
2025-12-02 19:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY71UNL/2025-11-28/image/458bed60-eaaa-4a29-8868-66e3ab456acb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508301?view=catalogue)
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252Fd87d65c2-3c76-4d91-84ec-2ebf845fc04b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/d87d65c2-3c76-4d91-84ec-2ebf845fc04b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252Fe0473668-e405-4471-8e53-d1de844387f3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/e0473668-e405-4471-8e53-d1de844387f3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117447701?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117417496?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117524612, 'registration': 'NA72UFM', 'account': 'ZEN009', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '2.0 B3P Core 5dr Auto', 'mileage': 42119, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-16', 'fuel': 'Petrol', 'motExpiry': '2026-11-15', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NA72UFM/2025-12-02/image/48757d86-d566-4042-8270-d5c52066de6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/e7dcfac1-d52e-4a8a-b726-179ca4ddd8eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/5be7962e-7940-40fd-9e68-1b108ee5f1a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a9b72878-c3d7-47a8-accf-8b1eacff918b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/ed2156b0-32c4-4323-b650-6c4a5e860a5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/fb6afe43-ae86-4e3f-a5d2-d83e2bbf7666_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a7e919a9-b8a0-48e9-861d-d01defbb931f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/0cd57591-05d1-4e72-9dcb-ff1670263d10_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/6a79a172-50b3-4838-aefc-0a5f06a9f7b0_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/25 - 32K', 'remarks': '**708**VOSA STATES 41K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/75cbd984-5a63-43d7-9831-1d4002e01736.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117524612, 'registration': 'NA72UFM', 'account': 'ZEN009', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '2.0 B3P Core 5dr Auto', 'mileage': 42119, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-16', 'fuel': 'Petrol', 'motExpiry': '2026-11-15', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NA72UFM/2025-12-02/image/48757d86-d566-4042-8270-d5c52066de6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/e7dcfac1-d52e-4a8a-b726-179ca4ddd8eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/5be7962e-7940-40fd-9e68-1b108ee5f1a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a9b72878-c3d7-47a8-accf-8b1eacff918b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/ed2156b0-32c4-4323-b650-6c4a5e860a5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/fb6afe43-ae86-4e3f-a5d2-d83e2bbf7666_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a7e919a9-b8a0-48e9-861d-d01defbb931f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/0cd57591-05d1-4e72-9dcb-ff1670263d10_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/6a79a172-50b3-4838-aefc-0a5f06a9f7b0_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/25 - 32K', 'remarks': '**708**VOSA STATES 41K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/75cbd984-5a63-43d7-9831-1d4002e01736.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13 with identifier: 117524612
2025-12-02 19:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13 with scrape type 1
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252F48757d86-d566-4042-8270-d5c52066de6a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/48757d86-d566-4042-8270-d5c52066de6a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117457056, 'registration': 'KS22TTE', 'account': 'ZEN009', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': 'M135i xDrive 5dr Step Auto [Pro Pack]', 'mileage': 20781, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-30', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c020f32f-91e2-43bc-9a0f-96e090bbaa63_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f4e4182e-b2f3-489d-a06b-5f93ca5a67ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/b0f454bc-00ca-4446-810c-07e50467f0e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c905bf93-689c-403b-8cef-16e6a803e89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f8e702c2-06e2-4fa1-8ece-75510e0380ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/12096044-f373-42e5-9879-13e75c49c310_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fe51d39-8580-4169-b3b2-86dfa17fd656_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/2fe0b2c3-2838-48d1-9b10-02c6626f15aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fae927f-21d1-4da0-8e1a-e94865dfffb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/e2cc78ed-dafb-4437-9e3d-466169bb3993_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**742**VOSA STATES 18K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 172, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a132abdc-8850-4526-9ea4-ba5aeeff7748.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117457056, 'registration': 'KS22TTE', 'account': 'ZEN009', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': 'M135i xDrive 5dr Step Auto [Pro Pack]', 'mileage': 20781, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-30', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c020f32f-91e2-43bc-9a0f-96e090bbaa63_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f4e4182e-b2f3-489d-a06b-5f93ca5a67ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/b0f454bc-00ca-4446-810c-07e50467f0e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c905bf93-689c-403b-8cef-16e6a803e89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f8e702c2-06e2-4fa1-8ece-75510e0380ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/12096044-f373-42e5-9879-13e75c49c310_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fe51d39-8580-4169-b3b2-86dfa17fd656_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/2fe0b2c3-2838-48d1-9b10-02c6626f15aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fae927f-21d1-4da0-8e1a-e94865dfffb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/e2cc78ed-dafb-4437-9e3d-466169bb3993_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**742**VOSA STATES 18K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 172, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a132abdc-8850-4526-9ea4-ba5aeeff7748.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd with identifier: 117457056
2025-12-02 19:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd with scrape type 1
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Fc020f32f-91e2-43bc-9a0f-96e090bbaa63_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c020f32f-91e2-43bc-9a0f-96e090bbaa63_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117547832, 'registration': 'NX66XEO', 'account': 'THE109', 'make': 'FORD', 'model': 'MONDEO DIESEL HATCHBACK', 'derivative': '1.5 TDCi ECOnetic Zetec 5dr', 'mileage': 104815, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-16', 'fuel': 'Diesel', 'motExpiry': '2026-04-18', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NX66XEO/2025-12-02/image/b7dccd1c-ef62-4250-8ba5-a75dd4d63036_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/4d70d034-850d-4b9b-9f43-d7d77db7b122_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/7ebcfcb7-9106-4c7e-872c-c51d6b852b44_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/98065e85-cca4-42d4-bb33-526447da11b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/fe810be8-b69f-42b7-89f1-1c6d63f8664f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/ed70da77-40a2-4068-9816-7c2477fb94d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/86034229-794b-4118-a27b-ff45e917996e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/faf8cec2-744b-4f13-8ffc-2947a03aa4f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/7dee6323-05f4-4ef4-8d5e-3044eeebf7d5_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/18 - 18K, 09/19 - 31K, 01/21 - 50K, 03/22 - 62K, 04/23 - 68K', 'remarks': '**480** VOSA STATES 31K, 44K, 50K, 62K, 68K, 87K, 99K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e17fed19-276f-43e2-81cf-507441f93d69.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117547832, 'registration': 'NX66XEO', 'account': 'THE109', 'make': 'FORD', 'model': 'MONDEO DIESEL HATCHBACK', 'derivative': '1.5 TDCi ECOnetic Zetec 5dr', 'mileage': 104815, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-16', 'fuel': 'Diesel', 'motExpiry': '2026-04-18', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NX66XEO/2025-12-02/image/b7dccd1c-ef62-4250-8ba5-a75dd4d63036_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/4d70d034-850d-4b9b-9f43-d7d77db7b122_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/7ebcfcb7-9106-4c7e-872c-c51d6b852b44_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/98065e85-cca4-42d4-bb33-526447da11b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/fe810be8-b69f-42b7-89f1-1c6d63f8664f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/ed70da77-40a2-4068-9816-7c2477fb94d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/86034229-794b-4118-a27b-ff45e917996e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/faf8cec2-744b-4f13-8ffc-2947a03aa4f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/NX66XEO/2025-12-02/image/7dee6323-05f4-4ef4-8d5e-3044eeebf7d5_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/18 - 18K, 09/19 - 31K, 01/21 - 50K, 03/22 - 62K, 04/23 - 68K', 'remarks': '**480** VOSA STATES 31K, 44K, 50K, 62K, 68K, 87K, 99K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e17fed19-276f-43e2-81cf-507441f93d69.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606c334b-f187-5ad5-ba9c-a24bff686768 with identifier: 117547832
2025-12-02 19:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606c334b-f187-5ad5-ba9c-a24bff686768 with scrape type 2
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606c334b-f187-5ad5-ba9c-a24bff686768 with scrape type 2
2025-12-02 19:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 606c334b-f187-5ad5-ba9c-a24bff686768, identifier: 117547832
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117604347, 'registration': 'EN70ZWD', 'account': 'HAT006', 'make': 'VOLVO', 'model': 'XC90 DIESEL ESTATE', 'derivative': '2.0 B5D [235] R DESIGN Pro 5dr AWD Geartronic', 'mileage': 62979, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-12', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/b0d418e2-e647-4dfe-bf9d-a5d6eff3655e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/a4231025-d422-4167-a991-efdbaea197d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/9624ffe3-cb77-4d8b-b096-46305a378454_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/c74021fc-8969-4e7f-8baa-2661f7ed4f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/bdb83040-67b8-4075-954b-271181203625_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/113cc191-eb99-42c6-bff1-8063ec5789d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/4b6eca67-b97c-4bee-9400-fd8e9f9638df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/9cc19b21-b107-4a47-8e20-f49966e91a3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/f228f9ad-e7d0-4ee7-afdd-617c34d179f5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/24 - 33K, 07/25 - 52K', 'remarks': '**86**VOSA STATES 23K, 25K, 44K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 187, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e7f02dca-a91b-4e45-b2f3-63984e961baf.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117604347, 'registration': 'EN70ZWD', 'account': 'HAT006', 'make': 'VOLVO', 'model': 'XC90 DIESEL ESTATE', 'derivative': '2.0 B5D [235] R DESIGN Pro 5dr AWD Geartronic', 'mileage': 62979, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-12', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/b0d418e2-e647-4dfe-bf9d-a5d6eff3655e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/a4231025-d422-4167-a991-efdbaea197d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/9624ffe3-cb77-4d8b-b096-46305a378454_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/c74021fc-8969-4e7f-8baa-2661f7ed4f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/bdb83040-67b8-4075-954b-271181203625_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/113cc191-eb99-42c6-bff1-8063ec5789d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/4b6eca67-b97c-4bee-9400-fd8e9f9638df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/9cc19b21-b107-4a47-8e20-f49966e91a3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN70ZWD/2025-12-02/image/f228f9ad-e7d0-4ee7-afdd-617c34d179f5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/24 - 33K, 07/25 - 52K', 'remarks': '**86**VOSA STATES 23K, 25K, 44K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 187, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e7f02dca-a91b-4e45-b2f3-63984e961baf.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7574627c-47b6-5a52-b89b-c70eb95eca3f with identifier: 117604347
2025-12-02 19:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7574627c-47b6-5a52-b89b-c70eb95eca3f with scrape type 2
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7574627c-47b6-5a52-b89b-c70eb95eca3f with scrape type 2
2025-12-02 19:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7574627c-47b6-5a52-b89b-c70eb95eca3f, identifier: 117604347
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117702797, 'registration': 'BV18VKU', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna 5dr Xtronic', 'mileage': 54494, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-03-08', 'fuel': 'Petrol', 'motExpiry': '2026-03-13', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117702797, 'registration': 'BV18VKU', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna 5dr Xtronic', 'mileage': 54494, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-03-08', 'fuel': 'Petrol', 'motExpiry': '2026-03-13', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd557d3d-7205-52b5-88db-ba8d064fc442 with identifier: 117702797
2025-12-02 19:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd557d3d-7205-52b5-88db-ba8d064fc442 with scrape type 1
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item fd557d3d-7205-52b5-88db-ba8d064fc442
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item fd557d3d-7205-52b5-88db-ba8d064fc442
2025-12-02 19:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fd557d3d-7205-52b5-88db-ba8d064fc442, identifier: 117702797
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117600051, 'registration': 'LH16DXA', 'account': 'WIL004', 'make': 'HYUNDAI', 'model': 'TUCSON DIESEL ESTATE', 'derivative': '2.0 CRDi 185 Premium SE 5dr', 'mileage': 56595, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-08', 'fuel': 'Diesel', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117600051, 'registration': 'LH16DXA', 'account': 'WIL004', 'make': 'HYUNDAI', 'model': 'TUCSON DIESEL ESTATE', 'derivative': '2.0 CRDi 185 Premium SE 5dr', 'mileage': 56595, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 177}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-08', 'fuel': 'Diesel', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf4e4d0-cd7c-5853-a090-52ac6a404d0b with identifier: 117600051
2025-12-02 19:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf4e4d0-cd7c-5853-a090-52ac6a404d0b with scrape type 1
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item bbf4e4d0-cd7c-5853-a090-52ac6a404d0b
2025-12-02 19:08:30 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item bbf4e4d0-cd7c-5853-a090-52ac6a404d0b
2025-12-02 19:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bbf4e4d0-cd7c-5853-a090-52ac6a404d0b, identifier: 117600051
2025-12-02 19:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/32220310-e352-4cb1-910c-1759daca1a0a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F2f4c97fb-e02f-48da-b564-091def29b5b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/2f4c97fb-e02f-48da-b564-091def29b5b3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F1f2dca70-5322-49ea-bd5a-2eed581a0e5d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1f2dca70-5322-49ea-bd5a-2eed581a0e5d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 606c334b-f187-5ad5-ba9c-a24bff686768 with identifier: 117547832
2025-12-02 19:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 606c334b-f187-5ad5-ba9c-a24bff686768 with identifier: 117547832
2025-12-02 19:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168682 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168682
2025-12-02 19:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 606c334b-f187-5ad5-ba9c-a24bff686768 spider: astonbarclay.gb
2025-12-02 19:08:31 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 606c334b-f187-5ad5-ba9c-a24bff686768 due to rule: high_mileage_for_country.json, error: 168682 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168682
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '606c334b-f187-5ad5-ba9c-a24bff686768',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NX66XEO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117547832',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'MONDEO DIESEL HATCHBACK',
 'odometer': 104815,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-16',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD MONDEO DIESEL HATCHBACK 1.5 TDCi ECOnetic Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi ECOnetic Zetec 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547832%27 HTTP/1.1" 200 None
2025-12-02 19:08:31 [astonbarclay.gb] INFO: Saving data for 117547832: {'auction_closing_time': 1765285200.0, 'created_time': 1764615709.214798, 'last_price_update_time': 1764702511.701014}
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117547832') HTTP/1.1" 204 0
2025-12-02 19:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7574627c-47b6-5a52-b89b-c70eb95eca3f with identifier: 117604347
2025-12-02 19:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7574627c-47b6-5a52-b89b-c70eb95eca3f with identifier: 117604347
2025-12-02 19:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7574627c-47b6-5a52-b89b-c70eb95eca3f with identifier: 117604347 to the API
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277574627c-47b6-5a52-b89b-c70eb95eca3f%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7574627c-47b6-5a52-b89b-c70eb95eca3f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:08:31 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117604347?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7574627c-47b6-5a52-b89b-c70eb95eca3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN70ZWD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117604347',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLVO',
 'model': 'XC90 DIESEL ESTATE',
 'odometer': 62979,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-30',
 'seller_name': 'Hatfields Group',
 'title': 'VOLVO XC90 DIESEL ESTATE 2.0 B5D [235] R DESIGN Pro 5dr AWD '
          'Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 B5D [235] R DESIGN Pro 5dr AWD Geartronic',
 'vin': None,
 'year': 2020}
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117604347%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [astonbarclay.gb] INFO: Saving data for 117604347: {'auction_closing_time': 1765285200.0, 'created_time': 1764356650.587786, 'last_price_update_time': 1764702512.106546}
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117604347') HTTP/1.1" 204 0
2025-12-02 19:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fd557d3d-7205-52b5-88db-ba8d064fc442 with identifier: 117702797
2025-12-02 19:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fd557d3d-7205-52b5-88db-ba8d064fc442 with identifier: 117702797
2025-12-02 19:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fd557d3d-7205-52b5-88db-ba8d064fc442 with identifier: 117702797 to the API
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fd557d3d-7205-52b5-88db-ba8d064fc442%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fd557d3d-7205-52b5-88db-ba8d064fc442: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:08:32 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117702797?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'fd557d3d-7205-52b5-88db-ba8d064fc442',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BV18VKU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117702797',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 54494,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-08',
 'seller_name': 'Wilsons',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T Tekna 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.2 DiG-T Tekna 5dr Xtronic',
 'vin': None,
 'year': 2018}
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702797%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [astonbarclay.gb] INFO: Saving data for 117702797: {'created_time': 1764702512.388667, 'last_price_update_time': 1764702512.388681, 'auction_closing_time': 1765359900.0}
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117702797') HTTP/1.1" 204 0
2025-12-02 19:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bbf4e4d0-cd7c-5853-a090-52ac6a404d0b with identifier: 117600051
2025-12-02 19:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bbf4e4d0-cd7c-5853-a090-52ac6a404d0b with identifier: 117600051
2025-12-02 19:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bbf4e4d0-cd7c-5853-a090-52ac6a404d0b with identifier: 117600051 to the API
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27bbf4e4d0-cd7c-5853-a090-52ac6a404d0b%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id bbf4e4d0-cd7c-5853-a090-52ac6a404d0b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:08:32 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117600051?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'bbf4e4d0-cd7c-5853-a090-52ac6a404d0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LH16DXA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600051',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'HYUNDAI',
 'model': 'TUCSON DIESEL ESTATE',
 'odometer': 56595,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-08',
 'seller_name': 'Wilsons',
 'title': 'HYUNDAI TUCSON DIESEL ESTATE 2.0 CRDi 185 Premium SE 5dr',
 'transmission': 'manual',
 'trim': '2.0 CRDi 185 Premium SE 5dr',
 'vin': None,
 'year': 2016}
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600051%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [astonbarclay.gb] INFO: Saving data for 117600051: {'created_time': 1764702512.696895, 'last_price_update_time': 1764702512.696906, 'auction_closing_time': 1765359900.0}
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117600051') HTTP/1.1" 204 0
2025-12-02 19:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD71YTL/2025-11-20/image/080a0c5c-b2cd-4f0a-8996-d581bc47c3b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117359464?view=catalogue)
2025-12-02 19:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/731ea754-dbbe-4311-9757-2d8216a99cbe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD71YTL/2025-11-20/image/6e9bce92-62c4-4e0b-a14a-f7432af799b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117359464?view=catalogue)
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252Fe7dcfac1-d52e-4a8a-b726-179ca4ddd8eb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/e7dcfac1-d52e-4a8a-b726-179ca4ddd8eb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Ff4e4182e-b2f3-489d-a06b-5f93ca5a67ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f4e4182e-b2f3-489d-a06b-5f93ca5a67ad_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/6f05494d-e744-4744-941d-b42e9bfe9fae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD71YTL/2025-11-20/image/32a11743-173f-45f8-aebf-8a3f0ac7a228_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117359464?view=catalogue)
2025-12-02 19:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/48807c88-3330-4c93-877a-8e18fb20252d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue)
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F4fe47211-8ad2-47c4-8983-e032609d097d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/4fe47211-8ad2-47c4-8983-e032609d097d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252Fad7baace-55eb-46d6-9b4c-d8c0c0d3ee89_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/ad7baace-55eb-46d6-9b4c-d8c0c0d3ee89_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252F5be7962e-7940-40fd-9e68-1b108ee5f1a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/5be7962e-7940-40fd-9e68-1b108ee5f1a9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Fb0f454bc-00ca-4446-810c-07e50467f0e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/b0f454bc-00ca-4446-810c-07e50467f0e5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0831e50>
2025-12-02 19:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F1e5039b0-53f6-4099-a140-3a38a1e6babe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e5039b0-53f6-4099-a140-3a38a1e6babe_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09cc310>
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F81f46ce4-4b42-4eaa-9623-148eb662c195_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/81f46ce4-4b42-4eaa-9623-148eb662c195_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d58ba83b-4489-52c5-b56c-2b235c97c8be
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ff190>
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Ff34cd200-8a22-41b2-89d6-1e8b6f0c5228_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/f34cd200-8a22-41b2-89d6-1e8b6f0c5228_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71483516-b9d5-594e-82f5-ffef2099fd34
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0745050>
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F2df7c900-c65c-4820-a959-3734acfcf56d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/2df7c900-c65c-4820-a959-3734acfcf56d_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ab5250>
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F458bed60-eaaa-4a29-8868-66e3ab456acb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/458bed60-eaaa-4a29-8868-66e3ab456acb_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ebc548a-8426-52af-a925-2e350152f83b
2025-12-02 19:08:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117447701, 'registration': 'YF72AXJ', 'account': 'ZEN009', 'make': 'VOLKSWAGEN', 'model': 'UP ELECTRIC HATCHBACK', 'derivative': '60kW E-Up 32kWh 5dr Auto', 'mileage': 30278, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/d946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/f5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 09/24- 18K, 09/25- 28K,', 'remarks': '**830**VOSA STATE 29K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f14a92b1-28dd-494b-b906-061bfa28cd64.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117447701, 'registration': 'YF72AXJ', 'account': 'ZEN009', 'make': 'VOLKSWAGEN', 'model': 'UP ELECTRIC HATCHBACK', 'derivative': '60kW E-Up 32kWh 5dr Auto', 'mileage': 30278, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-30', 'fuel': 'Electric', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/d946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/f5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 09/24- 18K, 09/25- 28K,', 'remarks': '**830**VOSA STATE 29K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f14a92b1-28dd-494b-b906-061bfa28cd64.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af5c760b-4d53-552a-8ef1-f2c30d77e16e with identifier: 117447701
2025-12-02 19:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5c760b-4d53-552a-8ef1-f2c30d77e16e with scrape type 1
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item af5c760b-4d53-552a-8ef1-f2c30d77e16e
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117417496, 'registration': 'BJ71AVR', 'account': 'ZEN009', 'make': 'CUPRA', 'model': 'LEON HATCHBACK', 'derivative': '1.4 eHybrid VZ2 5dr DSG', 'mileage': 16037, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-16', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/6c82771a-523f-4042-9d65-b58849af5757_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/7626b886-352e-45f7-bc53-804b8ddc9372_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/256aa757-985a-4720-934e-742e912edca8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/d30bed58-aecc-4ecb-9950-bc4b2b1090a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/de967e53-c9e6-4b7b-8066-c1eab377e53d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/94e458b3-601f-4340-a831-51d31bafa750_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/324ce1ce-580f-4ecf-b894-a130d7934e01_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/36e09e33-46d7-4632-8827-8f845cdbf7da_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/41cad555-f81b-42af-86b5-1ef17d23a75e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 06/24- 9K, 10/25- 15K,', 'remarks': '**956**VOSA STATES 11K, 15K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 30, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9e1b69fe-e561-4c75-9c36-eb2bd12e76e0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117417496, 'registration': 'BJ71AVR', 'account': 'ZEN009', 'make': 'CUPRA', 'model': 'LEON HATCHBACK', 'derivative': '1.4 eHybrid VZ2 5dr DSG', 'mileage': 16037, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-16', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/6c82771a-523f-4042-9d65-b58849af5757_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/7626b886-352e-45f7-bc53-804b8ddc9372_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/256aa757-985a-4720-934e-742e912edca8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/d30bed58-aecc-4ecb-9950-bc4b2b1090a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/de967e53-c9e6-4b7b-8066-c1eab377e53d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/94e458b3-601f-4340-a831-51d31bafa750_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/324ce1ce-580f-4ecf-b894-a130d7934e01_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/36e09e33-46d7-4632-8827-8f845cdbf7da_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/41cad555-f81b-42af-86b5-1ef17d23a75e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 06/24- 9K, 10/25- 15K,', 'remarks': '**956**VOSA STATES 11K, 15K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 30, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9e1b69fe-e561-4c75-9c36-eb2bd12e76e0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14a89f04-36b4-56b0-be19-9a7421666389 with identifier: 117417496
2025-12-02 19:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14a89f04-36b4-56b0-be19-9a7421666389 with scrape type 1
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 14a89f04-36b4-56b0-be19-9a7421666389
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F6c82771a-523f-4042-9d65-b58849af5757_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/6c82771a-523f-4042-9d65-b58849af5757_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf072f450>
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F32220310-e352-4cb1-910c-1759daca1a0a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/32220310-e352-4cb1-910c-1759daca1a0a_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252Fedaf10d3-83c0-4a7c-ad6e-bf0a712645f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/edaf10d3-83c0-4a7c-ad6e-bf0a712645f2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252Fdca12231-3984-44a4-b4e0-abd7bfa84849_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/dca12231-3984-44a4-b4e0-abd7bfa84849_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72UFM/2025-12-02/image/48757d86-d566-4042-8270-d5c52066de6a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117524612?view=catalogue)
2025-12-02 19:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/e0473668-e405-4471-8e53-d1de844387f3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD71YTL/2025-11-20/image/d87d65c2-3c76-4d91-84ec-2ebf845fc04b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117359464?view=catalogue)
2025-12-02 19:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c020f32f-91e2-43bc-9a0f-96e090bbaa63_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457056?view=catalogue)
2025-12-02 19:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE72NYL/2025-12-02/image/9d80adad-17fe-41ff-bfe7-67502f0b5a5f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117100813?view=catalogue)
2025-12-02 19:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY71UNL/2025-11-28/image/65fe797d-571c-401d-8a22-e78b5ddad78f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508301?view=catalogue)
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252Fa9b72878-c3d7-47a8-accf-8b1eacff918b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a9b72878-c3d7-47a8-accf-8b1eacff918b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Fc905bf93-689c-403b-8cef-16e6a803e89a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c905bf93-689c-403b-8cef-16e6a803e89a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F7626b886-352e-45f7-bc53-804b8ddc9372_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/7626b886-352e-45f7-bc53-804b8ddc9372_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD71YTL/2025-11-20/image/2f4c97fb-e02f-48da-b564-091def29b5b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117359464?view=catalogue)
2025-12-02 19:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1f2dca70-5322-49ea-bd5a-2eed581a0e5d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/5e8532b9-d076-4f2a-9972-ce9b6f6ab14a.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626788?view=catalogue)
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F124aae53-fbbc-4ad2-9537-bce2f40a48dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/124aae53-fbbc-4ad2-9537-bce2f40a48dd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F33e708b3-92fc-470b-8198-707232509853_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/33e708b3-92fc-470b-8198-707232509853_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1fdf850>
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F080a0c5c-b2cd-4f0a-8996-d581bc47c3b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/080a0c5c-b2cd-4f0a-8996-d581bc47c3b9_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d58ba83b-4489-52c5-b56c-2b235c97c8be
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03e0910>
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F731ea754-dbbe-4311-9757-2d8216a99cbe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/731ea754-dbbe-4311-9757-2d8216a99cbe_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf031b550>
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F6e9bce92-62c4-4e0b-a14a-f7432af799b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/6e9bce92-62c4-4e0b-a14a-f7432af799b0_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d58ba83b-4489-52c5-b56c-2b235c97c8be
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04ddf10>
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F6f05494d-e744-4744-941d-b42e9bfe9fae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/6f05494d-e744-4744-941d-b42e9bfe9fae_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0693c50>
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F32a11743-173f-45f8-aebf-8a3f0ac7a228_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/32a11743-173f-45f8-aebf-8a3f0ac7a228_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d58ba83b-4489-52c5-b56c-2b235c97c8be
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf069f950>
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F48807c88-3330-4c93-877a-8e18fb20252d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/48807c88-3330-4c93-877a-8e18fb20252d_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252Fed2156b0-32c4-4323-b650-6c4a5e860a5e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/ed2156b0-32c4-4323-b650-6c4a5e860a5e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Ff8e702c2-06e2-4fa1-8ece-75510e0380ba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f8e702c2-06e2-4fa1-8ece-75510e0380ba_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F256aa757-985a-4720-934e-742e912edca8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/256aa757-985a-4720-934e-742e912edca8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a4c605c3-a447-43ab-bf94-8e770c588f8c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626788?view=catalogue)
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F935ce31f-3989-4c9a-a00d-d2851ee934a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/935ce31f-3989-4c9a-a00d-d2851ee934a5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F1c1386d4-3a4f-444a-afd2-10909d6fb461_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1c1386d4-3a4f-444a-afd2-10909d6fb461_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252Ffb6afe43-ae86-4e3f-a5d2-d83e2bbf7666_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/fb6afe43-ae86-4e3f-a5d2-d83e2bbf7666_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252F12096044-f373-42e5-9879-13e75c49c310_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/12096044-f373-42e5-9879-13e75c49c310_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252Fd30bed58-aecc-4ecb-9950-bc4b2b1090a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/d30bed58-aecc-4ecb-9950-bc4b2b1090a2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07cf550>
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252F48757d86-d566-4042-8270-d5c52066de6a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/48757d86-d566-4042-8270-d5c52066de6a_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0629350>
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252Fe0473668-e405-4471-8e53-d1de844387f3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/e0473668-e405-4471-8e53-d1de844387f3_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a7ec10>
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252Fd87d65c2-3c76-4d91-84ec-2ebf845fc04b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/d87d65c2-3c76-4d91-84ec-2ebf845fc04b_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d58ba83b-4489-52c5-b56c-2b235c97c8be
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066a510>
2025-12-02 19:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Fc020f32f-91e2-43bc-9a0f-96e090bbaa63_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c020f32f-91e2-43bc-9a0f-96e090bbaa63_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0635e90>
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE72NYL%252F2025-12-02%252Fimage%252F9d80adad-17fe-41ff-bfe7-67502f0b5a5f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE72NYL/2025-12-02/image/9d80adad-17fe-41ff-bfe7-67502f0b5a5f_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c
2025-12-02 19:08:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12a56f48-06e8-57f9-aff2-c4a0c00fa35c, skipping ID generation
2025-12-02 19:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c with scrape type 1
2025-12-02 19:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c from tracking dictionaries
2025-12-02 19:08:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12a56f48-06e8-57f9-aff2-c4a0c00fa35c sending to next pipeline
2025-12-02 19:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 12a56f48-06e8-57f9-aff2-c4a0c00fa35c, identifier: 117100813
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08cb9d0>
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY71UNL%252F2025-11-28%252Fimage%252F65fe797d-571c-401d-8a22-e78b5ddad78f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY71UNL/2025-11-28/image/65fe797d-571c-401d-8a22-e78b5ddad78f_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ebc548a-8426-52af-a925-2e350152f83b
2025-12-02 19:08:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ebc548a-8426-52af-a925-2e350152f83b, skipping ID generation
2025-12-02 19:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ebc548a-8426-52af-a925-2e350152f83b with scrape type 1
2025-12-02 19:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1ebc548a-8426-52af-a925-2e350152f83b from tracking dictionaries
2025-12-02 19:08:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ebc548a-8426-52af-a925-2e350152f83b sending to next pipeline
2025-12-02 19:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1ebc548a-8426-52af-a925-2e350152f83b, identifier: 117508301
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07a8410>
2025-12-02 19:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F2f4c97fb-e02f-48da-b564-091def29b5b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/2f4c97fb-e02f-48da-b564-091def29b5b3_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d58ba83b-4489-52c5-b56c-2b235c97c8be
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0832110>
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F1f2dca70-5322-49ea-bd5a-2eed581a0e5d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1f2dca70-5322-49ea-bd5a-2eed581a0e5d_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0319610>
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b6e6ff-3ccc-5534-8f05-3cdca20dbd96/76b6e6ff-3ccc-5534-8f05-3cdca20dbd96_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F5e8532b9-d076-4f2a-9972-ce9b6f6ab14a.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5e8532b9-d076-4f2a-9972-ce9b6f6ab14a.jpg?w=600 saved to cache
2025-12-02 19:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96
2025-12-02 19:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/dca12231-3984-44a4-b4e0-abd7bfa84849_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447701?view=catalogue)
2025-12-02 19:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD71YTL/2025-11-20/image/edaf10d3-83c0-4a7c-ad6e-bf0a712645f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117359464?view=catalogue)
2025-12-02 19:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/6c82771a-523f-4042-9d65-b58849af5757_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117417496?view=catalogue)
2025-12-02 19:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/ad7baace-55eb-46d6-9b4c-d8c0c0d3ee89_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KS22TTE/2025-12-01/image/b0f454bc-00ca-4446-810c-07e50467f0e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457056?view=catalogue)
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F1e990bee-4a00-412f-82a9-9814a37dd698_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e990bee-4a00-412f-82a9-9814a37dd698_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 12a56f48-06e8-57f9-aff2-c4a0c00fa35c with identifier: 117100813
2025-12-02 19:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 12a56f48-06e8-57f9-aff2-c4a0c00fa35c with identifier: 117100813
2025-12-02 19:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 12a56f48-06e8-57f9-aff2-c4a0c00fa35c with identifier: 117100813 to the API
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YE72NYL/2025-12-02/image/9d80adad-17fe-41ff-bfe7-67502f0b5a5f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '12a56f48-06e8-57f9-aff2-c4a0c00fa35c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YE72NYL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117100813',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 28466,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23151,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/7f2ad809-16aa-4677-8fd3-e0e1a668ba71_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22526,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/18bee46c-db9d-433e-83ed-13d54addfa22_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22520,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/45997e16-9fc0-4f07-bb79-dfef7a73a1d0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22902,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/53c43ca1-0bd7-449c-9d50-ad3a4e12b3b6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44201,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/d14bfdba-1b74-41fc-bfc4-9228eebee364_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46275,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/0c055c06-b7a4-4036-8d52-3d6b5014e334_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35026,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/9d80adad-17fe-41ff-bfe7-67502f0b5a5f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37632,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/707d7481-d731-4fb1-a624-ae7493bd9b39_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12a56f48-06e8-57f9-aff2-c4a0c00fa35c/12a56f48-06e8-57f9-aff2-c4a0c00fa35c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40409,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YE72NYL/2025-12-02/image/2df7c900-c65c-4820-a959-3734acfcf56d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-06',
 'seller_name': 'Zenith',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH Acenta Premium 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100813%27 HTTP/1.1" 200 None
2025-12-02 19:08:39 [astonbarclay.gb] INFO: Saving data for 117100813: {'created_time': 1764702519.014702, 'last_price_update_time': 1764702519.014712, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117100813') HTTP/1.1" 204 0
2025-12-02 19:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1ebc548a-8426-52af-a925-2e350152f83b with identifier: 117508301
2025-12-02 19:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1ebc548a-8426-52af-a925-2e350152f83b with identifier: 117508301
2025-12-02 19:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1ebc548a-8426-52af-a925-2e350152f83b with identifier: 117508301 to the API
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DY71UNL/2025-11-28/image/65fe797d-571c-401d-8a22-e78b5ddad78f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '1ebc548a-8426-52af-a925-2e350152f83b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DY71UNL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117508301',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 55645,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32571,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/488bfaf0-8fc1-47ed-b585-f0b182b2df9f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32105,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/201ea98e-db24-45de-b34b-143137bb992e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37917,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/4c40585e-af97-4827-8fb5-ad649d3d6022_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36376,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/65fe797d-571c-401d-8a22-e78b5ddad78f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33291,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/10b797fa-8f94-48af-ade0-a4634b33e4be_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61277,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/458bed60-eaaa-4a29-8868-66e3ab456acb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58899,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/b66f6932-1dda-4ed4-8f71-08fdd27df132_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46292,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/c17695d0-fba7-4590-b137-4c0e5d6cef34_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc548a-8426-52af-a925-2e350152f83b/1ebc548a-8426-52af-a925-2e350152f83b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52018,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY71UNL/2025-11-28/image/8c2d1c70-ab10-474f-9c5d-c036b4ab2b33_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seller_name': 'Zenith',
 'title': 'FORD KUGA ESTATE 2.5 PHEV ST-Line X Edition 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 PHEV ST-Line X Edition 5dr CVT',
 'vin': None,
 'year': 2021}
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508301%27 HTTP/1.1" 200 None
2025-12-02 19:08:39 [astonbarclay.gb] INFO: Saving data for 117508301: {'created_time': 1764702519.391183, 'last_price_update_time': 1764702519.391194, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117508301') HTTP/1.1" 204 0
2025-12-02 19:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/a74c7deb-8d40-4843-bbc9-dcb2cb372f94_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446881?view=catalogue)
2025-12-02 19:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72UFM/2025-12-02/image/5be7962e-7940-40fd-9e68-1b108ee5f1a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117524612?view=catalogue)
2025-12-02 19:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/d5d0acb8-ebc2-4353-9afa-9f114b40daa4.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626788?view=catalogue)
2025-12-02 19:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/cf80bd86-7ec7-4d72-b2fe-44ceaa7bb3ce.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117626788?view=catalogue)
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252Fa7e919a9-b8a0-48e9-861d-d01defbb931f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a7e919a9-b8a0-48e9-861d-d01defbb931f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252F7fe51d39-8580-4169-b3b2-86dfa17fd656_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fe51d39-8580-4169-b3b2-86dfa17fd656_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252Fde967e53-c9e6-4b7b-8066-c1eab377e53d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/de967e53-c9e6-4b7b-8066-c1eab377e53d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116884737?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117491214?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116832725?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0511110>
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b6e6ff-3ccc-5534-8f05-3cdca20dbd96/76b6e6ff-3ccc-5534-8f05-3cdca20dbd96_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa4c605c3-a447-43ab-bf94-8e770c588f8c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a4c605c3-a447-43ab-bf94-8e770c588f8c.jpg?w=600 saved to cache
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252Ff51925ed-9194-4b1f-9ad0-a4ca23aa122a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/f51925ed-9194-4b1f-9ad0-a4ca23aa122a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252F0cd57591-05d1-4e72-9dcb-ff1670263d10_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/0cd57591-05d1-4e72-9dcb-ff1670263d10_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252F2fe0b2c3-2838-48d1-9b10-02c6626f15aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/2fe0b2c3-2838-48d1-9b10-02c6626f15aa_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F94e458b3-601f-4340-a831-51d31bafa750_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/94e458b3-601f-4340-a831-51d31bafa750_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf044d1d0>
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252Fdca12231-3984-44a4-b4e0-abd7bfa84849_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/dca12231-3984-44a4-b4e0-abd7bfa84849_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09b9490>
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af5c760b-4d53-552a-8ef1-f2c30d77e16e
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0aa7f50>
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252Fedaf10d3-83c0-4a7c-ad6e-bf0a712645f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/edaf10d3-83c0-4a7c-ad6e-bf0a712645f2_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d58ba83b-4489-52c5-b56c-2b235c97c8be
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09bb790>
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F6c82771a-523f-4042-9d65-b58849af5757_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/6c82771a-523f-4042-9d65-b58849af5757_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14a89f04-36b4-56b0-be19-9a7421666389
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0939250>
2025-12-02 19:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252Fad7baace-55eb-46d6-9b4c-d8c0c0d3ee89_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/ad7baace-55eb-46d6-9b4c-d8c0c0d3ee89_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08e9e50>
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Fb0f454bc-00ca-4446-810c-07e50467f0e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/b0f454bc-00ca-4446-810c-07e50467f0e5_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf096b590>
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Fa74c7deb-8d40-4843-bbc9-dcb2cb372f94_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/a74c7deb-8d40-4843-bbc9-dcb2cb372f94_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71483516-b9d5-594e-82f5-ffef2099fd34
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04f9e90>
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252F5be7962e-7940-40fd-9e68-1b108ee5f1a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/5be7962e-7940-40fd-9e68-1b108ee5f1a9_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf031fdd0>
2025-12-02 19:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b6e6ff-3ccc-5534-8f05-3cdca20dbd96/76b6e6ff-3ccc-5534-8f05-3cdca20dbd96_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fd5d0acb8-ebc2-4353-9afa-9f114b40daa4.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d5d0acb8-ebc2-4353-9afa-9f114b40daa4.jpg?w=600 saved to cache
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96
2025-12-02 19:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04fa550>
2025-12-02 19:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b6e6ff-3ccc-5534-8f05-3cdca20dbd96/76b6e6ff-3ccc-5534-8f05-3cdca20dbd96_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fcf80bd86-7ec7-4d72-b2fe-44ceaa7bb3ce.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/cf80bd86-7ec7-4d72-b2fe-44ceaa7bb3ce.jpg?w=600 saved to cache
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96
2025-12-02 19:08:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96, skipping ID generation
2025-12-02 19:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96 with scrape type 1
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96 from tracking dictionaries
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96 sending to next pipeline
2025-12-02 19:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96, identifier: 117626788
2025-12-02 19:08:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116884737, 'registration': 'DV73WYG', 'account': 'ZEN002', 'make': 'VOLVO', 'model': 'XC60 ESTATE', 'derivative': '2.0 B5P Ultimate Dark 5dr AWD Geartronic', 'mileage': 7646, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-02-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV73WYG/2025-11-27/image/bfb88551-7ac3-4866-bfda-76f192bb307e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/5317c5f0-0b53-413e-8a6c-4e9ec7424372_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/9b6de8b4-66c1-437d-abd6-4148baed33c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/c144689d-f68d-4c0a-b6ee-11bf8e104589_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/975e5c8e-c703-4834-9b5f-8d8ab6c89387_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/a3b66de3-f05e-47dd-9b8b-53368d26e06f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/db4ce05a-f8ce-40e0-9bad-f7db335a0075_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/ac274279-59e2-442d-a5db-af92aa26190b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/826624f3-c397-4ddd-a2d2-3d4856f7b861_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/9246bbd9-4c01-437f-ab1d-56d4b2fcabad_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/25-6K', 'remarks': '**731** SPARE KEY Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 185, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8de65194-7672-424d-b270-7b104a15ac87.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116884737, 'registration': 'DV73WYG', 'account': 'ZEN002', 'make': 'VOLVO', 'model': 'XC60 ESTATE', 'derivative': '2.0 B5P Ultimate Dark 5dr AWD Geartronic', 'mileage': 7646, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-02-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV73WYG/2025-11-27/image/bfb88551-7ac3-4866-bfda-76f192bb307e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/5317c5f0-0b53-413e-8a6c-4e9ec7424372_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/9b6de8b4-66c1-437d-abd6-4148baed33c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/c144689d-f68d-4c0a-b6ee-11bf8e104589_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/975e5c8e-c703-4834-9b5f-8d8ab6c89387_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/a3b66de3-f05e-47dd-9b8b-53368d26e06f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/db4ce05a-f8ce-40e0-9bad-f7db335a0075_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/ac274279-59e2-442d-a5db-af92aa26190b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/826624f3-c397-4ddd-a2d2-3d4856f7b861_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/9246bbd9-4c01-437f-ab1d-56d4b2fcabad_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/25-6K', 'remarks': '**731** SPARE KEY Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 185, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8de65194-7672-424d-b270-7b104a15ac87.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39d63a91-5eb6-56e4-a233-b410c801bc54 with identifier: 116884737
2025-12-02 19:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39d63a91-5eb6-56e4-a233-b410c801bc54 with scrape type 2
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39d63a91-5eb6-56e4-a233-b410c801bc54 with scrape type 2
2025-12-02 19:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 39d63a91-5eb6-56e4-a233-b410c801bc54, identifier: 116884737
2025-12-02 19:08:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117491214, 'registration': 'SN71VCZ', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW Sport 80kWh 5dr Auto', 'mileage': 64201, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-07', 'fuel': 'Electric', 'motExpiry': '2025-12-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/22 - 15K, 12/23 - 28K, 10/24 - 43K, 07/25 - 58K', 'remarks': '**960**VOSA STATES 47K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3247b6cd-1822-46d4-9541-c9e2b140b329.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117491214, 'registration': 'SN71VCZ', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW Sport 80kWh 5dr Auto', 'mileage': 64201, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-07', 'fuel': 'Electric', 'motExpiry': '2025-12-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/22 - 15K, 12/23 - 28K, 10/24 - 43K, 07/25 - 58K', 'remarks': '**960**VOSA STATES 47K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3247b6cd-1822-46d4-9541-c9e2b140b329.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f327b62c-8ae3-540a-a75b-0cad22be2279 with identifier: 117491214
2025-12-02 19:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f327b62c-8ae3-540a-a75b-0cad22be2279 with scrape type 2
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f327b62c-8ae3-540a-a75b-0cad22be2279 with scrape type 2
2025-12-02 19:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f327b62c-8ae3-540a-a75b-0cad22be2279, identifier: 117491214
2025-12-02 19:08:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116832725, 'registration': 'MJ71YYH', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 51929, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-20', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/e1f2a5b1-25cc-4b26-90ae-927c23ce24a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/5bcfce37-adbd-4904-b8ed-42444e4d3ec9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/5b3f9e01-4611-4e6f-a892-a72fb8e437c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/77275e62-673a-47e6-a2eb-37c616b41eab_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/96442a70-7a84-49b2-b090-ebd9065cbded_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/ada7f348-62c3-4a8d-8fac-8cc7c0f435c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/3fc3f528-d4e5-4b92-a3f5-a54ee6c7a716_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/f25b9ec2-3920-4a88-8249-dd66a5f5ce4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/e3fd389f-6dcc-4f55-989d-914dcb6d8ff3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/d53b4f27-5049-4168-b046-3111f523b43d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24- 35K, 10/25- 49K', 'remarks': '**770**VOSA STATES 35K, 49K SPARE KEY   \t Solid Paint, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/07e758a2-7d13-457c-9983-1857b087d111.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116832725, 'registration': 'MJ71YYH', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 51929, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-20', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/e1f2a5b1-25cc-4b26-90ae-927c23ce24a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/5bcfce37-adbd-4904-b8ed-42444e4d3ec9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/5b3f9e01-4611-4e6f-a892-a72fb8e437c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/77275e62-673a-47e6-a2eb-37c616b41eab_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/96442a70-7a84-49b2-b090-ebd9065cbded_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/ada7f348-62c3-4a8d-8fac-8cc7c0f435c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/3fc3f528-d4e5-4b92-a3f5-a54ee6c7a716_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/f25b9ec2-3920-4a88-8249-dd66a5f5ce4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/e3fd389f-6dcc-4f55-989d-914dcb6d8ff3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/d53b4f27-5049-4168-b046-3111f523b43d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24- 35K, 10/25- 49K', 'remarks': '**770**VOSA STATES 35K, 49K SPARE KEY   \t Solid Paint, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/07e758a2-7d13-457c-9983-1857b087d111.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbc5d71c-e761-56cc-ba45-efddbe7eb208 with identifier: 116832725
2025-12-02 19:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbc5d71c-e761-56cc-ba45-efddbe7eb208 with scrape type 2
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbc5d71c-e761-56cc-ba45-efddbe7eb208 with scrape type 2
2025-12-02 19:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dbc5d71c-e761-56cc-ba45-efddbe7eb208, identifier: 116832725
2025-12-02 19:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/33e708b3-92fc-470b-8198-707232509853_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f4e4182e-b2f3-489d-a06b-5f93ca5a67ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457056?view=catalogue)
2025-12-02 19:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD71YTL/2025-11-20/image/4fe47211-8ad2-47c4-8983-e032609d097d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117359464?view=catalogue)
2025-12-02 19:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1c1386d4-3a4f-444a-afd2-10909d6fb461_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KS22TTE/2025-12-01/image/12096044-f373-42e5-9879-13e75c49c310_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457056?view=catalogue)
2025-12-02 19:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447701?view=catalogue)
2025-12-02 19:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/d30bed58-aecc-4ecb-9950-bc4b2b1090a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117417496?view=catalogue)
2025-12-02 19:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72UFM/2025-12-02/image/fb6afe43-ae86-4e3f-a5d2-d83e2bbf7666_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117524612?view=catalogue)
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252F6a79a172-50b3-4838-aefc-0a5f06a9f7b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/6a79a172-50b3-4838-aefc-0a5f06a9f7b0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252F7fae927f-21d1-4da0-8e1a-e94865dfffb9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fae927f-21d1-4da0-8e1a-e94865dfffb9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252Fd946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/d946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F324ce1ce-580f-4ecf-b894-a130d7934e01_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/324ce1ce-580f-4ecf-b894-a130d7934e01_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96 with identifier: 117626788
2025-12-02 19:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96 with identifier: 117626788
2025-12-02 19:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 76b6e6ff-3ccc-5534-8f05-3cdca20dbd96 with identifier: 117626788 to the API
2025-12-02 19:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/cf80bd86-7ec7-4d72-b2fe-44ceaa7bb3ce.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '76b6e6ff-3ccc-5534-8f05-3cdca20dbd96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KX72HMJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117626788',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FIAT',
 'model': '500 HATCHBACK',
 'odometer': 5508,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b6e6ff-3ccc-5534-8f05-3cdca20dbd96/76b6e6ff-3ccc-5534-8f05-3cdca20dbd96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83264,
             'Height': 442,
             'OriginUrl': 'https://abimg002.imgix.net/5e8532b9-d076-4f2a-9972-ce9b6f6ab14a.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b6e6ff-3ccc-5534-8f05-3cdca20dbd96/76b6e6ff-3ccc-5534-8f05-3cdca20dbd96_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76845,
             'Height': 442,
             'OriginUrl': 'https://abimg002.imgix.net/cf80bd86-7ec7-4d72-b2fe-44ceaa7bb3ce.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b6e6ff-3ccc-5534-8f05-3cdca20dbd96/76b6e6ff-3ccc-5534-8f05-3cdca20dbd96_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63329,
             'Height': 442,
             'OriginUrl': 'https://abimg002.imgix.net/a4c605c3-a447-43ab-bf94-8e770c588f8c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b6e6ff-3ccc-5534-8f05-3cdca20dbd96/76b6e6ff-3ccc-5534-8f05-3cdca20dbd96_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68028,
             'Height': 442,
             'OriginUrl': 'https://abimg002.imgix.net/d5d0acb8-ebc2-4353-9afa-9f114b40daa4.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-22',
 'seller_name': 'Hedin Automotive Mini',
 'title': 'FIAT 500 HATCHBACK 1.0 Mild Hybrid Dolcevita [Part Leather] 3dr',
 'transmission': 'manual',
 'trim': '1.0 Mild Hybrid Dolcevita [Part Leather] 3dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117626788%27 HTTP/1.1" 200 None
2025-12-02 19:08:43 [astonbarclay.gb] INFO: Saving data for 117626788: {'created_time': 1764702523.217207, 'last_price_update_time': 1764702523.217217, 'auction_closing_time': 1765360800.0}
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117626788') HTTP/1.1" 204 0
2025-12-02 19:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 39d63a91-5eb6-56e4-a233-b410c801bc54 with identifier: 116884737
2025-12-02 19:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 39d63a91-5eb6-56e4-a233-b410c801bc54 with identifier: 116884737
2025-12-02 19:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 39d63a91-5eb6-56e4-a233-b410c801bc54 with identifier: 116884737 to the API
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2739d63a91-5eb6-56e4-a233-b410c801bc54%27 HTTP/1.1" 200 None
2025-12-02 19:08:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 39d63a91-5eb6-56e4-a233-b410c801bc54: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:08:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116884737?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '39d63a91-5eb6-56e4-a233-b410c801bc54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV73WYG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116884737',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLVO',
 'model': 'XC60 ESTATE',
 'odometer': 7646,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-13',
 'seller_name': 'Zenith',
 'title': 'VOLVO XC60 ESTATE 2.0 B5P Ultimate Dark 5dr AWD Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 B5P Ultimate Dark 5dr AWD Geartronic',
 'vin': None,
 'year': 2024}
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116884737%27 HTTP/1.1" 200 None
2025-12-02 19:08:43 [astonbarclay.gb] INFO: Saving data for 116884737: {'auction_closing_time': 1764755100.0, 'created_time': 1763492829.457915, 'last_price_update_time': 1764702523.485991}
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116884737') HTTP/1.1" 204 0
2025-12-02 19:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f327b62c-8ae3-540a-a75b-0cad22be2279 with identifier: 117491214
2025-12-02 19:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f327b62c-8ae3-540a-a75b-0cad22be2279 with identifier: 117491214
2025-12-02 19:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 64201, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-07', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491214', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw sport 80kwh 5dr auto', 'license_plate': 'sn71vcz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f327b62c-8ae3-540a-a75b-0cad22be2279', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 103321} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': 'f327b62c-8ae3-540a-a75b-0cad22be2279',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'sn71vcz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491214',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 64201,
     'odometer_in_km': 103321,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-07',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'zenith',
     'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw sport 80kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: f327b62c-8ae3-540a-a75b-0cad22be2279 spider: astonbarclay.gb
2025-12-02 19:08:43 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f327b62c-8ae3-540a-a75b-0cad22be2279 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 64201, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-07', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491214', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw sport 80kwh 5dr auto', 'license_plate': 'sn71vcz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f327b62c-8ae3-540a-a75b-0cad22be2279', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 103321} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': 'f327b62c-8ae3-540a-a75b-0cad22be2279',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'sn71vcz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491214',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 64201,
     'odometer_in_km': 103321,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-07',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'zenith',
     'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw sport 80kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'f327b62c-8ae3-540a-a75b-0cad22be2279',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SN71VCZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491214',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 64201,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seller_name': 'Zenith',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW Sport 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW Sport 80kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491214%27 HTTP/1.1" 200 None
2025-12-02 19:08:43 [astonbarclay.gb] INFO: Saving data for 117491214: {'auction_closing_time': 1764755100.0, 'created_time': 1764270081.300419, 'last_price_update_time': 1764702523.692245}
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117491214') HTTP/1.1" 204 0
2025-12-02 19:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dbc5d71c-e761-56cc-ba45-efddbe7eb208 with identifier: 116832725
2025-12-02 19:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dbc5d71c-e761-56cc-ba45-efddbe7eb208 with identifier: 116832725
2025-12-02 19:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: dbc5d71c-e761-56cc-ba45-efddbe7eb208 with identifier: 116832725 to the API
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116832725?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'dbc5d71c-e761-56cc-ba45-efddbe7eb208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MJ71YYH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116832725',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 51929,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-20',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116832725%27 HTTP/1.1" 200 None
2025-12-02 19:08:43 [astonbarclay.gb] INFO: Saving data for 116832725: {'auction_closing_time': 1764755100.0, 'created_time': 1764147701.941899, 'last_price_update_time': 1764702523.965553}
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116832725') HTTP/1.1" 204 0
2025-12-02 19:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Fe2cc78ed-dafb-4437-9e3d-466169bb3993_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/e2cc78ed-dafb-4437-9e3d-466169bb3993_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252Ff5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/f5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F36e09e33-46d7-4632-8827-8f845cdbf7da_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/36e09e33-46d7-4632-8827-8f845cdbf7da_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f8e702c2-06e2-4fa1-8ece-75510e0380ba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457056?view=catalogue)
2025-12-02 19:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447701?view=catalogue)
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F41cad555-f81b-42af-86b5-1ef17d23a75e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/41cad555-f81b-42af-86b5-1ef17d23a75e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02fecd0>
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F33e708b3-92fc-470b-8198-707232509853_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/33e708b3-92fc-470b-8198-707232509853_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08cd950>
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Ff4e4182e-b2f3-489d-a06b-5f93ca5a67ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f4e4182e-b2f3-489d-a06b-5f93ca5a67ad_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c8b6d0>
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F4fe47211-8ad2-47c4-8983-e032609d097d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/4fe47211-8ad2-47c4-8983-e032609d097d_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d58ba83b-4489-52c5-b56c-2b235c97c8be
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08a2bd0>
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F1c1386d4-3a4f-444a-afd2-10909d6fb461_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1c1386d4-3a4f-444a-afd2-10909d6fb461_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf34e61d0>
2025-12-02 19:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252F12096044-f373-42e5-9879-13e75c49c310_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/12096044-f373-42e5-9879-13e75c49c310_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0437990>
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af5c760b-4d53-552a-8ef1-f2c30d77e16e
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08cd1d0>
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252Fd30bed58-aecc-4ecb-9950-bc4b2b1090a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/d30bed58-aecc-4ecb-9950-bc4b2b1090a2_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14a89f04-36b4-56b0-be19-9a7421666389
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf058b650>
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252Ffb6afe43-ae86-4e3f-a5d2-d83e2bbf7666_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/fb6afe43-ae86-4e3f-a5d2-d83e2bbf7666_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13
2025-12-02 19:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e990bee-4a00-412f-82a9-9814a37dd698_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD71YTL/2025-11-20/image/124aae53-fbbc-4ad2-9537-bce2f40a48dd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117359464?view=catalogue)
2025-12-02 19:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD71YTL/2025-11-20/image/935ce31f-3989-4c9a-a00d-d2851ee934a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117359464?view=catalogue)
2025-12-02 19:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/7626b886-352e-45f7-bc53-804b8ddc9372_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117417496?view=catalogue)
2025-12-02 19:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72UFM/2025-12-02/image/ed2156b0-32c4-4323-b650-6c4a5e860a5e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117524612?view=catalogue)
2025-12-02 19:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/256aa757-985a-4720-934e-742e912edca8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117417496?view=catalogue)
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b51d0>
2025-12-02 19:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Ff8e702c2-06e2-4fa1-8ece-75510e0380ba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f8e702c2-06e2-4fa1-8ece-75510e0380ba_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b4e650>
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af5c760b-4d53-552a-8ef1-f2c30d77e16e
2025-12-02 19:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447701?view=catalogue)
2025-12-02 19:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KS22TTE/2025-12-01/image/2fe0b2c3-2838-48d1-9b10-02c6626f15aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457056?view=catalogue)
2025-12-02 19:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fe51d39-8580-4169-b3b2-86dfa17fd656_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457056?view=catalogue)
2025-12-02 19:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447701?view=catalogue)
2025-12-02 19:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE71CFO/2025-11-27/image/f51925ed-9194-4b1f-9ad0-a4ca23aa122a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117398180?view=catalogue)
2025-12-02 19:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/94e458b3-601f-4340-a831-51d31bafa750_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117417496?view=catalogue)
2025-12-02 19:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/de967e53-c9e6-4b7b-8066-c1eab377e53d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117417496?view=catalogue)
2025-12-02 19:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72UFM/2025-12-02/image/0cd57591-05d1-4e72-9dcb-ff1670263d10_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117524612?view=catalogue)
2025-12-02 19:08:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf3714f50>
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252F1e990bee-4a00-412f-82a9-9814a37dd698_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e990bee-4a00-412f-82a9-9814a37dd698_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03f5c10>
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F124aae53-fbbc-4ad2-9537-bce2f40a48dd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/124aae53-fbbc-4ad2-9537-bce2f40a48dd_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d58ba83b-4489-52c5-b56c-2b235c97c8be
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08ca5d0>
2025-12-02 19:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD71YTL%252F2025-11-20%252Fimage%252F935ce31f-3989-4c9a-a00d-d2851ee934a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD71YTL/2025-11-20/image/935ce31f-3989-4c9a-a00d-d2851ee934a5_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d58ba83b-4489-52c5-b56c-2b235c97c8be
2025-12-02 19:08:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d58ba83b-4489-52c5-b56c-2b235c97c8be, skipping ID generation
2025-12-02 19:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58ba83b-4489-52c5-b56c-2b235c97c8be with scrape type 1
2025-12-02 19:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d58ba83b-4489-52c5-b56c-2b235c97c8be from tracking dictionaries
2025-12-02 19:08:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d58ba83b-4489-52c5-b56c-2b235c97c8be sending to next pipeline
2025-12-02 19:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d58ba83b-4489-52c5-b56c-2b235c97c8be, identifier: 117359464
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f32190>
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F7626b886-352e-45f7-bc53-804b8ddc9372_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/7626b886-352e-45f7-bc53-804b8ddc9372_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14a89f04-36b4-56b0-be19-9a7421666389
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf078af10>
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252Fed2156b0-32c4-4323-b650-6c4a5e860a5e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/ed2156b0-32c4-4323-b650-6c4a5e860a5e_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0984190>
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F256aa757-985a-4720-934e-742e912edca8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/256aa757-985a-4720-934e-742e912edca8_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14a89f04-36b4-56b0-be19-9a7421666389
2025-12-02 19:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d58ba83b-4489-52c5-b56c-2b235c97c8be with identifier: 117359464
2025-12-02 19:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d58ba83b-4489-52c5-b56c-2b235c97c8be with identifier: 117359464
2025-12-02 19:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d58ba83b-4489-52c5-b56c-2b235c97c8be with identifier: 117359464 to the API
2025-12-02 19:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SD71YTL/2025-11-20/image/935ce31f-3989-4c9a-a00d-d2851ee934a5_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'd58ba83b-4489-52c5-b56c-2b235c97c8be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SD71YTL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117359464',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 60174,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 19170,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/81f46ce4-4b42-4eaa-9623-148eb662c195_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 19308,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/080a0c5c-b2cd-4f0a-8996-d581bc47c3b9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21698,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/6e9bce92-62c4-4e0b-a14a-f7432af799b0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22043,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/32a11743-173f-45f8-aebf-8a3f0ac7a228_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31891,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/d87d65c2-3c76-4d91-84ec-2ebf845fc04b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33959,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/2f4c97fb-e02f-48da-b564-091def29b5b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32229,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/4fe47211-8ad2-47c4-8983-e032609d097d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35113,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/edaf10d3-83c0-4a7c-ad6e-bf0a712645f2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41284,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/124aae53-fbbc-4ad2-9537-bce2f40a48dd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58ba83b-4489-52c5-b56c-2b235c97c8be/d58ba83b-4489-52c5-b56c-2b235c97c8be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51763,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD71YTL/2025-11-20/image/935ce31f-3989-4c9a-a00d-d2851ee934a5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seller_name': 'Kinto',
 'title': 'TESLA MODEL 3 SALOON Standard Plus 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Standard Plus 4dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117359464%27 HTTP/1.1" 200 None
2025-12-02 19:08:50 [astonbarclay.gb] INFO: Saving data for 117359464: {'created_time': 1764702530.344504, 'last_price_update_time': 1764702530.344516, 'auction_closing_time': 1765532700.0}
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117359464') HTTP/1.1" 204 0
2025-12-02 19:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KS22TTE/2025-12-01/image/e2cc78ed-dafb-4437-9e3d-466169bb3993_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457056?view=catalogue)
2025-12-02 19:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/d946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447701?view=catalogue)
2025-12-02 19:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fae927f-21d1-4da0-8e1a-e94865dfffb9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457056?view=catalogue)
2025-12-02 19:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/f5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447701?view=catalogue)
2025-12-02 19:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447701?view=catalogue)
2025-12-02 19:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/36e09e33-46d7-4632-8827-8f845cdbf7da_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117417496?view=catalogue)
2025-12-02 19:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/41cad555-f81b-42af-86b5-1ef17d23a75e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117417496?view=catalogue)
2025-12-02 19:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/324ce1ce-580f-4ecf-b894-a130d7934e01_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117417496?view=catalogue)
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03e7f50>
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af5c760b-4d53-552a-8ef1-f2c30d77e16e
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c7c890>
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252F2fe0b2c3-2838-48d1-9b10-02c6626f15aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/2fe0b2c3-2838-48d1-9b10-02c6626f15aa_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06bc650>
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252F7fe51d39-8580-4169-b3b2-86dfa17fd656_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fe51d39-8580-4169-b3b2-86dfa17fd656_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c7f550>
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af5c760b-4d53-552a-8ef1-f2c30d77e16e
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090c310>
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_11.jpg HTTP/1.1" 201 0
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE71CFO%252F2025-11-27%252Fimage%252Ff51925ed-9194-4b1f-9ad0-a4ca23aa122a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE71CFO/2025-11-27/image/f51925ed-9194-4b1f-9ad0-a4ca23aa122a_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ab01a251-29e1-5907-bbdc-2f90aba01bfc
2025-12-02 19:08:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab01a251-29e1-5907-bbdc-2f90aba01bfc, skipping ID generation
2025-12-02 19:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab01a251-29e1-5907-bbdc-2f90aba01bfc with scrape type 1
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ab01a251-29e1-5907-bbdc-2f90aba01bfc from tracking dictionaries
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab01a251-29e1-5907-bbdc-2f90aba01bfc sending to next pipeline
2025-12-02 19:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ab01a251-29e1-5907-bbdc-2f90aba01bfc, identifier: 117398180
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0748590>
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F94e458b3-601f-4340-a831-51d31bafa750_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/94e458b3-601f-4340-a831-51d31bafa750_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14a89f04-36b4-56b0-be19-9a7421666389
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03bb4d0>
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252Fde967e53-c9e6-4b7b-8066-c1eab377e53d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/de967e53-c9e6-4b7b-8066-c1eab377e53d_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14a89f04-36b4-56b0-be19-9a7421666389
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a8a250>
2025-12-02 19:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252F0cd57591-05d1-4e72-9dcb-ff1670263d10_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/0cd57591-05d1-4e72-9dcb-ff1670263d10_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13
2025-12-02 19:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ab01a251-29e1-5907-bbdc-2f90aba01bfc with identifier: 117398180
2025-12-02 19:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ab01a251-29e1-5907-bbdc-2f90aba01bfc with identifier: 117398180
2025-12-02 19:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ab01a251-29e1-5907-bbdc-2f90aba01bfc with identifier: 117398180 to the API
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DE71CFO/2025-11-27/image/f51925ed-9194-4b1f-9ad0-a4ca23aa122a_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'ab01a251-29e1-5907-bbdc-2f90aba01bfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DE71CFO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117398180',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '2 SERIES DIESEL GRAN TOURER',
 'odometer': 93086,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30326,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e5039b0-53f6-4099-a140-3a38a1e6babe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32329,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/731ea754-dbbe-4311-9757-2d8216a99cbe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34433,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/32220310-e352-4cb1-910c-1759daca1a0a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35534,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/6f05494d-e744-4744-941d-b42e9bfe9fae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49015,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/e0473668-e405-4471-8e53-d1de844387f3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42040,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1f2dca70-5322-49ea-bd5a-2eed581a0e5d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44839,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/ad7baace-55eb-46d6-9b4c-d8c0c0d3ee89_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47987,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/dca12231-3984-44a4-b4e0-abd7bfa84849_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63468,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/33e708b3-92fc-470b-8198-707232509853_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52378,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1c1386d4-3a4f-444a-afd2-10909d6fb461_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52542,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/1e990bee-4a00-412f-82a9-9814a37dd698_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab01a251-29e1-5907-bbdc-2f90aba01bfc/ab01a251-29e1-5907-bbdc-2f90aba01bfc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48888,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE71CFO/2025-11-27/image/f51925ed-9194-4b1f-9ad0-a4ca23aa122a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-31',
 'seller_name': 'Kinto',
 'title': 'BMW 2 SERIES DIESEL GRAN TOURER 216d SE 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '216d SE 5dr Step Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117398180%27 HTTP/1.1" 200 None
2025-12-02 19:08:52 [astonbarclay.gb] INFO: Saving data for 117398180: {'created_time': 1764702532.612674, 'last_price_update_time': 1764702532.612685, 'auction_closing_time': 1765532700.0}
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117398180') HTTP/1.1" 204 0
2025-12-02 19:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447701?view=catalogue)
2025-12-02 19:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c905bf93-689c-403b-8cef-16e6a803e89a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457056?view=catalogue)
2025-12-02 19:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a9b72878-c3d7-47a8-accf-8b1eacff918b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117524612?view=catalogue)
2025-12-02 19:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72UFM/2025-12-02/image/e7dcfac1-d52e-4a8a-b726-179ca4ddd8eb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117524612?view=catalogue)
2025-12-02 19:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72UFM/2025-12-02/image/6a79a172-50b3-4838-aefc-0a5f06a9f7b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117524612?view=catalogue)
2025-12-02 19:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a7e919a9-b8a0-48e9-861d-d01defbb931f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117524612?view=catalogue)
2025-12-02 19:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/85830920-c4bc-4614-b18c-242fc437fc23_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue)
2025-12-02 19:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0352750>
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Fe2cc78ed-dafb-4437-9e3d-466169bb3993_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/e2cc78ed-dafb-4437-9e3d-466169bb3993_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b4f090>
2025-12-02 19:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252Fd946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/d946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af5c760b-4d53-552a-8ef1-f2c30d77e16e
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03928d0>
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252F7fae927f-21d1-4da0-8e1a-e94865dfffb9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fae927f-21d1-4da0-8e1a-e94865dfffb9_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b4ec10>
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252Ff5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/f5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af5c760b-4d53-552a-8ef1-f2c30d77e16e
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03517d0>
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af5c760b-4d53-552a-8ef1-f2c30d77e16e
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b6b50>
2025-12-02 19:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F36e09e33-46d7-4632-8827-8f845cdbf7da_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/36e09e33-46d7-4632-8827-8f845cdbf7da_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14a89f04-36b4-56b0-be19-9a7421666389
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf099b710>
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F41cad555-f81b-42af-86b5-1ef17d23a75e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/41cad555-f81b-42af-86b5-1ef17d23a75e_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14a89f04-36b4-56b0-be19-9a7421666389
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06b7d10>
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ71AVR%252F2025-12-01%252Fimage%252F324ce1ce-580f-4ecf-b894-a130d7934e01_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/324ce1ce-580f-4ecf-b894-a130d7934e01_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14a89f04-36b4-56b0-be19-9a7421666389
2025-12-02 19:08:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14a89f04-36b4-56b0-be19-9a7421666389, skipping ID generation
2025-12-02 19:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14a89f04-36b4-56b0-be19-9a7421666389 with scrape type 1
2025-12-02 19:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 14a89f04-36b4-56b0-be19-9a7421666389 from tracking dictionaries
2025-12-02 19:08:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14a89f04-36b4-56b0-be19-9a7421666389 sending to next pipeline
2025-12-02 19:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 14a89f04-36b4-56b0-be19-9a7421666389, identifier: 117417496
2025-12-02 19:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 14a89f04-36b4-56b0-be19-9a7421666389 with identifier: 117417496
2025-12-02 19:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 14a89f04-36b4-56b0-be19-9a7421666389 with identifier: 117417496
2025-12-02 19:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 14a89f04-36b4-56b0-be19-9a7421666389 with identifier: 117417496 to the API
2025-12-02 19:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/324ce1ce-580f-4ecf-b894-a130d7934e01_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '14a89f04-36b4-56b0-be19-9a7421666389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BJ71AVR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117417496',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'CUPRA',
 'model': 'LEON HATCHBACK',
 'odometer': 16037,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29465,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/6c82771a-523f-4042-9d65-b58849af5757_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28332,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/7626b886-352e-45f7-bc53-804b8ddc9372_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26737,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/256aa757-985a-4720-934e-742e912edca8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25593,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/d30bed58-aecc-4ecb-9950-bc4b2b1090a2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37085,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/de967e53-c9e6-4b7b-8066-c1eab377e53d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43355,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/94e458b3-601f-4340-a831-51d31bafa750_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42316,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/324ce1ce-580f-4ecf-b894-a130d7934e01_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52036,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/36e09e33-46d7-4632-8827-8f845cdbf7da_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14a89f04-36b4-56b0-be19-9a7421666389/14a89f04-36b4-56b0-be19-9a7421666389_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 14180,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ71AVR/2025-12-01/image/41cad555-f81b-42af-86b5-1ef17d23a75e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seller_name': 'Zenith',
 'title': 'CUPRA LEON HATCHBACK 1.4 eHybrid VZ2 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 eHybrid VZ2 5dr DSG',
 'vin': None,
 'year': 2021}
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117417496%27 HTTP/1.1" 200 None
2025-12-02 19:08:55 [astonbarclay.gb] INFO: Saving data for 117417496: {'created_time': 1764702535.400634, 'last_price_update_time': 1764702535.400645, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117417496') HTTP/1.1" 204 0
2025-12-02 19:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d962289a-3935-4e94-83fd-5caebadf04f6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509119?view=catalogue)
2025-12-02 19:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e52d4c4a-b195-49e2-a656-f72d7c5aecac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372665?view=catalogue)
2025-12-02 19:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/e8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117508313?view=catalogue)
2025-12-02 19:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/cb225f8b-cdc8-4c37-985a-6d8f67ec48ba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446881?view=catalogue)
2025-12-02 19:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71XVH/2025-11-28/image/428d149c-5436-4dde-92f7-1dc373a5542c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509119?view=catalogue)
2025-12-02 19:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/e9b3f1e1-65ca-41f5-81ed-53e5efc3ccae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117446881?view=catalogue)
2025-12-02 19:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf097ac90>
2025-12-02 19:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72AXJ%252F2025-11-28%252Fimage%252F3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af5c760b-4d53-552a-8ef1-f2c30d77e16e
2025-12-02 19:08:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af5c760b-4d53-552a-8ef1-f2c30d77e16e, skipping ID generation
2025-12-02 19:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5c760b-4d53-552a-8ef1-f2c30d77e16e with scrape type 1
2025-12-02 19:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item af5c760b-4d53-552a-8ef1-f2c30d77e16e from tracking dictionaries
2025-12-02 19:08:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af5c760b-4d53-552a-8ef1-f2c30d77e16e sending to next pipeline
2025-12-02 19:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: af5c760b-4d53-552a-8ef1-f2c30d77e16e, identifier: 117447701
2025-12-02 19:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0586cd0>
2025-12-02 19:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKS22TTE%252F2025-12-01%252Fimage%252Fc905bf93-689c-403b-8cef-16e6a803e89a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c905bf93-689c-403b-8cef-16e6a803e89a_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd
2025-12-02 19:08:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd, skipping ID generation
2025-12-02 19:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd with scrape type 1
2025-12-02 19:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd from tracking dictionaries
2025-12-02 19:08:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd sending to next pipeline
2025-12-02 19:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd, identifier: 117457056
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf099bb90>
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252Fa9b72878-c3d7-47a8-accf-8b1eacff918b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a9b72878-c3d7-47a8-accf-8b1eacff918b_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0509ad0>
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252Fe7dcfac1-d52e-4a8a-b726-179ca4ddd8eb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/e7dcfac1-d52e-4a8a-b726-179ca4ddd8eb_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf084a1d0>
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252F6a79a172-50b3-4838-aefc-0a5f06a9f7b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/6a79a172-50b3-4838-aefc-0a5f06a9f7b0_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0606290>
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA72UFM%252F2025-12-02%252Fimage%252Fa7e919a9-b8a0-48e9-861d-d01defbb931f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a7e919a9-b8a0-48e9-861d-d01defbb931f_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13
2025-12-02 19:08:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13, skipping ID generation
2025-12-02 19:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13 with scrape type 1
2025-12-02 19:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13 from tracking dictionaries
2025-12-02 19:08:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13 sending to next pipeline
2025-12-02 19:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13, identifier: 117524612
2025-12-02 19:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b4ea50>
2025-12-02 19:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252F85830920-c4bc-4614-b18c-242fc437fc23_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/85830920-c4bc-4614-b18c-242fc437fc23_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: af5c760b-4d53-552a-8ef1-f2c30d77e16e with identifier: 117447701
2025-12-02 19:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: af5c760b-4d53-552a-8ef1-f2c30d77e16e with identifier: 117447701
2025-12-02 19:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'up electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 30278, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117447701', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '60kw e-up 32kwh 5dr auto', 'license_plate': 'yf72axj', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'af5c760b-4d53-552a-8ef1-f2c30d77e16e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30848}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 26935}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 25919}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45693}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 60067}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/d946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42637}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/f5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56205}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48959}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'volkswagen up electric hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 48727} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'af5c760b-4d53-552a-8ef1-f2c30d77e16e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yf72axj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117447701',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'volkswagen',
     'make_model': 'volkswagen up electric hatchback',
     'model': 'up electric hatchback',
     'odometer': 30278,
     'odometer_in_km': 48727,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30848,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30853,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26935,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25919,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45693,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60067,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42637,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/d946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56205,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/f5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48959,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-30',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '60kw e-up 32kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: af5c760b-4d53-552a-8ef1-f2c30d77e16e spider: astonbarclay.gb
2025-12-02 19:08:57 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: af5c760b-4d53-552a-8ef1-f2c30d77e16e due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'up electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 30278, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117447701', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '60kw e-up 32kwh 5dr auto', 'license_plate': 'yf72axj', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'af5c760b-4d53-552a-8ef1-f2c30d77e16e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30848}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 26935}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 25919}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45693}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 60067}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/d946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42637}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/f5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56205}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48959}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'volkswagen up electric hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 48727} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'af5c760b-4d53-552a-8ef1-f2c30d77e16e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yf72axj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117447701',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'volkswagen',
     'make_model': 'volkswagen up electric hatchback',
     'model': 'up electric hatchback',
     'odometer': 30278,
     'odometer_in_km': 48727,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30848,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30853,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26935,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25919,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45693,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60067,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42637,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/d946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56205,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/f5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48959,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-30',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '60kw e-up 32kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'af5c760b-4d53-552a-8ef1-f2c30d77e16e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YF72AXJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117447701',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'UP ELECTRIC HATCHBACK',
 'odometer': 30278,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30848,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/22584bb8-088b-4674-a71a-144a997b5fe3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30853,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/3119db94-f27f-4802-b1c5-6239e4a7bb11_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26935,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/51eb9fa0-0111-45f0-81de-37d87e2ddb85_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25919,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/11d953d5-74db-4291-b621-6b6e77b613e8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45693,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5f26c7ec-09c3-4616-812c-dbe624242592_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60067,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/5ceabfce-7bb7-44b3-8e38-8056fe226144_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42637,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/d946253f-267d-4d37-81b7-b16eeeeef0e9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56205,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/f5561a69-0b21-47f9-8b03-e07d3ab86500_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5c760b-4d53-552a-8ef1-f2c30d77e16e/af5c760b-4d53-552a-8ef1-f2c30d77e16e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48959,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72AXJ/2025-11-28/image/2c4e2c22-ba73-49a0-9259-d56783ce8203_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-30',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN UP ELECTRIC HATCHBACK 60kW E-Up 32kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '60kW E-Up 32kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447701%27 HTTP/1.1" 200 None
2025-12-02 19:08:57 [astonbarclay.gb] INFO: Saving data for 117447701: {'created_time': 1764702537.62297, 'last_price_update_time': 1764702537.62298, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117447701') HTTP/1.1" 204 0
2025-12-02 19:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd with identifier: 117457056
2025-12-02 19:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd with identifier: 117457056
2025-12-02 19:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4ce37573-739a-5b0c-ac2b-bcccc3c80bfd with identifier: 117457056 to the API
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c905bf93-689c-403b-8cef-16e6a803e89a_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '4ce37573-739a-5b0c-ac2b-bcccc3c80bfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KS22TTE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117457056',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 20781,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25304,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c020f32f-91e2-43bc-9a0f-96e090bbaa63_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24825,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f4e4182e-b2f3-489d-a06b-5f93ca5a67ad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26553,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/b0f454bc-00ca-4446-810c-07e50467f0e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25596,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/c905bf93-689c-403b-8cef-16e6a803e89a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40168,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/f8e702c2-06e2-4fa1-8ece-75510e0380ba_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39338,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/12096044-f373-42e5-9879-13e75c49c310_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45854,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fe51d39-8580-4169-b3b2-86dfa17fd656_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43064,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/2fe0b2c3-2838-48d1-9b10-02c6626f15aa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39942,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/7fae927f-21d1-4da0-8e1a-e94865dfffb9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce37573-739a-5b0c-ac2b-bcccc3c80bfd/4ce37573-739a-5b0c-ac2b-bcccc3c80bfd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43664,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/KS22TTE/2025-12-01/image/e2cc78ed-dafb-4437-9e3d-466169bb3993_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-31',
 'seller_name': 'Zenith',
 'title': 'BMW 1 SERIES HATCHBACK M135i xDrive 5dr Step Auto [Pro Pack]',
 'transmission': 'automatic',
 'trim': 'M135i xDrive 5dr Step Auto [Pro Pack]',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457056%27 HTTP/1.1" 200 None
2025-12-02 19:08:58 [astonbarclay.gb] INFO: Saving data for 117457056: {'created_time': 1764702538.017816, 'last_price_update_time': 1764702538.017832, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117457056') HTTP/1.1" 204 0
2025-12-02 19:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13 with identifier: 117524612
2025-12-02 19:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13 with identifier: 117524612
2025-12-02 19:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2e83f62e-99f7-513b-be3e-b6c4ae5d0b13 with identifier: 117524612 to the API
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a7e919a9-b8a0-48e9-861d-d01defbb931f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '2e83f62e-99f7-513b-be3e-b6c4ae5d0b13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NA72UFM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117524612',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLVO',
 'model': 'XC40 ESTATE',
 'odometer': 42119,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32755,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/48757d86-d566-4042-8270-d5c52066de6a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33610,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/e7dcfac1-d52e-4a8a-b726-179ca4ddd8eb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33938,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/5be7962e-7940-40fd-9e68-1b108ee5f1a9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31515,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a9b72878-c3d7-47a8-accf-8b1eacff918b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35420,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/ed2156b0-32c4-4323-b650-6c4a5e860a5e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51297,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/fb6afe43-ae86-4e3f-a5d2-d83e2bbf7666_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50187,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/a7e919a9-b8a0-48e9-861d-d01defbb931f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47568,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/0cd57591-05d1-4e72-9dcb-ff1670263d10_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e83f62e-99f7-513b-be3e-b6c4ae5d0b13/2e83f62e-99f7-513b-be3e-b6c4ae5d0b13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50559,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA72UFM/2025-12-02/image/6a79a172-50b3-4838-aefc-0a5f06a9f7b0_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-16',
 'seller_name': 'Zenith',
 'title': 'VOLVO XC40 ESTATE 2.0 B3P Core 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 B3P Core 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117524612%27 HTTP/1.1" 200 None
2025-12-02 19:08:58 [astonbarclay.gb] INFO: Saving data for 117524612: {'created_time': 1764702538.385281, 'last_price_update_time': 1764702538.385293, 'auction_closing_time': 1764927900.0}
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117524612') HTTP/1.1" 204 0
2025-12-02 19:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV72KPE/2025-11-27/image/4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117397431?view=catalogue)
2025-12-02 19:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117505111?view=catalogue)
2025-12-02 19:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP73AYV/2025-11-26/image/f7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117484817?view=catalogue)
2025-12-02 19:08:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY72ASX/2025-12-01/image/a28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101420?view=catalogue)
2025-12-02 19:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117574882?view=catalogue)
2025-12-02 19:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PN71OEO/2025-12-01/image/d5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609383?view=catalogue)
2025-12-02 19:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71HUK/2025-11-27/image/b7b86cad-5d69-4cd2-ace0-3168703f7695_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542530?view=catalogue)
2025-12-02 19:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117344624?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117311401?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:08:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07ce3d0>
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252Fd962289a-3935-4e94-83fd-5caebadf04f6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d962289a-3935-4e94-83fd-5caebadf04f6_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d59de41-1bac-57aa-a199-c7265717669d
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08ce910>
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FML21AKZ%252F2025-12-02%252Fimage%252Fe52d4c4a-b195-49e2-a656-f72d7c5aecac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e52d4c4a-b195-49e2-a656-f72d7c5aecac_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0
2025-12-02 19:08:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0, skipping ID generation
2025-12-02 19:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0 with scrape type 1
2025-12-02 19:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0 from tracking dictionaries
2025-12-02 19:08:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0 sending to next pipeline
2025-12-02 19:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0, identifier: 117372665
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf059d7d0>
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71XVZ%252F2025-12-01%252Fimage%252Fe8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/e8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc40b220-30ca-5b5b-b901-16ef42be703b
2025-12-02 19:08:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc40b220-30ca-5b5b-b901-16ef42be703b, skipping ID generation
2025-12-02 19:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc40b220-30ca-5b5b-b901-16ef42be703b with scrape type 1
2025-12-02 19:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc40b220-30ca-5b5b-b901-16ef42be703b from tracking dictionaries
2025-12-02 19:08:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc40b220-30ca-5b5b-b901-16ef42be703b sending to next pipeline
2025-12-02 19:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fc40b220-30ca-5b5b-b901-16ef42be703b, identifier: 117508313
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07ce850>
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Fcb225f8b-cdc8-4c37-985a-6d8f67ec48ba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/cb225f8b-cdc8-4c37-985a-6d8f67ec48ba_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71483516-b9d5-594e-82f5-ffef2099fd34
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08ce310>
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71XVH%252F2025-11-28%252Fimage%252F428d149c-5436-4dde-92f7-1dc373a5542c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71XVH/2025-11-28/image/428d149c-5436-4dde-92f7-1dc373a5542c_removebg.jpg?w=600 saved to cache
2025-12-02 19:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d59de41-1bac-57aa-a199-c7265717669d
2025-12-02 19:08:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d59de41-1bac-57aa-a199-c7265717669d, skipping ID generation
2025-12-02 19:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d59de41-1bac-57aa-a199-c7265717669d with scrape type 1
2025-12-02 19:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1d59de41-1bac-57aa-a199-c7265717669d from tracking dictionaries
2025-12-02 19:08:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d59de41-1bac-57aa-a199-c7265717669d sending to next pipeline
2025-12-02 19:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1d59de41-1bac-57aa-a199-c7265717669d, identifier: 117509119
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf059e810>
2025-12-02 19:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSJ70WNR%252F2025-12-02%252Fimage%252Fe9b3f1e1-65ca-41f5-81ed-53e5efc3ccae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/e9b3f1e1-65ca-41f5-81ed-53e5efc3ccae_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71483516-b9d5-594e-82f5-ffef2099fd34
2025-12-02 19:09:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71483516-b9d5-594e-82f5-ffef2099fd34, skipping ID generation
2025-12-02 19:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71483516-b9d5-594e-82f5-ffef2099fd34 with scrape type 1
2025-12-02 19:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 71483516-b9d5-594e-82f5-ffef2099fd34 from tracking dictionaries
2025-12-02 19:09:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71483516-b9d5-594e-82f5-ffef2099fd34 sending to next pipeline
2025-12-02 19:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 71483516-b9d5-594e-82f5-ffef2099fd34, identifier: 117446881
2025-12-02 19:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0 with identifier: 117372665
2025-12-02 19:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0 with identifier: 117372665
2025-12-02 19:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0 with identifier: 117372665 to the API
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e52d4c4a-b195-49e2-a656-f72d7c5aecac_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'ML21AKZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117372665',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 84143,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24555,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e52d4c4a-b195-49e2-a656-f72d7c5aecac_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26531,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/483a54e6-6449-4932-85fd-7bc62c9a748e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24752,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/85830920-c4bc-4614-b18c-242fc437fc23_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22801,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/9193df10-ccec-44b8-a031-ed5e9dbf3b23_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37095,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/231166ad-93cc-47ee-a9a2-624d3beb7cae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41659,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/48807c88-3330-4c93-877a-8e18fb20252d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42847,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/23696852-78d5-4057-b37f-cf9e6f1cc282_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50972,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/3fdcb158-482b-45ca-8f31-7c3126687320_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45783,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/d1c24b8e-9418-433a-b818-d5390e2640ee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41870,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/bb97c163-900c-4bf6-b5dc-bf4c8c77b209_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0/4fa3a0b0-60f9-59dc-b4d0-aab424ae41f0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41526,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/ML21AKZ/2025-12-02/image/e98b47d5-21a0-4a09-bf93-3a112718d416_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-21',
 'seller_name': 'Zenith',
 'title': 'BMW 3 SERIES TOURING 330e M Sport 5dr Step Auto [Tech/Pro Pack]',
 'transmission': 'automatic',
 'trim': '330e M Sport 5dr Step Auto [Tech/Pro Pack]',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372665%27 HTTP/1.1" 200 None
2025-12-02 19:09:00 [astonbarclay.gb] INFO: Saving data for 117372665: {'created_time': 1764702540.560028, 'last_price_update_time': 1764702540.560038, 'auction_closing_time': 1764927900.0}
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117372665') HTTP/1.1" 204 0
2025-12-02 19:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fc40b220-30ca-5b5b-b901-16ef42be703b with identifier: 117508313
2025-12-02 19:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fc40b220-30ca-5b5b-b901-16ef42be703b with identifier: 117508313
2025-12-02 19:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 32569, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117508313', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto', 'license_plate': 'mj71xvz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'fc40b220-30ca-5b5b-b901-16ef42be703b', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/fca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32802}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35107}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33817}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/bddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41761}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 61393}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46386}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50030}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/e8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50875}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 52414} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'fc40b220-30ca-5b5b-b901-16ef42be703b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'mj71xvz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117508313',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 32569,
     'odometer_in_km': 52414,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32802,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/fca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35107,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33817,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34670,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/bddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41761,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61393,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46386,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50030,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50875,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/e8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-12',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: fc40b220-30ca-5b5b-b901-16ef42be703b spider: astonbarclay.gb
2025-12-02 19:09:00 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: fc40b220-30ca-5b5b-b901-16ef42be703b due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 32569, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117508313', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto', 'license_plate': 'mj71xvz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'fc40b220-30ca-5b5b-b901-16ef42be703b', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/fca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32802}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35107}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33817}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/bddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41761}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 61393}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46386}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50030}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/e8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50875}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 52414} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'fc40b220-30ca-5b5b-b901-16ef42be703b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'mj71xvz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117508313',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 32569,
     'odometer_in_km': 52414,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32802,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/fca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35107,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33817,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34670,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/bddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41761,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61393,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46386,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50030,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50875,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/e8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-12',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'fc40b220-30ca-5b5b-b901-16ef42be703b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MJ71XVZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117508313',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q4 E-TRON ESTATE',
 'odometer': 32569,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32802,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/fca95e54-f883-4953-9b63-c5c8ad161e00_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35107,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f374734-0419-4401-860b-272fe98a68d5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33817,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/13ed1d2c-b06d-4cd4-90c9-9ae1ef41b3d2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34670,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/bddbe6ac-f74a-49bb-9e96-1675dd675959_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41761,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/774ded07-c4a0-47fe-80b6-77c9835f09ef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61393,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/8f91297f-b7bf-42c8-a2b7-95f24a0cff05_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46386,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/61f8477e-5c78-44f5-a4a9-3c2d4371abe5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50030,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/5a5e6738-d411-4e10-8bd7-9cd3b67109ee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc40b220-30ca-5b5b-b901-16ef42be703b/fc40b220-30ca-5b5b-b901-16ef42be703b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50875,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71XVZ/2025-12-01/image/e8779bbe-6c14-48dd-b66f-e7975add4a21_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seller_name': 'Zenith',
 'title': 'AUDI Q4 E-TRON ESTATE 150kW 40 82kWh S Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW 40 82kWh S Line 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508313%27 HTTP/1.1" 200 None
2025-12-02 19:09:00 [astonbarclay.gb] INFO: Saving data for 117508313: {'created_time': 1764702540.874672, 'last_price_update_time': 1764702540.874684, 'auction_closing_time': 1764927900.0}
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117508313') HTTP/1.1" 204 0
2025-12-02 19:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1d59de41-1bac-57aa-a199-c7265717669d with identifier: 117509119
2025-12-02 19:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1d59de41-1bac-57aa-a199-c7265717669d with identifier: 117509119
2025-12-02 19:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1d59de41-1bac-57aa-a199-c7265717669d with identifier: 117509119 to the API
2025-12-02 19:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AO71XVH/2025-11-28/image/428d149c-5436-4dde-92f7-1dc373a5542c_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1d59de41-1bac-57aa-a199-c7265717669d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AO71XVH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117509119',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 62874,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30565,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/727d2cd5-a675-43e9-972f-73c85ca2acf2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29031,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/ecc4f524-f6c8-4375-8930-d7278a80031a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31099,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d014bdba-9fd6-4ebb-9d99-a9b69eca694f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30323,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/b1737738-433b-479d-af4f-0b1d75bdc385_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49803,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/a4e54916-5ce3-4342-8872-55cf113eab79_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46372,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/428d149c-5436-4dde-92f7-1dc373a5542c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43327,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d489d5aa-aa5f-4a2b-8ac9-7aec30582f1a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d59de41-1bac-57aa-a199-c7265717669d/1d59de41-1bac-57aa-a199-c7265717669d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57239,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71XVH/2025-11-28/image/d962289a-3935-4e94-83fd-5caebadf04f6_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seller_name': 'Zenith',
 'title': 'BMW 2 SERIES GRAN COUPE 218i [136] Sport 4dr DCT [Live Cockpit '
          'Prof]',
 'transmission': 'automatic',
 'trim': '218i [136] Sport 4dr DCT [Live Cockpit Prof]',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509119%27 HTTP/1.1" 200 None
2025-12-02 19:09:01 [astonbarclay.gb] INFO: Saving data for 117509119: {'created_time': 1764702541.235091, 'last_price_update_time': 1764702541.235103, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117509119') HTTP/1.1" 204 0
2025-12-02 19:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 71483516-b9d5-594e-82f5-ffef2099fd34 with identifier: 117446881
2025-12-02 19:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 71483516-b9d5-594e-82f5-ffef2099fd34 with identifier: 117446881
2025-12-02 19:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 71483516-b9d5-594e-82f5-ffef2099fd34 with identifier: 117446881 to the API
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/e9b3f1e1-65ca-41f5-81ed-53e5efc3ccae_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '71483516-b9d5-594e-82f5-ffef2099fd34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SJ70WNR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117446881',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TOYOTA',
 'model': 'COROLLA HATCHBACK',
 'odometer': 16347,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27582,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/74f410c8-67bf-40ec-bd1c-d91c6975bba8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30568,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/cb225f8b-cdc8-4c37-985a-6d8f67ec48ba_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30318,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/e9b3f1e1-65ca-41f5-81ed-53e5efc3ccae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32602,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/4023ae9c-64f3-4ad8-abbc-4e850dd3d6b5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60118,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/c2de56dc-7d0d-4d26-b8f7-643e8b1f3856_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52876,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/6a89d969-8f4f-4a4e-9abc-d8f8eadbdb71_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37586,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/a74c7deb-8d40-4843-bbc9-dcb2cb372f94_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47164,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/ca40e6e4-06d4-4fbc-a4b9-99927d85b032_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71483516-b9d5-594e-82f5-ffef2099fd34/71483516-b9d5-594e-82f5-ffef2099fd34_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54574,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SJ70WNR/2025-12-02/image/f34cd200-8a22-41b2-89d6-1e8b6f0c5228_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seller_name': 'Zenith',
 'title': 'TOYOTA COROLLA HATCHBACK 1.8 VVT-i Hybrid Icon Tech 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.8 VVT-i Hybrid Icon Tech 5dr CVT',
 'vin': None,
 'year': 2020}
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446881%27 HTTP/1.1" 200 None
2025-12-02 19:09:01 [astonbarclay.gb] INFO: Saving data for 117446881: {'created_time': 1764702541.579334, 'last_price_update_time': 1764702541.579344, 'auction_closing_time': 1764927900.0}
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117446881') HTTP/1.1" 204 0
2025-12-02 19:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR70ATV/2025-12-01/image/497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117363031?view=catalogue)
2025-12-02 19:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609383?view=catalogue)
2025-12-02 19:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/73f9b7db-4a11-45c2-bc16-39a7e400233e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117509080?view=catalogue)
2025-12-02 19:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71HUK/2025-12-01/image/ce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117571604?view=catalogue)
2025-12-02 19:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR70ATV/2025-12-01/image/a25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117363031?view=catalogue)
2025-12-02 19:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY72ASX/2025-12-01/image/e0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101420?view=catalogue)
2025-12-02 19:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71HUK/2025-12-01/image/4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117571604?view=catalogue)
2025-12-02 19:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117565754?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117406459?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07ca290>
2025-12-02 19:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV72KPE%252F2025-11-27%252Fimage%252F4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV72KPE/2025-11-27/image/4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7442e60-4434-5001-9201-0290dd09a7d2
2025-12-02 19:09:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7442e60-4434-5001-9201-0290dd09a7d2, skipping ID generation
2025-12-02 19:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7442e60-4434-5001-9201-0290dd09a7d2 with scrape type 1
2025-12-02 19:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a7442e60-4434-5001-9201-0290dd09a7d2 from tracking dictionaries
2025-12-02 19:09:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7442e60-4434-5001-9201-0290dd09a7d2 sending to next pipeline
2025-12-02 19:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a7442e60-4434-5001-9201-0290dd09a7d2, identifier: 117397431
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf068eb50>
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ71NZP%252F2025-11-26%252Fimage%252F087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef
2025-12-02 19:09:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef, skipping ID generation
2025-12-02 19:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef with scrape type 1
2025-12-02 19:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef from tracking dictionaries
2025-12-02 19:09:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef sending to next pipeline
2025-12-02 19:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef, identifier: 117505111
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf060ad50>
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP73AYV%252F2025-11-26%252Fimage%252Ff7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP73AYV/2025-11-26/image/f7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe
2025-12-02 19:09:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1756ad73-1e7b-56ab-b081-c9cbc6b316fe, skipping ID generation
2025-12-02 19:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe with scrape type 1
2025-12-02 19:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe from tracking dictionaries
2025-12-02 19:09:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1756ad73-1e7b-56ab-b081-c9cbc6b316fe sending to next pipeline
2025-12-02 19:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1756ad73-1e7b-56ab-b081-c9cbc6b316fe, identifier: 117484817
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0832190>
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252Fa28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/a28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4f48589-fe70-55fd-8be4-3136f685545b
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05187d0>
2025-12-02 19:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFM23AFF%252F2025-11-28%252Fimage%252Fb049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58b820cf-82d8-5a63-ac61-5c4de479678a
2025-12-02 19:09:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58b820cf-82d8-5a63-ac61-5c4de479678a, skipping ID generation
2025-12-02 19:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b820cf-82d8-5a63-ac61-5c4de479678a with scrape type 1
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 58b820cf-82d8-5a63-ac61-5c4de479678a from tracking dictionaries
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58b820cf-82d8-5a63-ac61-5c4de479678a sending to next pipeline
2025-12-02 19:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 58b820cf-82d8-5a63-ac61-5c4de479678a, identifier: 117574882
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0832dd0>
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252Fd5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/d5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf33bd610>
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71HUK%252F2025-11-27%252Fimage%252Fb7b86cad-5d69-4cd2-ace0-3168703f7695_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71HUK/2025-11-27/image/b7b86cad-5d69-4cd2-ace0-3168703f7695_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67451644-95be-507f-a155-ac065161e243
2025-12-02 19:09:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67451644-95be-507f-a155-ac065161e243, skipping ID generation
2025-12-02 19:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67451644-95be-507f-a155-ac065161e243 with scrape type 1
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 67451644-95be-507f-a155-ac065161e243 from tracking dictionaries
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67451644-95be-507f-a155-ac065161e243 sending to next pipeline
2025-12-02 19:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 67451644-95be-507f-a155-ac065161e243, identifier: 117542530
2025-12-02 19:09:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117344624, 'registration': 'LB71FNE', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 23043, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-29', 'fuel': 'Electric', 'motExpiry': '2026-11-28', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LB71FNE/2025-12-01/image/4661e44e-a752-4c73-bc8f-d5174ddf04ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/5df7a42f-bdc2-4472-98ff-d0f87bc5bae0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d29783a6-55cd-4043-9670-afd3b9870c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d5f9432d-0ff8-4478-ab48-e087e6dc0b08_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/6bcc7bde-4449-4b97-8b11-5e90e0ea2b9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/2bb1ce6b-20be-4e4e-a7c3-13436491d64b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/0b62e6f2-de8e-4658-afce-6266602e2ccb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/18bb3521-d16c-4128-b3f0-69cffa9e9953_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/919b135c-019e-4e6b-9953-ae280850aefa_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**827**VOSA STATES 16K, 22K  SPARE KEY   \t Multi-coat Red', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b4bce701-375b-40ec-9536-134ad9bf35b1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117344624, 'registration': 'LB71FNE', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 23043, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-29', 'fuel': 'Electric', 'motExpiry': '2026-11-28', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LB71FNE/2025-12-01/image/4661e44e-a752-4c73-bc8f-d5174ddf04ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/5df7a42f-bdc2-4472-98ff-d0f87bc5bae0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d29783a6-55cd-4043-9670-afd3b9870c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d5f9432d-0ff8-4478-ab48-e087e6dc0b08_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/6bcc7bde-4449-4b97-8b11-5e90e0ea2b9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/2bb1ce6b-20be-4e4e-a7c3-13436491d64b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/0b62e6f2-de8e-4658-afce-6266602e2ccb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/18bb3521-d16c-4128-b3f0-69cffa9e9953_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/919b135c-019e-4e6b-9953-ae280850aefa_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**827**VOSA STATES 16K, 22K  SPARE KEY   \t Multi-coat Red', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b4bce701-375b-40ec-9536-134ad9bf35b1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0061dd9e-9f66-58a7-bbb7-36252aa3e46b with identifier: 117344624
2025-12-02 19:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b with scrape type 1
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F4661e44e-a752-4c73-bc8f-d5174ddf04ed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/4661e44e-a752-4c73-bc8f-d5174ddf04ed_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117311401, 'registration': 'YK21FPW', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF ESTATE', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 66322, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-07-05', 'fuel': 'Petrol', 'motExpiry': '2026-07-04', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YK21FPW/2025-11-18/image/a605f0fb-f602-4827-b2af-53720f81389b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/0d5ed8f7-57af-4493-ae64-47768aa521a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/38a91f87-60a6-4774-96aa-5475192d4e7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/9439a47a-18c4-4f38-b73c-5414e1f273a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/c9f39247-088a-4ee6-966f-f1ad9fed4cdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/d003b278-c72a-4c90-848f-c8bb574f1723_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/b4634c59-a0fd-43b3-8f71-3f29cc874ba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/464fa3cc-c503-4f6d-8cf3-affe3e4b507d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/e72f89b5-4121-4559-804d-04e25e1eb68a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/22- 18K, 04/24- 42K', 'remarks': '**982** VOSA STATES 45K, 58K SPARE KEY  17in Ventura Alloys+anti Theft Whl Bolts\tRear Tinted Glass\tSpace+weight Saving Spare Wheel', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/62757095-8d57-4cea-8a17-6a00edd85259.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117311401, 'registration': 'YK21FPW', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF ESTATE', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 66322, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-07-05', 'fuel': 'Petrol', 'motExpiry': '2026-07-04', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YK21FPW/2025-11-18/image/a605f0fb-f602-4827-b2af-53720f81389b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/0d5ed8f7-57af-4493-ae64-47768aa521a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/38a91f87-60a6-4774-96aa-5475192d4e7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/9439a47a-18c4-4f38-b73c-5414e1f273a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/c9f39247-088a-4ee6-966f-f1ad9fed4cdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/d003b278-c72a-4c90-848f-c8bb574f1723_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/b4634c59-a0fd-43b3-8f71-3f29cc874ba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/464fa3cc-c503-4f6d-8cf3-affe3e4b507d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/e72f89b5-4121-4559-804d-04e25e1eb68a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/22- 18K, 04/24- 42K', 'remarks': '**982** VOSA STATES 45K, 58K SPARE KEY  17in Ventura Alloys+anti Theft Whl Bolts\tRear Tinted Glass\tSpace+weight Saving Spare Wheel', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/62757095-8d57-4cea-8a17-6a00edd85259.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1cb433c-dc51-57a1-baa8-eb359e0ec833 with identifier: 117311401
2025-12-02 19:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1cb433c-dc51-57a1-baa8-eb359e0ec833 with scrape type 2
2025-12-02 19:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1cb433c-dc51-57a1-baa8-eb359e0ec833 with scrape type 2
2025-12-02 19:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a1cb433c-dc51-57a1-baa8-eb359e0ec833, identifier: 117311401
2025-12-02 19:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a7442e60-4434-5001-9201-0290dd09a7d2 with identifier: 117397431
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a7442e60-4434-5001-9201-0290dd09a7d2 with identifier: 117397431
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line premium 70.5kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqa hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 35879, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117397431', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqa 250+ 140kw amg line premium 70.5kwh 5dr auto', 'license_plate': 'fv72kpe', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'a7442e60-4434-5001-9201-0290dd09a7d2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30818}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/c65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31320}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/a984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32603}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31750}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57068}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52832}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49349}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57740}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'mercedes-benz eqa hatchback', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 57741} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'a7442e60-4434-5001-9201-0290dd09a7d2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fv72kpe',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117397431',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqa hatchback',
     'model': 'eqa hatchback',
     'odometer': 35879,
     'odometer_in_km': 57741,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30818,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31320,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/c65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32603,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/a984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31750,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57068,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52832,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49349,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57740,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-24',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'zenith',
     'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line premium '
              '70.5kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqa 250+ 140kw amg line premium 70.5kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: a7442e60-4434-5001-9201-0290dd09a7d2 spider: astonbarclay.gb
2025-12-02 19:09:04 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a7442e60-4434-5001-9201-0290dd09a7d2 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line premium 70.5kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqa hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 35879, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117397431', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqa 250+ 140kw amg line premium 70.5kwh 5dr auto', 'license_plate': 'fv72kpe', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'a7442e60-4434-5001-9201-0290dd09a7d2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30818}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/c65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31320}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/a984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32603}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31750}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57068}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52832}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49349}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57740}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'mercedes-benz eqa hatchback', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 57741} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'a7442e60-4434-5001-9201-0290dd09a7d2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fv72kpe',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117397431',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqa hatchback',
     'model': 'eqa hatchback',
     'odometer': 35879,
     'odometer_in_km': 57741,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30818,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31320,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/c65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32603,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/a984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31750,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57068,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52832,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49349,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57740,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-24',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'zenith',
     'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line premium '
              '70.5kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqa 250+ 140kw amg line premium 70.5kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'a7442e60-4434-5001-9201-0290dd09a7d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FV72KPE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117397431',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQA HATCHBACK',
 'odometer': 35879,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30818,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/4ae5b60b-4950-46ac-8d81-97f1aa055cb5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31320,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/c65fe78c-771b-451d-804c-d1261db8b7fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32603,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/a984e622-c1f2-437a-8747-155a81f8724e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31750,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/51e73c8e-182b-4d2b-a2c7-2341aeb05c56_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57068,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/384cc03e-3617-4fdb-bf72-a30218df6f81_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52832,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/0e06fb98-8068-4884-b270-476ebc485dfc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49349,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/1f12d61d-7278-4e9e-b852-2f9ecde8a1ac_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7442e60-4434-5001-9201-0290dd09a7d2/a7442e60-4434-5001-9201-0290dd09a7d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57740,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV72KPE/2025-11-27/image/7b0d0e91-8bd6-4b14-ba90-920a740e1e27_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-24',
 'seller_name': 'Zenith',
 'title': 'MERCEDES-BENZ EQA HATCHBACK EQA 250+ 140kW AMG Line Premium 70.5kWh '
          '5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQA 250+ 140kW AMG Line Premium 70.5kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397431%27 HTTP/1.1" 200 None
2025-12-02 19:09:04 [astonbarclay.gb] INFO: Saving data for 117397431: {'created_time': 1764702544.245774, 'last_price_update_time': 1764702544.245784, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117397431') HTTP/1.1" 204 0
2025-12-02 19:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef with identifier: 117505111
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef with identifier: 117505111
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 60171, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117505111', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto', 'license_plate': 'mj71nzp', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '32a2d7c2-e28f-5972-bead-cc5a1b84d2ef', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27423}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/a7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 28856}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/b95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27402}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 42347}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/8ed08253-6918-4338-be3a-f58726470258_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 40609}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/fc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 46502}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 45651}], 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 96835} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '32a2d7c2-e28f-5972-bead-cc5a1b84d2ef',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'mj71nzp',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117505111',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 60171,
     'odometer_in_km': 96835,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27423,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28856,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/a7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27402,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/b95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27006,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42347,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40609,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/8ed08253-6918-4338-be3a-f58726470258_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46502,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/fc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45651,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-25',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef spider: astonbarclay.gb
2025-12-02 19:09:04 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 32a2d7c2-e28f-5972-bead-cc5a1b84d2ef due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 60171, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117505111', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto', 'license_plate': 'mj71nzp', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '32a2d7c2-e28f-5972-bead-cc5a1b84d2ef', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27423}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/a7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 28856}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/b95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27402}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 42347}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/8ed08253-6918-4338-be3a-f58726470258_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 40609}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/fc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 46502}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 45651}], 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 96835} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '32a2d7c2-e28f-5972-bead-cc5a1b84d2ef',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'mj71nzp',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117505111',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 60171,
     'odometer_in_km': 96835,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27423,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28856,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/a7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27402,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/b95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27006,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42347,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40609,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/8ed08253-6918-4338-be3a-f58726470258_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46502,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/fc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45651,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-25',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '32a2d7c2-e28f-5972-bead-cc5a1b84d2ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MJ71NZP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117505111',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'AUDI',
 'model': 'Q4 E-TRON ESTATE',
 'odometer': 60171,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27423,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/087a4f45-5c8c-4c00-bcb9-4b8f9090268d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28856,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/a7cf91b5-24c1-4dfb-ab1e-0381a4ab6646_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27402,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/b95f1ed5-45aa-46f3-8767-9bb6b950fcaf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27006,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2077a301-13d4-42fb-a79a-105826667e17_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42347,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/099800cd-f246-4df7-9d0a-d30029779fb3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40609,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/8ed08253-6918-4338-be3a-f58726470258_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46502,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/fc6a4a9c-bad7-4f96-8fce-df8898d82c75_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a2d7c2-e28f-5972-bead-cc5a1b84d2ef/32a2d7c2-e28f-5972-bead-cc5a1b84d2ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45651,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MJ71NZP/2025-11-26/image/2d875458-fc3d-4553-9aeb-24e03f772738_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seller_name': 'Zenith',
 'title': 'AUDI Q4 E-TRON ESTATE 150kW 40 82kWh S Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW 40 82kWh S Line 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505111%27 HTTP/1.1" 200 None
2025-12-02 19:09:04 [astonbarclay.gb] INFO: Saving data for 117505111: {'created_time': 1764702544.504979, 'last_price_update_time': 1764702544.504989, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117505111') HTTP/1.1" 204 0
2025-12-02 19:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1756ad73-1e7b-56ab-b081-c9cbc6b316fe with identifier: 117484817
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1756ad73-1e7b-56ab-b081-c9cbc6b316fe with identifier: 117484817
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mg motor uk mg4 hatchback 125kw se ev 51kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'mg4 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 5463, 'odometer_reading_unit': 'mi', 'registration_date': '2023-11-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117484817', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '125kw se ev 51kwh 5dr auto', 'license_plate': 'fp73ayv', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '1756ad73-1e7b-56ab-b081-c9cbc6b316fe', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/f7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30539}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29857}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28886}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29472}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44465}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/e96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46795}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/420141bc-53e2-475b-9410-838815f29bec_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54602}], 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'mg motor uk mg4 hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 8791} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 24,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '1756ad73-1e7b-56ab-b081-c9cbc6b316fe',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fp73ayv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117484817',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk mg4 hatchback',
     'model': 'mg4 hatchback',
     'odometer': 5463,
     'odometer_in_km': 8791,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30539,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/f7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29857,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28886,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29472,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44465,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55214,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46795,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/e96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54602,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/420141bc-53e2-475b-9410-838815f29bec_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-11-20',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'zenith',
     'title': 'mg motor uk mg4 hatchback 125kw se ev 51kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '125kw se ev 51kwh 5dr auto',
     'vin': None,
     'year': 2023}
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 1756ad73-1e7b-56ab-b081-c9cbc6b316fe spider: astonbarclay.gb
2025-12-02 19:09:04 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1756ad73-1e7b-56ab-b081-c9cbc6b316fe due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mg motor uk mg4 hatchback 125kw se ev 51kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'mg4 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 5463, 'odometer_reading_unit': 'mi', 'registration_date': '2023-11-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117484817', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '125kw se ev 51kwh 5dr auto', 'license_plate': 'fp73ayv', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '1756ad73-1e7b-56ab-b081-c9cbc6b316fe', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/f7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30539}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29857}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28886}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29472}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44465}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/e96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46795}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/420141bc-53e2-475b-9410-838815f29bec_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54602}], 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'mg motor uk mg4 hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 8791} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 24,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '1756ad73-1e7b-56ab-b081-c9cbc6b316fe',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fp73ayv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117484817',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk mg4 hatchback',
     'model': 'mg4 hatchback',
     'odometer': 5463,
     'odometer_in_km': 8791,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30539,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/f7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29857,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28886,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29472,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44465,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55214,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46795,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/e96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54602,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/420141bc-53e2-475b-9410-838815f29bec_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-11-20',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'zenith',
     'title': 'mg motor uk mg4 hatchback 125kw se ev 51kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '125kw se ev 51kwh 5dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '1756ad73-1e7b-56ab-b081-c9cbc6b316fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FP73AYV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117484817',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MG MOTOR UK',
 'model': 'MG4 HATCHBACK',
 'odometer': 5463,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30539,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/f7c27a94-f566-4d77-a3f9-fde247aa85fe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29857,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/347249a4-58b6-4178-a563-7c25dd5685fc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28886,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a85cbd51-7c08-4325-adc5-519b0eb737a8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29472,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/3baf30ef-9e7a-420f-9439-1059213b8189_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44465,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/a938e80a-5d53-41f5-b27e-127ef9be746e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55214,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/78f0f64a-5efb-4818-9246-3b24fb46ed30_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46795,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/e96a8456-39d0-42d4-8d4e-f9df66267f31_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756ad73-1e7b-56ab-b081-c9cbc6b316fe/1756ad73-1e7b-56ab-b081-c9cbc6b316fe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54602,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP73AYV/2025-11-26/image/420141bc-53e2-475b-9410-838815f29bec_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-20',
 'seller_name': 'Zenith',
 'title': 'MG MOTOR UK MG4 HATCHBACK 125kW SE EV 51kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '125kW SE EV 51kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117484817%27 HTTP/1.1" 200 None
2025-12-02 19:09:04 [astonbarclay.gb] INFO: Saving data for 117484817: {'created_time': 1764702544.742377, 'last_price_update_time': 1764702544.742386, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117484817') HTTP/1.1" 204 0
2025-12-02 19:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 58b820cf-82d8-5a63-ac61-5c4de479678a with identifier: 117574882
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 58b820cf-82d8-5a63-ac61-5c4de479678a with identifier: 117574882
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mg motor uk mg4 hatchback 150kw trophy ev long range 64kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'mg4 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 20872, 'odometer_reading_unit': 'mi', 'registration_date': '2023-08-17', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117574882', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw trophy ev long range 64kwh 5dr auto', 'license_plate': 'fm23aff', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '58b820cf-82d8-5a63-ac61-5c4de479678a', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33745}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32104}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/f041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32735}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45657}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55439}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50738}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 58293}], 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'mg motor uk mg4 hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 33590} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 27,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '58b820cf-82d8-5a63-ac61-5c4de479678a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fm23aff',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117574882',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk mg4 hatchback',
     'model': 'mg4 hatchback',
     'odometer': 20872,
     'odometer_in_km': 33590,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33745,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32104,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32735,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/f041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34141,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45657,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55439,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50738,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58293,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-08-17',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'zenith',
     'title': 'mg motor uk mg4 hatchback 150kw trophy ev long range 64kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '150kw trophy ev long range 64kwh 5dr auto',
     'vin': None,
     'year': 2023}
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 58b820cf-82d8-5a63-ac61-5c4de479678a spider: astonbarclay.gb
2025-12-02 19:09:04 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 58b820cf-82d8-5a63-ac61-5c4de479678a due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mg motor uk mg4 hatchback 150kw trophy ev long range 64kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'mg4 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 20872, 'odometer_reading_unit': 'mi', 'registration_date': '2023-08-17', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117574882', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw trophy ev long range 64kwh 5dr auto', 'license_plate': 'fm23aff', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '58b820cf-82d8-5a63-ac61-5c4de479678a', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33745}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32104}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/f041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32735}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45657}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55439}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50738}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 58293}], 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'mg motor uk mg4 hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 33590} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 27,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '58b820cf-82d8-5a63-ac61-5c4de479678a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fm23aff',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117574882',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk mg4 hatchback',
     'model': 'mg4 hatchback',
     'odometer': 20872,
     'odometer_in_km': 33590,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33745,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32104,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32735,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/f041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34141,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45657,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55439,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50738,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58293,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-08-17',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'zenith',
     'title': 'mg motor uk mg4 hatchback 150kw trophy ev long range 64kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '150kw trophy ev long range 64kwh 5dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '58b820cf-82d8-5a63-ac61-5c4de479678a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FM23AFF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117574882',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MG MOTOR UK',
 'model': 'MG4 HATCHBACK',
 'odometer': 20872,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33745,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/18827777-c063-4645-bf10-8a2fa79e594d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32104,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b049c423-47b6-4ed2-82e2-cce15c9ab5ac_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32735,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/f041bb9c-95d5-4702-bf45-0b5378ae1335_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34141,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9ccd19b8-23cf-4806-b02e-479eb9226c8b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45657,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/9cff8984-fdc2-43ed-9b52-43c475afe539_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55439,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/1f055196-4ffb-4373-9fff-025d3edbf15a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50738,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/b8de30d1-e724-43b6-aac9-68de60980f5c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b820cf-82d8-5a63-ac61-5c4de479678a/58b820cf-82d8-5a63-ac61-5c4de479678a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58293,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FM23AFF/2025-11-28/image/2b4629ed-1e04-4f85-ba60-621ae0fad6a7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-17',
 'seller_name': 'Zenith',
 'title': 'MG MOTOR UK MG4 HATCHBACK 150kW Trophy EV Long Range 64kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW Trophy EV Long Range 64kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117574882%27 HTTP/1.1" 200 None
2025-12-02 19:09:04 [astonbarclay.gb] INFO: Saving data for 117574882: {'created_time': 1764702544.969201, 'last_price_update_time': 1764702544.969214, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117574882') HTTP/1.1" 204 0
2025-12-02 19:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 67451644-95be-507f-a155-ac065161e243 with identifier: 117542530
2025-12-02 19:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 67451644-95be-507f-a155-ac065161e243 with identifier: 117542530
2025-12-02 19:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 67451644-95be-507f-a155-ac065161e243 with identifier: 117542530 to the API
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FV71HUK/2025-11-27/image/b7b86cad-5d69-4cd2-ace0-3168703f7695_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '67451644-95be-507f-a155-ac065161e243',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FV71HUK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117542530',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS SALOON',
 'odometer': 44352,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33209,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/93ef1912-7944-44aa-90cc-31290c73eb3c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32781,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/b7b86cad-5d69-4cd2-ace0-3168703f7695_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33957,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/8d3a4e53-5ff8-4492-8448-8ec840226164_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33702,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/5df49d56-939e-4d97-b10e-19e08c8abc1e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55614,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/ddb97a8c-b515-4e38-a5f4-0a625d18e018_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59091,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/a2736ba4-9275-4b14-bb78-d5f49577b8f8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61502,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/43baf93c-c5f2-48a0-9b4c-51c21054eee9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67451644-95be-507f-a155-ac065161e243/67451644-95be-507f-a155-ac065161e243_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64013,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71HUK/2025-11-27/image/dd21a1bf-fe98-4133-9264-b3d43e348087_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seller_name': 'Zenith',
 'title': 'MERCEDES-BENZ E CLASS SALOON E300e AMG Line Edition 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'E300e AMG Line Edition 4dr 9G-Tronic',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542530%27 HTTP/1.1" 200 None
2025-12-02 19:09:05 [astonbarclay.gb] INFO: Saving data for 117542530: {'created_time': 1764702545.347687, 'last_price_update_time': 1764702545.347697, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117542530') HTTP/1.1" 204 0
2025-12-02 19:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a1cb433c-dc51-57a1-baa8-eb359e0ec833 with identifier: 117311401
2025-12-02 19:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a1cb433c-dc51-57a1-baa8-eb359e0ec833 with identifier: 117311401
2025-12-02 19:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a1cb433c-dc51-57a1-baa8-eb359e0ec833 with identifier: 117311401 to the API
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117311401?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'a1cb433c-dc51-57a1-baa8-eb359e0ec833',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YK21FPW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117311401',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF ESTATE',
 'odometer': 66322,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN GOLF ESTATE 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311401%27 HTTP/1.1" 200 None
2025-12-02 19:09:05 [astonbarclay.gb] INFO: Saving data for 117311401: {'auction_closing_time': 1764755100.0, 'created_time': 1763492625.033973, 'last_price_update_time': 1764702545.615632}
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117311401') HTTP/1.1" 204 0
2025-12-02 19:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PN71OEO/2025-12-01/image/5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609383?view=catalogue)
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F5df7a42f-bdc2-4472-98ff-d0f87bc5bae0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/5df7a42f-bdc2-4472-98ff-d0f87bc5bae0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PN71OEO/2025-12-01/image/ece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609383?view=catalogue)
2025-12-02 19:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY72ASX/2025-12-01/image/fbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101420?view=catalogue)
2025-12-02 19:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY72ASX/2025-12-01/image/6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101420?view=catalogue)
2025-12-02 19:09:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1e52550>
2025-12-02 19:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf059a250>
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252Fc0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0318cd0>
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMF71ZPO%252F2025-12-01%252Fimage%252F73f9b7db-4a11-45c2-bc16-39a7e400233e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/73f9b7db-4a11-45c2-bc16-39a7e400233e_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13
2025-12-02 19:09:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13, skipping ID generation
2025-12-02 19:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13 with scrape type 1
2025-12-02 19:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13 from tracking dictionaries
2025-12-02 19:09:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13 sending to next pipeline
2025-12-02 19:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13, identifier: 117509080
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1e52550>
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252Fce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/ce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f078946-171f-5caa-940b-454aafb1ea0e
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf034aad0>
2025-12-02 19:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252Fa25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/a25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04de890>
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252Fe0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/e0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4f48589-fe70-55fd-8be4-3136f685545b
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf051d590>
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252F4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f078946-171f-5caa-940b-454aafb1ea0e
2025-12-02 19:09:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117565754, 'registration': 'MW72SFX', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'Long Range AWD 5dr Auto', 'mileage': 38454, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-28', 'fuel': 'Electric', 'motExpiry': '2026-11-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f9f006c0-f42f-433b-b54a-6f8930b70e94_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/387a3882-2d08-4b4a-99ba-9c8b2529c048_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/987ee527-6f1d-49bc-b22e-d995dc82b498_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/80f484d1-13e0-4c7c-9082-ecb00974b775_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f4841b27-2a08-4edb-ad04-5087d2d04163_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/6cac10cd-0902-43fa-8341-f7ca8c78cab3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/4778f5d6-328b-44d2-a46d-08e39f557ddd_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/482bf1d0-d6c9-495f-b85a-6e951f024b1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f33995c2-d7ec-4817-a703-2abf5dc9d85b_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**754**VOSA STATES 37K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/faefb2b6-7ed7-4072-b14b-0d6fa8281d2a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117565754, 'registration': 'MW72SFX', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'Long Range AWD 5dr Auto', 'mileage': 38454, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 250}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-28', 'fuel': 'Electric', 'motExpiry': '2026-11-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f9f006c0-f42f-433b-b54a-6f8930b70e94_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/387a3882-2d08-4b4a-99ba-9c8b2529c048_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/987ee527-6f1d-49bc-b22e-d995dc82b498_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/80f484d1-13e0-4c7c-9082-ecb00974b775_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f4841b27-2a08-4edb-ad04-5087d2d04163_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/6cac10cd-0902-43fa-8341-f7ca8c78cab3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/4778f5d6-328b-44d2-a46d-08e39f557ddd_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/482bf1d0-d6c9-495f-b85a-6e951f024b1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f33995c2-d7ec-4817-a703-2abf5dc9d85b_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**754**VOSA STATES 37K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/faefb2b6-7ed7-4072-b14b-0d6fa8281d2a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf046c63-aff0-5623-80bb-a7603fe43dfb with identifier: 117565754
2025-12-02 19:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf046c63-aff0-5623-80bb-a7603fe43dfb with scrape type 1
2025-12-02 19:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item cf046c63-aff0-5623-80bb-a7603fe43dfb
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252Ff9f006c0-f42f-433b-b54a-6f8930b70e94_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f9f006c0-f42f-433b-b54a-6f8930b70e94_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117406459, 'registration': 'WX71NZJ', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'B CLASS HATCHBACK', 'derivative': 'B250e AMG Line Premium Plus 5dr Auto', 'mileage': 47814, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-10', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-06-26', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/2ab3d3e6-ff8c-4ffe-a0b2-ccb7068e8a7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e2a8b75c-6bd3-48ac-b908-772ee7331c70_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/1279ce62-0ded-435b-9a80-80306f4fa1b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/7f6182ca-e34a-46ec-b177-92027e30a712_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/3801b498-db09-42d0-8295-a80d1978a514_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/46a69a73-a5c3-4ec3-aba3-a5de5749919a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e9c65861-5edf-48bb-add9-1c122dc77b66_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/fd7d86a1-4bb4-4fd2-a8f5-8b74d5776b74_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24 27k 07/25 45k', 'remarks': 'VOSA STATES 32K 43K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4f897ed5-edff-4dad-b332-9f54ff04a8fb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:09:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117406459, 'registration': 'WX71NZJ', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'B CLASS HATCHBACK', 'derivative': 'B250e AMG Line Premium Plus 5dr Auto', 'mileage': 47814, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-10', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-06-26', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/2ab3d3e6-ff8c-4ffe-a0b2-ccb7068e8a7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e2a8b75c-6bd3-48ac-b908-772ee7331c70_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/1279ce62-0ded-435b-9a80-80306f4fa1b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/7f6182ca-e34a-46ec-b177-92027e30a712_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/3801b498-db09-42d0-8295-a80d1978a514_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/46a69a73-a5c3-4ec3-aba3-a5de5749919a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e9c65861-5edf-48bb-add9-1c122dc77b66_removebg.jpg?w=600', 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/fd7d86a1-4bb4-4fd2-a8f5-8b74d5776b74_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24 27k 07/25 45k', 'remarks': 'VOSA STATES 32K 43K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4f897ed5-edff-4dad-b332-9f54ff04a8fb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 204aeabf-4af5-5825-8c2d-b6fc65345f80 with identifier: 117406459
2025-12-02 19:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 204aeabf-4af5-5825-8c2d-b6fc65345f80 with scrape type 1
2025-12-02 19:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 204aeabf-4af5-5825-8c2d-b6fc65345f80
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252F2ab3d3e6-ff8c-4ffe-a0b2-ccb7068e8a7f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/2ab3d3e6-ff8c-4ffe-a0b2-ccb7068e8a7f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TVC/2025-11-28/image/1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117458227?view=catalogue)
2025-12-02 19:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KR70ATV/2025-12-01/image/2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117363031?view=catalogue)
2025-12-02 19:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FG71HUK/2025-12-01/image/812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117571604?view=catalogue)
2025-12-02 19:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PN71OEO/2025-12-01/image/fb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609383?view=catalogue)
2025-12-02 19:09:07 [scrapy.extensions.logstats] INFO: Crawled 429 pages (at 44 pages/min), scraped 296 items (at 46 items/min)
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252Fd29783a6-55cd-4043-9670-afd3b9870c0c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d29783a6-55cd-4043-9670-afd3b9870c0c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13 with identifier: 117509080
2025-12-02 19:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13 with identifier: 117509080
2025-12-02 19:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13 with identifier: 117509080 to the API
2025-12-02 19:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/73f9b7db-4a11-45c2-bc16-39a7e400233e_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MF71ZPO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117509080',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 43881,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32048,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/586ed5fc-7b63-4291-bb1e-88c199ed2e00_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31922,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/73f9b7db-4a11-45c2-bc16-39a7e400233e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34511,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/08710b9a-b628-4ae5-854d-f30e54e6fa5c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30114,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/b26a89c1-daac-4a9e-987f-36b0d7c88f8f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47247,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/8fe4f446-4a0f-4a18-b7eb-b8fb00880cc4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59305,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/324d9d14-7e26-451f-91fc-0496aed50a0c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46933,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/514aa7b7-ed0e-4db8-b39d-43f95c925fe3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60418,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/6bca9b24-0fd7-4d6d-b11d-ef4f9157e1fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13/4b87c6e1-7cfc-5fec-bf9c-de22a44b2e13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57019,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MF71ZPO/2025-12-01/image/c4863142-caf0-474c-a195-489bdabba450_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-27',
 'seller_name': 'Zenith',
 'title': 'BMW 3 SERIES TOURING 330e xDrive Sport Pro 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e xDrive Sport Pro 5dr Step Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509080%27 HTTP/1.1" 200 None
2025-12-02 19:09:08 [astonbarclay.gb] INFO: Saving data for 117509080: {'created_time': 1764702548.223497, 'last_price_update_time': 1764702548.223506, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117509080') HTTP/1.1" 204 0
2025-12-02 19:09:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F387a3882-2d08-4b4a-99ba-9c8b2529c048_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/387a3882-2d08-4b4a-99ba-9c8b2529c048_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252Fe2a8b75c-6bd3-48ac-b908-772ee7331c70_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e2a8b75c-6bd3-48ac-b908-772ee7331c70_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117366645?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117138563?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf039bdd0>
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252F5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881
2025-12-02 19:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71TVC/2025-11-28/image/b930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117458227?view=catalogue)
2025-12-02 19:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/bd6732cc-850d-418b-ae4d-1b61adcc4c2f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY72ASX/2025-12-01/image/abee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101420?view=catalogue)
2025-12-02 19:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e7f80ee4-b832-4398-bead-401ee8512cbe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252Fd5f9432d-0ff8-4478-ab48-e087e6dc0b08_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d5f9432d-0ff8-4478-ab48-e087e6dc0b08_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0995650>
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252Fece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/ece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0827250>
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252Ffbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/fbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4f48589-fe70-55fd-8be4-3136f685545b
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0997e90>
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252F6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4f48589-fe70-55fd-8be4-3136f685545b
2025-12-02 19:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71FNE/2025-12-01/image/4661e44e-a752-4c73-bc8f-d5174ddf04ed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117344624?view=catalogue)
2025-12-02 19:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/863df404-cf96-49f7-bac4-cdba94a8e373_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F987ee527-6f1d-49bc-b22e-d995dc82b498_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/987ee527-6f1d-49bc-b22e-d995dc82b498_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252F1279ce62-0ded-435b-9a80-80306f4fa1b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/1279ce62-0ded-435b-9a80-80306f4fa1b3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0779e90>
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252F1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08cb1562-d169-5941-bed4-70781c82a521
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0778810>
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKR70ATV%252F2025-12-01%252Fimage%252F2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KR70ATV/2025-12-01/image/2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba
2025-12-02 19:09:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bfeeef3-c0e9-5f08-ab82-702162b70aba, skipping ID generation
2025-12-02 19:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba with scrape type 1
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7bfeeef3-c0e9-5f08-ab82-702162b70aba from tracking dictionaries
2025-12-02 19:09:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bfeeef3-c0e9-5f08-ab82-702162b70aba sending to next pipeline
2025-12-02 19:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7bfeeef3-c0e9-5f08-ab82-702162b70aba, identifier: 117363031
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf093a610>
2025-12-02 19:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFG71HUK%252F2025-12-01%252Fimage%252F812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FG71HUK/2025-12-01/image/812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f078946-171f-5caa-940b-454aafb1ea0e
2025-12-02 19:09:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f078946-171f-5caa-940b-454aafb1ea0e, skipping ID generation
2025-12-02 19:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f078946-171f-5caa-940b-454aafb1ea0e with scrape type 1
2025-12-02 19:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8f078946-171f-5caa-940b-454aafb1ea0e from tracking dictionaries
2025-12-02 19:09:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f078946-171f-5caa-940b-454aafb1ea0e sending to next pipeline
2025-12-02 19:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8f078946-171f-5caa-940b-454aafb1ea0e, identifier: 117571604
2025-12-02 19:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0864a50>
2025-12-02 19:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPN71OEO%252F2025-12-01%252Fimage%252Ffb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PN71OEO/2025-12-01/image/fb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881
2025-12-02 19:09:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881, skipping ID generation
2025-12-02 19:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881 with scrape type 1
2025-12-02 19:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881 from tracking dictionaries
2025-12-02 19:09:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881 sending to next pipeline
2025-12-02 19:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881, identifier: 117609383
2025-12-02 19:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5d137294-3663-4e0d-bc22-109a05effe4a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662004?view=catalogue)
2025-12-02 19:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71FNE/2025-12-01/image/5df7a42f-bdc2-4472-98ff-d0f87bc5bae0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117344624?view=catalogue)
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F6bcc7bde-4449-4b97-8b11-5e90e0ea2b9a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/6bcc7bde-4449-4b97-8b11-5e90e0ea2b9a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7bfeeef3-c0e9-5f08-ab82-702162b70aba with identifier: 117363031
2025-12-02 19:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7bfeeef3-c0e9-5f08-ab82-702162b70aba with identifier: 117363031
2025-12-02 19:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'seat mii electric hatchback 61kw one 36.8kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'seat', 'model': 'mii electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 17769, 'odometer_reading_unit': 'mi', 'registration_date': '2020-12-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117363031', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '61kw one 36.8kwh 5dr auto', 'license_plate': 'kr70atv', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '7bfeeef3-c0e9-5f08-ab82-702162b70aba', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29889}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30404}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27187}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 26781}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/a25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49591}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/afc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56138}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 10302}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 65370}], 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'seat mii electric hatchback', 'sanitized_make': 'seat', 'odometer_in_km': 28596} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '7bfeeef3-c0e9-5f08-ab82-702162b70aba',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'kr70atv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117363031',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'seat',
     'make_model': 'seat mii electric hatchback',
     'model': 'mii electric hatchback',
     'odometer': 17769,
     'odometer_in_km': 28596,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29889,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30404,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27187,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26781,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49591,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/a25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56138,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/afc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 10302,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65370,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-01',
     'sanitized_make': 'seat',
     'seller_name': 'zenith',
     'title': 'seat mii electric hatchback 61kw one 36.8kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '61kw one 36.8kwh 5dr auto',
     'vin': None,
     'year': 2020}
2025-12-02 19:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 7bfeeef3-c0e9-5f08-ab82-702162b70aba spider: astonbarclay.gb
2025-12-02 19:09:10 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7bfeeef3-c0e9-5f08-ab82-702162b70aba due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'seat mii electric hatchback 61kw one 36.8kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'seat', 'model': 'mii electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 17769, 'odometer_reading_unit': 'mi', 'registration_date': '2020-12-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117363031', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '61kw one 36.8kwh 5dr auto', 'license_plate': 'kr70atv', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '7bfeeef3-c0e9-5f08-ab82-702162b70aba', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29889}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30404}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27187}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 26781}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/a25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49591}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/afc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56138}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 10302}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 65370}], 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'seat mii electric hatchback', 'sanitized_make': 'seat', 'odometer_in_km': 28596} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '7bfeeef3-c0e9-5f08-ab82-702162b70aba',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'kr70atv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117363031',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'seat',
     'make_model': 'seat mii electric hatchback',
     'model': 'mii electric hatchback',
     'odometer': 17769,
     'odometer_in_km': 28596,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29889,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30404,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27187,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26781,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49591,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/a25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56138,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/afc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 10302,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65370,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-01',
     'sanitized_make': 'seat',
     'seller_name': 'zenith',
     'title': 'seat mii electric hatchback 61kw one 36.8kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '61kw one 36.8kwh 5dr auto',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '7bfeeef3-c0e9-5f08-ab82-702162b70aba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KR70ATV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117363031',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SEAT',
 'model': 'MII ELECTRIC HATCHBACK',
 'odometer': 17769,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29889,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/2cfcc14c-93a3-4310-8f75-08cd6aa0ee70_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30404,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/7a4175bb-e7f6-4efa-9aa8-83b58b80d41c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27187,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/696cbcbf-335b-4645-b489-5052e050c96d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26781,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/9f355210-0167-4c64-89a8-cb1170bd7bed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49591,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/a25bde7b-9098-48ba-8b9d-7761c0abdea9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56138,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/afc51863-ab58-415a-ab08-422569cbf82e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 10302,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/497d9b43-1e5c-4bb7-b7d5-2f3dca3824d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfeeef3-c0e9-5f08-ab82-702162b70aba/7bfeeef3-c0e9-5f08-ab82-702162b70aba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65370,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KR70ATV/2025-12-01/image/82613dab-810e-4344-bb1f-70e1c61eb2ff_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seller_name': 'Zenith',
 'title': 'SEAT MII ELECTRIC HATCHBACK 61kW One 36.8kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '61kW One 36.8kWh 5dr Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117363031%27 HTTP/1.1" 200 None
2025-12-02 19:09:10 [astonbarclay.gb] INFO: Saving data for 117363031: {'created_time': 1764702550.980051, 'last_price_update_time': 1764702550.980063, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117363031') HTTP/1.1" 204 0
2025-12-02 19:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8f078946-171f-5caa-940b-454aafb1ea0e with identifier: 117571604
2025-12-02 19:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8f078946-171f-5caa-940b-454aafb1ea0e with identifier: 117571604
2025-12-02 19:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw ix3 electric estate 210kw premier edition 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'ix3 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 27438, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117571604', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '210kw premier edition 80kwh 5dr auto', 'license_plate': 'fg71huk', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '8f078946-171f-5caa-940b-454aafb1ea0e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30480}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/f44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30640}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/d518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29059}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30315}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55496}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53808}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/ce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54410}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 63697}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'bmw ix3 electric estate', 'sanitized_make': 'bmw', 'odometer_in_km': 44157} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '8f078946-171f-5caa-940b-454aafb1ea0e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fg71huk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117571604',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw ix3 electric estate',
     'model': 'ix3 electric estate',
     'odometer': 27438,
     'odometer_in_km': 44157,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30480,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30640,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/f44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29059,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/d518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30315,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55496,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53808,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54410,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/ce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63697,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-23',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw ix3 electric estate 210kw premier edition 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '210kw premier edition 80kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 8f078946-171f-5caa-940b-454aafb1ea0e spider: astonbarclay.gb
2025-12-02 19:09:11 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8f078946-171f-5caa-940b-454aafb1ea0e due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw ix3 electric estate 210kw premier edition 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'ix3 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 27438, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117571604', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '210kw premier edition 80kwh 5dr auto', 'license_plate': 'fg71huk', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '8f078946-171f-5caa-940b-454aafb1ea0e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30480}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/f44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30640}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/d518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29059}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30315}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55496}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53808}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/ce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54410}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 63697}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'bmw ix3 electric estate', 'sanitized_make': 'bmw', 'odometer_in_km': 44157} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '8f078946-171f-5caa-940b-454aafb1ea0e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fg71huk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117571604',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw ix3 electric estate',
     'model': 'ix3 electric estate',
     'odometer': 27438,
     'odometer_in_km': 44157,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30480,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30640,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/f44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29059,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/d518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30315,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55496,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53808,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54410,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/ce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63697,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-23',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw ix3 electric estate 210kw premier edition 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '210kw premier edition 80kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '8f078946-171f-5caa-940b-454aafb1ea0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FG71HUK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117571604',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': 'iX3 ELECTRIC ESTATE',
 'odometer': 27438,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30480,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/812d5bb9-c9e9-4d46-a4ee-3b84d04a75fd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30640,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/f44a9175-682c-421f-b525-74af468a0ea4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29059,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/d518fab6-3ed3-49c0-ad4e-d71f8ba08b3d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30315,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/6252c3df-03f0-4d66-9906-0260fed74ded_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55496,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/4af05bbe-db49-445b-b0dd-7ea902b04b9e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53808,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/90769d68-314b-4c0d-9026-c8c9f9a06ddf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54410,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/ce89c664-0ce3-4ee3-92e8-57de778597db_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f078946-171f-5caa-940b-454aafb1ea0e/8f078946-171f-5caa-940b-454aafb1ea0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63697,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FG71HUK/2025-12-01/image/8349e621-ce4e-4ca3-89ff-d06efbd92e15_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': 'Zenith',
 'title': 'BMW iX3 ELECTRIC ESTATE 210kW Premier Edition 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '210kW Premier Edition 80kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571604%27 HTTP/1.1" 200 None
2025-12-02 19:09:11 [astonbarclay.gb] INFO: Saving data for 117571604: {'created_time': 1764702551.21576, 'last_price_update_time': 1764702551.215769, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117571604') HTTP/1.1" 204 0
2025-12-02 19:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881 with identifier: 117609383
2025-12-02 19:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881 with identifier: 117609383
2025-12-02 19:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen id.3 hatchback 150kw tour pro s 77kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.3 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 29823, 'odometer_reading_unit': 'mi', 'registration_date': '2021-09-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609383', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw tour pro s 77kwh 5dr auto', 'license_plate': 'pn71oeo', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '3de0fbba-9900-5c1c-a8a6-d6fe9cdce881', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/fb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30083}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28875}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/ece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30253}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29859}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41998}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55629}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41110}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/d5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45509}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53752}], 'current_year_diff': 4, 'age_in_months': 51, 'make_model': 'volkswagen id.3 hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 47995} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '3de0fbba-9900-5c1c-a8a6-d6fe9cdce881',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'pn71oeo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609383',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.3 hatchback',
     'model': 'id.3 hatchback',
     'odometer': 29823,
     'odometer_in_km': 47995,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30083,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/fb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28875,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30253,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/ece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29859,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41998,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55629,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41110,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45509,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/d5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53752,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-01',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen id.3 hatchback 150kw tour pro s 77kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw tour pro s 77kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881 spider: astonbarclay.gb
2025-12-02 19:09:11 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 3de0fbba-9900-5c1c-a8a6-d6fe9cdce881 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen id.3 hatchback 150kw tour pro s 77kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.3 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 29823, 'odometer_reading_unit': 'mi', 'registration_date': '2021-09-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609383', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw tour pro s 77kwh 5dr auto', 'license_plate': 'pn71oeo', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '3de0fbba-9900-5c1c-a8a6-d6fe9cdce881', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/fb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30083}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28875}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/ece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30253}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29859}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41998}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55629}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41110}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/d5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45509}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53752}], 'current_year_diff': 4, 'age_in_months': 51, 'make_model': 'volkswagen id.3 hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 47995} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '3de0fbba-9900-5c1c-a8a6-d6fe9cdce881',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'pn71oeo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609383',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.3 hatchback',
     'model': 'id.3 hatchback',
     'odometer': 29823,
     'odometer_in_km': 47995,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30083,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/fb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28875,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30253,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/ece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29859,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41998,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55629,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41110,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45509,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/d5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53752,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-01',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen id.3 hatchback 150kw tour pro s 77kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw tour pro s 77kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '3de0fbba-9900-5c1c-a8a6-d6fe9cdce881',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'PN71OEO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609383',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'ID.3 HATCHBACK',
 'odometer': 29823,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30083,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/fb3b8a95-cdeb-4144-95f0-0360a59972b2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28875,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c9eae3c8-8fba-47c9-9d80-e168f7a2ec07_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30253,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/ece9f6d4-fe2b-40af-ba00-f51d78f15ab5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29859,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/54c33cd4-fb58-4f04-9a47-52dee8d703ab_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41998,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/5e33724e-e838-4676-aaf1-63fba0a0e2bb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55629,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/7e57a331-f99e-4887-90d7-d4a5c8559b8c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41110,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/c0190fa9-f785-4ab9-81d2-9b06eea9dc40_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45509,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/d5c67a49-2540-4fc0-be1f-c0e07321f6dc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3de0fbba-9900-5c1c-a8a6-d6fe9cdce881/3de0fbba-9900-5c1c-a8a6-d6fe9cdce881_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53752,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PN71OEO/2025-12-01/image/2343007f-319e-40e1-a6ef-7236cd2424b9_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-01',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN ID.3 HATCHBACK 150kW Tour Pro S 77kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW Tour Pro S 77kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609383%27 HTTP/1.1" 200 None
2025-12-02 19:09:11 [astonbarclay.gb] INFO: Saving data for 117609383: {'created_time': 1764702551.452723, 'last_price_update_time': 1764702551.452733, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117609383') HTTP/1.1" 204 0
2025-12-02 19:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117366645, 'registration': 'FD21MBX', 'account': 'ZEN002', 'make': 'BMW', 'model': 'X1 ESTATE', 'derivative': 'xDrive 25e M Sport 5dr Auto', 'mileage': 89102, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-05-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-03-17', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FD21MBX/2025-11-21/image/a5c0d13c-3375-41f9-8842-98a5c7e622a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/0faee6e6-0d97-4aac-b7c0-5f0d828b1861_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/cd109215-32c9-4bed-8be4-445c46578aac_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/761bffc9-5f72-4316-90bd-73d5f000a3bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/cedb8d15-9400-4825-9d60-45e545fd4245_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/da2e148d-5c13-4315-b97a-280ed838fa85_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/72612986-e89e-4bc0-8ee6-dca97d00fe7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/f2f4ff42-1f66-4456-b492-2a8d420b6d70_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 04/24-52K, 01/25-69K, 03/25-72K,', 'remarks': 'VOSA STATES 52K, 72K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 43, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3e7a3db7-57c6-445b-8c2e-4eea1bec02db.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:09:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117366645, 'registration': 'FD21MBX', 'account': 'ZEN002', 'make': 'BMW', 'model': 'X1 ESTATE', 'derivative': 'xDrive 25e M Sport 5dr Auto', 'mileage': 89102, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-05-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-03-17', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FD21MBX/2025-11-21/image/a5c0d13c-3375-41f9-8842-98a5c7e622a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/0faee6e6-0d97-4aac-b7c0-5f0d828b1861_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/cd109215-32c9-4bed-8be4-445c46578aac_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/761bffc9-5f72-4316-90bd-73d5f000a3bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/cedb8d15-9400-4825-9d60-45e545fd4245_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/da2e148d-5c13-4315-b97a-280ed838fa85_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/72612986-e89e-4bc0-8ee6-dca97d00fe7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD21MBX/2025-11-21/image/f2f4ff42-1f66-4456-b492-2a8d420b6d70_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 04/24-52K, 01/25-69K, 03/25-72K,', 'remarks': 'VOSA STATES 52K, 72K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 43, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3e7a3db7-57c6-445b-8c2e-4eea1bec02db.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3068bec-211b-57c8-9e7e-2eb4d580b59f with identifier: 117366645
2025-12-02 19:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3068bec-211b-57c8-9e7e-2eb4d580b59f with scrape type 2
2025-12-02 19:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3068bec-211b-57c8-9e7e-2eb4d580b59f with scrape type 2
2025-12-02 19:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a3068bec-211b-57c8-9e7e-2eb4d580b59f, identifier: 117366645
2025-12-02 19:09:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117138563, 'registration': 'AO74EWU', 'account': 'ZEN002', 'make': 'BMW', 'model': 'I4 GRAN COUPE', 'derivative': '210kW eDrive35 M Sport 70kWh 5dr Auto', 'mileage': 18883, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-06', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO74EWU/2025-11-14/image/a555a95d-48cb-4406-9934-1ed2a8b935b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/597fd548-302b-4538-909b-f1fe17d6e655_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/5ab1fd53-9f9c-457b-80cd-6f290930fce2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/8905a49b-1943-4d9a-a673-fe89f27628d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/4324349f-97b4-45e5-bdc3-8762f70bffec_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/be504f2a-ab23-48d2-b50b-2fb251a725ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/25414d50-e98a-4093-8070-93dfd9ad7818_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/0d7e2625-0422-4694-b6ee-91b0fe9ffc6e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f747bc70-6e87-4e65-b175-598ffe251bef.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117138563, 'registration': 'AO74EWU', 'account': 'ZEN002', 'make': 'BMW', 'model': 'I4 GRAN COUPE', 'derivative': '210kW eDrive35 M Sport 70kWh 5dr Auto', 'mileage': 18883, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-06', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO74EWU/2025-11-14/image/a555a95d-48cb-4406-9934-1ed2a8b935b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/597fd548-302b-4538-909b-f1fe17d6e655_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/5ab1fd53-9f9c-457b-80cd-6f290930fce2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/8905a49b-1943-4d9a-a673-fe89f27628d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/4324349f-97b4-45e5-bdc3-8762f70bffec_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/be504f2a-ab23-48d2-b50b-2fb251a725ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/25414d50-e98a-4093-8070-93dfd9ad7818_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74EWU/2025-11-14/image/0d7e2625-0422-4694-b6ee-91b0fe9ffc6e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f747bc70-6e87-4e65-b175-598ffe251bef.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcc8170f-cfec-5422-802c-923d4eb1e109 with identifier: 117138563
2025-12-02 19:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcc8170f-cfec-5422-802c-923d4eb1e109 with scrape type 2
2025-12-02 19:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcc8170f-cfec-5422-802c-923d4eb1e109 with scrape type 2
2025-12-02 19:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bcc8170f-cfec-5422-802c-923d4eb1e109, identifier: 117138563
2025-12-02 19:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b57135eb-720c-4442-9ceb-0f18db403817_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F80f484d1-13e0-4c7c-9082-ecb00974b775_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/80f484d1-13e0-4c7c-9082-ecb00974b775_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252F7f6182ca-e34a-46ec-b177-92027e30a712_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/7f6182ca-e34a-46ec-b177-92027e30a712_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a3068bec-211b-57c8-9e7e-2eb4d580b59f with identifier: 117366645
2025-12-02 19:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a3068bec-211b-57c8-9e7e-2eb4d580b59f with identifier: 117366645
2025-12-02 19:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a3068bec-211b-57c8-9e7e-2eb4d580b59f with identifier: 117366645 to the API
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117366645?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'a3068bec-211b-57c8-9e7e-2eb4d580b59f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FD21MBX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117366645',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': 'X1 ESTATE',
 'odometer': 89102,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seller_name': 'Zenith',
 'title': 'BMW X1 ESTATE xDrive 25e M Sport 5dr Auto',
 'transmission': 'automatic',
 'trim': 'xDrive 25e M Sport 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366645%27 HTTP/1.1" 200 None
2025-12-02 19:09:11 [astonbarclay.gb] INFO: Saving data for 117366645: {'auction_closing_time': 1764842400.0, 'created_time': 1764097335.84844, 'last_price_update_time': 1764702551.973889}
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117366645') HTTP/1.1" 204 0
2025-12-02 19:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bcc8170f-cfec-5422-802c-923d4eb1e109 with identifier: 117138563
2025-12-02 19:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bcc8170f-cfec-5422-802c-923d4eb1e109 with identifier: 117138563
2025-12-02 19:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw i4 gran coupe 210kw edrive35 m sport 70kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i4 gran coupe', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 18883, 'odometer_reading_unit': 'mi', 'registration_date': '2024-09-06', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117138563', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '210kw edrive35 m sport 70kwh 5dr auto', 'license_plate': 'ao74ewu', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'bcc8170f-cfec-5422-802c-923d4eb1e109', 'current_year_diff': 1, 'age_in_months': 14, 'make_model': 'bmw i4 gran coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 30389} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 14,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'bcc8170f-cfec-5422-802c-923d4eb1e109',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ao74ewu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117138563',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw i4 gran coupe',
     'model': 'i4 gran coupe',
     'odometer': 18883,
     'odometer_in_km': 30389,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-09-06',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw i4 gran coupe 210kw edrive35 m sport 70kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw edrive35 m sport 70kwh 5dr auto',
     'vin': None,
     'year': 2024}
2025-12-02 19:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: bcc8170f-cfec-5422-802c-923d4eb1e109 spider: astonbarclay.gb
2025-12-02 19:09:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: bcc8170f-cfec-5422-802c-923d4eb1e109 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw i4 gran coupe 210kw edrive35 m sport 70kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i4 gran coupe', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 18883, 'odometer_reading_unit': 'mi', 'registration_date': '2024-09-06', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117138563', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '210kw edrive35 m sport 70kwh 5dr auto', 'license_plate': 'ao74ewu', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'bcc8170f-cfec-5422-802c-923d4eb1e109', 'current_year_diff': 1, 'age_in_months': 14, 'make_model': 'bmw i4 gran coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 30389} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 14,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'bcc8170f-cfec-5422-802c-923d4eb1e109',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ao74ewu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117138563',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw i4 gran coupe',
     'model': 'i4 gran coupe',
     'odometer': 18883,
     'odometer_in_km': 30389,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-09-06',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw i4 gran coupe 210kw edrive35 m sport 70kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw edrive35 m sport 70kwh 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'bcc8170f-cfec-5422-802c-923d4eb1e109',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AO74EWU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117138563',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': 'I4 GRAN COUPE',
 'odometer': 18883,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-06',
 'seller_name': 'Zenith',
 'title': 'BMW I4 GRAN COUPE 210kW eDrive35 M Sport 70kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '210kW eDrive35 M Sport 70kWh 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117138563%27 HTTP/1.1" 200 None
2025-12-02 19:09:12 [astonbarclay.gb] INFO: Saving data for 117138563: {'created_time': 1764356699.893981, 'last_price_update_time': 1764702552.188948, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117138563') HTTP/1.1" 204 0
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b3fb90>
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71TVC%252F2025-11-28%252Fimage%252Fb930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71TVC/2025-11-28/image/b930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08cb1562-d169-5941-bed4-70781c82a521
2025-12-02 19:09:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08cb1562-d169-5941-bed4-70781c82a521, skipping ID generation
2025-12-02 19:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08cb1562-d169-5941-bed4-70781c82a521 with scrape type 1
2025-12-02 19:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 08cb1562-d169-5941-bed4-70781c82a521 from tracking dictionaries
2025-12-02 19:09:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08cb1562-d169-5941-bed4-70781c82a521 sending to next pipeline
2025-12-02 19:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 08cb1562-d169-5941-bed4-70781c82a521, identifier: 117458227
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac1d10>
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fbd6732cc-850d-418b-ae4d-1b61adcc4c2f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/bd6732cc-850d-418b-ae4d-1b61adcc4c2f_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0744e90>
2025-12-02 19:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY72ASX%252F2025-12-01%252Fimage%252Fabee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY72ASX/2025-12-01/image/abee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4f48589-fe70-55fd-8be4-3136f685545b
2025-12-02 19:09:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4f48589-fe70-55fd-8be4-3136f685545b, skipping ID generation
2025-12-02 19:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4f48589-fe70-55fd-8be4-3136f685545b with scrape type 1
2025-12-02 19:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d4f48589-fe70-55fd-8be4-3136f685545b from tracking dictionaries
2025-12-02 19:09:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4f48589-fe70-55fd-8be4-3136f685545b sending to next pipeline
2025-12-02 19:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d4f48589-fe70-55fd-8be4-3136f685545b, identifier: 117101420
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0769e90>
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252Fe7f80ee4-b832-4398-bead-401ee8512cbe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e7f80ee4-b832-4398-bead-401ee8512cbe_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b23d06a7-b4b6-41c6-bd7e-095b8b10a14e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117590985?view=catalogue)
2025-12-02 19:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/2ab3d3e6-ff8c-4ffe-a0b2-ccb7068e8a7f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406459?view=catalogue)
2025-12-02 19:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f9f006c0-f42f-433b-b54a-6f8930b70e94_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565754?view=catalogue)
2025-12-02 19:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d29783a6-55cd-4043-9670-afd3b9870c0c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117344624?view=catalogue)
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F2bb1ce6b-20be-4e4e-a7c3-13436491d64b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/2bb1ce6b-20be-4e4e-a7c3-13436491d64b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 08cb1562-d169-5941-bed4-70781c82a521 with identifier: 117458227
2025-12-02 19:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 08cb1562-d169-5941-bed4-70781c82a521 with identifier: 117458227
2025-12-02 19:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'peugeot e-2008 electric estate 100kw allure premium 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-2008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 44569, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117458227', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw allure premium 50kwh 5dr auto', 'license_plate': 'ov71tvc', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '08cb1562-d169-5941-bed4-70781c82a521', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31247}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/b930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31068}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/d19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28274}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27181}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/acaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49283}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41801}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 8595}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/f48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52232}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'peugeot e-2008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 71726} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '08cb1562-d169-5941-bed4-70781c82a521',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ov71tvc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117458227',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'peugeot',
     'make_model': 'peugeot e-2008 electric estate',
     'model': 'e-2008 electric estate',
     'odometer': 44569,
     'odometer_in_km': 71726,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31247,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31068,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/b930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28274,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/d19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27181,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49283,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/acaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41801,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 8595,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52232,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/f48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-25',
     'sanitized_make': 'peugeot',
     'seller_name': 'zenith',
     'title': 'peugeot e-2008 electric estate 100kw allure premium 50kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '100kw allure premium 50kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 08cb1562-d169-5941-bed4-70781c82a521 spider: astonbarclay.gb
2025-12-02 19:09:13 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 08cb1562-d169-5941-bed4-70781c82a521 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'peugeot e-2008 electric estate 100kw allure premium 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-2008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 44569, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117458227', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw allure premium 50kwh 5dr auto', 'license_plate': 'ov71tvc', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '08cb1562-d169-5941-bed4-70781c82a521', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31247}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/b930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31068}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/d19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28274}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27181}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/acaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49283}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41801}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 8595}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/f48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52232}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'peugeot e-2008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 71726} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '08cb1562-d169-5941-bed4-70781c82a521',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ov71tvc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117458227',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'peugeot',
     'make_model': 'peugeot e-2008 electric estate',
     'model': 'e-2008 electric estate',
     'odometer': 44569,
     'odometer_in_km': 71726,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31247,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31068,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/b930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28274,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/d19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27181,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49283,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/acaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41801,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 8595,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52232,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/f48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-25',
     'sanitized_make': 'peugeot',
     'seller_name': 'zenith',
     'title': 'peugeot e-2008 electric estate 100kw allure premium 50kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '100kw allure premium 50kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '08cb1562-d169-5941-bed4-70781c82a521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OV71TVC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117458227',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'PEUGEOT',
 'model': 'E-2008 ELECTRIC ESTATE',
 'odometer': 44569,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31247,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/774692ff-49ad-4359-b33d-ce1449219d60_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31068,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/b930b412-444d-4609-a1c7-0f590545c2ff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28274,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/d19bcbb4-4b19-4572-b0fe-d4bf3be017ca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27181,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/1fc5d669-01d9-480c-87af-267ac012c892_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49283,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/acaa476b-6cda-4ffa-ac83-49bcdc64adbc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41801,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/286c53c0-1320-4f67-8d21-b1bedcc8b23c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 8595,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/8d9d7382-318f-4cfd-84c9-75c5026e4eb1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb1562-d169-5941-bed4-70781c82a521/08cb1562-d169-5941-bed4-70781c82a521_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52232,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71TVC/2025-11-28/image/f48a9aa6-5ba9-48c5-9307-c822f5c4c3af_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seller_name': 'Zenith',
 'title': 'PEUGEOT E-2008 ELECTRIC ESTATE 100kW Allure Premium 50kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Allure Premium 50kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458227%27 HTTP/1.1" 200 None
2025-12-02 19:09:13 [astonbarclay.gb] INFO: Saving data for 117458227: {'created_time': 1764702553.617659, 'last_price_update_time': 1764702553.617669, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117458227') HTTP/1.1" 204 0
2025-12-02 19:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d4f48589-fe70-55fd-8be4-3136f685545b with identifier: 117101420
2025-12-02 19:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d4f48589-fe70-55fd-8be4-3136f685545b with identifier: 117101420
2025-12-02 19:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'nissan leaf hatchback 110kw acenta 40kwh 5dr auto [6.6kw charger]', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 65803, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117101420', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '110kw acenta 40kwh 5dr auto [6.6kw charger]', 'license_plate': 'dy72asx', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'd4f48589-fe70-55fd-8be4-3136f685545b', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/abee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29492}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30612}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/fbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28564}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44361}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/aba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49420}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/e0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 43630}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/a28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 62376}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55613}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'nissan leaf hatchback', 'sanitized_make': 'nissan', 'odometer_in_km': 105899} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'd4f48589-fe70-55fd-8be4-3136f685545b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'dy72asx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117101420',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'nissan',
     'make_model': 'nissan leaf hatchback',
     'model': 'leaf hatchback',
     'odometer': 65803,
     'odometer_in_km': 105899,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29492,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/abee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30612,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30853,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/fbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28564,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44361,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49420,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/aba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43630,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/e0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62376,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/a28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55613,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-30',
     'sanitized_make': 'nissan',
     'seller_name': 'zenith',
     'title': 'nissan leaf hatchback 110kw acenta 40kwh 5dr auto [6.6kw '
              'charger]',
     'transmission': 'automatic',
     'trim': '110kw acenta 40kwh 5dr auto [6.6kw charger]',
     'vin': None,
     'year': 2022}
2025-12-02 19:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: d4f48589-fe70-55fd-8be4-3136f685545b spider: astonbarclay.gb
2025-12-02 19:09:13 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d4f48589-fe70-55fd-8be4-3136f685545b due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'nissan leaf hatchback 110kw acenta 40kwh 5dr auto [6.6kw charger]', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 65803, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117101420', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '110kw acenta 40kwh 5dr auto [6.6kw charger]', 'license_plate': 'dy72asx', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'd4f48589-fe70-55fd-8be4-3136f685545b', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/abee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29492}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30612}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/fbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28564}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44361}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/aba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49420}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/e0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 43630}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/a28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 62376}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55613}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'nissan leaf hatchback', 'sanitized_make': 'nissan', 'odometer_in_km': 105899} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'd4f48589-fe70-55fd-8be4-3136f685545b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'dy72asx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117101420',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'nissan',
     'make_model': 'nissan leaf hatchback',
     'model': 'leaf hatchback',
     'odometer': 65803,
     'odometer_in_km': 105899,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29492,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/abee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30612,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30853,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/fbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28564,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44361,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49420,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/aba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43630,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/e0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62376,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/a28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55613,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-30',
     'sanitized_make': 'nissan',
     'seller_name': 'zenith',
     'title': 'nissan leaf hatchback 110kw acenta 40kwh 5dr auto [6.6kw '
              'charger]',
     'transmission': 'automatic',
     'trim': '110kw acenta 40kwh 5dr auto [6.6kw charger]',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'd4f48589-fe70-55fd-8be4-3136f685545b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DY72ASX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117101420',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'LEAF HATCHBACK',
 'odometer': 65803,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29492,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/abee7cc4-0eb0-4786-af60-6eecd9c70f07_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30612,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/26f1124c-59ca-459b-86d6-d5a8a5bf97bd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30853,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/fbcf4ac7-c2c6-4849-a133-5145ab90df91_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28564,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/0a622e92-d2c6-4d4d-ae77-9de53006cee6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44361,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/6e1d5f2c-2332-4415-9605-46b173877c41_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49420,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/aba3c34f-0d9d-41fa-a648-c4d1934de043_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43630,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/e0da95da-d1e9-436b-9fe0-5c26e23229d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62376,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/a28c9164-d42d-4eeb-90b1-a9a17be1fc0b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f48589-fe70-55fd-8be4-3136f685545b/d4f48589-fe70-55fd-8be4-3136f685545b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55613,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY72ASX/2025-12-01/image/1cd03683-fb37-45ef-af6e-e95a3a59e0a2_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-30',
 'seller_name': 'Zenith',
 'title': 'NISSAN LEAF HATCHBACK 110kW Acenta 40kWh 5dr Auto [6.6kw Charger]',
 'transmission': 'automatic',
 'trim': '110kW Acenta 40kWh 5dr Auto [6.6kw Charger]',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101420%27 HTTP/1.1" 200 None
2025-12-02 19:09:13 [astonbarclay.gb] INFO: Saving data for 117101420: {'created_time': 1764702553.8563, 'last_price_update_time': 1764702553.856311, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117101420') HTTP/1.1" 204 0
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c6da90>
2025-12-02 19:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F4661e44e-a752-4c73-bc8f-d5174ddf04ed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/4661e44e-a752-4c73-bc8f-d5174ddf04ed_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0406050>
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252F863df404-cf96-49f7-bac4-cdba94a8e373_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/863df404-cf96-49f7-bac4-cdba94a8e373_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72SFX/2025-11-27/image/387a3882-2d08-4b4a-99ba-9c8b2529c048_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565754?view=catalogue)
2025-12-02 19:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e2a8b75c-6bd3-48ac-b908-772ee7331c70_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406459?view=catalogue)
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252Ff4841b27-2a08-4edb-ad04-5087d2d04163_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f4841b27-2a08-4edb-ad04-5087d2d04163_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252F3801b498-db09-42d0-8295-a80d1978a514_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/3801b498-db09-42d0-8295-a80d1978a514_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584133?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584826?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02e7bd0>
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68JBX%252F2025-12-02%252Fimage%252F5d137294-3663-4e0d-bc22-109a05effe4a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5d137294-3663-4e0d-bc22-109a05effe4a_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1
2025-12-02 19:09:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9036fa43-3ae7-57f6-83b4-7cade4a76fb1, skipping ID generation
2025-12-02 19:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1 with scrape type 1
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1 from tracking dictionaries
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9036fa43-3ae7-57f6-83b4-7cade4a76fb1 sending to next pipeline
2025-12-02 19:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9036fa43-3ae7-57f6-83b4-7cade4a76fb1, identifier: 117662004
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf085d850>
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F5df7a42f-bdc2-4472-98ff-d0f87bc5bae0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/5df7a42f-bdc2-4472-98ff-d0f87bc5bae0_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b
2025-12-02 19:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d5f9432d-0ff8-4478-ab48-e087e6dc0b08_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117344624?view=catalogue)
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F0b62e6f2-de8e-4658-afce-6266602e2ccb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/0b62e6f2-de8e-4658-afce-6266602e2ccb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9036fa43-3ae7-57f6-83b4-7cade4a76fb1 with identifier: 117662004
2025-12-02 19:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9036fa43-3ae7-57f6-83b4-7cade4a76fb1 with identifier: 117662004
2025-12-02 19:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9036fa43-3ae7-57f6-83b4-7cade4a76fb1 with identifier: 117662004 to the API
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5d137294-3663-4e0d-bc22-109a05effe4a_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9036fa43-3ae7-57f6-83b4-7cade4a76fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL68JBX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662004',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'SEAT',
 'model': 'ATECA DIESEL ESTATE',
 'odometer': 55430,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33460,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5d137294-3663-4e0d-bc22-109a05effe4a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34344,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/7ad4494c-8fb5-42ed-9c39-a4c450d907db_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34101,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e7f80ee4-b832-4398-bead-401ee8512cbe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33172,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f09c3fbe-0903-4fbd-8efa-b0f82ae6fba9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50113,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/50eb3746-08f7-4e7f-a736-cdca303c4d12_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57324,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/ee00062b-ba04-4b88-9458-dca1a3cde696_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53315,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/28fa9e83-1a5c-4b83-9537-ac9b5941629d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62501,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/e34f508f-8c72-4b18-a707-17d3f6d0eb5f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42021,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/4f68fab2-f04e-4be6-bc9b-da9c96f9c52f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42298,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/82547d79-7aaa-40a0-ac61-a6e2ba11b588_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39603,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/35948979-e976-4c6a-9307-b51c8434213a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26861,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/5f66a6a6-bab6-42a8-9e70-1f6e63d819fa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38521,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/f168c1b6-2fa4-4bcb-bccd-e09beea1a947_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9036fa43-3ae7-57f6-83b4-7cade4a76fb1/9036fa43-3ae7-57f6-83b4-7cade4a76fb1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44646,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/NL68JBX/2025-12-02/image/b3fa3821-7a3b-4f14-99f9-c5715602c1b3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-26',
 'seller_name': 'Ken Jervis Kia',
 'title': 'SEAT ATECA DIESEL ESTATE 1.6 TDI SE Technology [EZ] 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDI SE Technology [EZ] 5dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662004%27 HTTP/1.1" 200 None
2025-12-02 19:09:15 [astonbarclay.gb] INFO: Saving data for 117662004: {'created_time': 1764702555.350069, 'last_price_update_time': 1764702555.350079, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662004') HTTP/1.1" 204 0
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1215710>
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fb57135eb-720c-4442-9ceb-0f18db403817_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b57135eb-720c-4442-9ceb-0f18db403817_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/1279ce62-0ded-435b-9a80-80306f4fa1b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406459?view=catalogue)
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F6cac10cd-0902-43fa-8341-f7ca8c78cab3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/6cac10cd-0902-43fa-8341-f7ca8c78cab3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252F46a69a73-a5c3-4ec3-aba3-a5de5749919a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/46a69a73-a5c3-4ec3-aba3-a5de5749919a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0661f50>
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPX68XYL%252F2025-12-02%252Fimage%252Fb23d06a7-b4b6-41c6-bd7e-095b8b10a14e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b23d06a7-b4b6-41c6-bd7e-095b8b10a14e_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15d0105f-1358-503b-a6ef-e3234f03ddd3
2025-12-02 19:09:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15d0105f-1358-503b-a6ef-e3234f03ddd3, skipping ID generation
2025-12-02 19:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15d0105f-1358-503b-a6ef-e3234f03ddd3 with scrape type 1
2025-12-02 19:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 15d0105f-1358-503b-a6ef-e3234f03ddd3 from tracking dictionaries
2025-12-02 19:09:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15d0105f-1358-503b-a6ef-e3234f03ddd3 sending to next pipeline
2025-12-02 19:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 15d0105f-1358-503b-a6ef-e3234f03ddd3, identifier: 117590985
2025-12-02 19:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1e79550>
2025-12-02 19:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252F2ab3d3e6-ff8c-4ffe-a0b2-ccb7068e8a7f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/2ab3d3e6-ff8c-4ffe-a0b2-ccb7068e8a7f_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 204aeabf-4af5-5825-8c2d-b6fc65345f80
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0331750>
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252Ff9f006c0-f42f-433b-b54a-6f8930b70e94_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f9f006c0-f42f-433b-b54a-6f8930b70e94_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf046c63-aff0-5623-80bb-a7603fe43dfb
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0693390>
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252Fd29783a6-55cd-4043-9670-afd3b9870c0c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d29783a6-55cd-4043-9670-afd3b9870c0c_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b
2025-12-02 19:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72SFX/2025-11-27/image/987ee527-6f1d-49bc-b22e-d995dc82b498_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565754?view=catalogue)
2025-12-02 19:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71FNE/2025-12-01/image/6bcc7bde-4449-4b97-8b11-5e90e0ea2b9a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117344624?view=catalogue)
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F18bb3521-d16c-4128-b3f0-69cffa9e9953_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/18bb3521-d16c-4128-b3f0-69cffa9e9953_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117625064?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 15d0105f-1358-503b-a6ef-e3234f03ddd3 with identifier: 117590985
2025-12-02 19:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 15d0105f-1358-503b-a6ef-e3234f03ddd3 with identifier: 117590985
2025-12-02 19:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 15d0105f-1358-503b-a6ef-e3234f03ddd3 with identifier: 117590985 to the API
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b23d06a7-b4b6-41c6-bd7e-095b8b10a14e_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '15d0105f-1358-503b-a6ef-e3234f03ddd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PX68XYL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117590985',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'FOCUS DIESEL HATCHBACK',
 'odometer': 60097,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35555,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b23d06a7-b4b6-41c6-bd7e-095b8b10a14e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34327,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/b57135eb-720c-4442-9ceb-0f18db403817_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35225,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/863df404-cf96-49f7-bac4-cdba94a8e373_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35588,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/bd6732cc-850d-418b-ae4d-1b61adcc4c2f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32290,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f92a86b4-4cf3-4a58-b643-b9b875b16321_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37052,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/eb7ce05f-923f-428a-acde-7145d9a17118_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57788,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/65bc4fc5-1f03-4556-bb7c-a583debfffe7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51061,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/a6809671-ebbc-4657-85ef-efaa94845cdb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53319,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/f7c3ff6c-7664-4e92-a411-fea4d8c0cdc6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36502,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/260d71ec-5b29-4b5e-b035-37900241a482_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37691,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/14825501-6618-43e2-9f86-16f5c6a71aea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61294,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/c3e30827-2c5b-4c84-9fa1-ea37060945d0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43687,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/fde35cd9-4564-449f-a9b8-366a069edade_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89188,
             'Height': 797,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/e057fba8-0088-4a13-9bed-28ee0836b935_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15d0105f-1358-503b-a6ef-e3234f03ddd3/15d0105f-1358-503b-a6ef-e3234f03ddd3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37128,
             'Height': 452,
             'OriginUrl': 'https://abimg003.imgix.net/PX68XYL/2025-12-02/image/38ade57c-88ab-4332-a336-6c61604e9de9_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-19',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD FOCUS DIESEL HATCHBACK 2.0 EcoBlue ST-Line X 5dr',
 'transmission': 'manual',
 'trim': '2.0 EcoBlue ST-Line X 5dr',
 'vin': None,
 'year': 2018}
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590985%27 HTTP/1.1" 200 None
2025-12-02 19:09:18 [astonbarclay.gb] INFO: Saving data for 117590985: {'created_time': 1764702558.007022, 'last_price_update_time': 1764702558.007035, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117590985') HTTP/1.1" 204 0
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05bbb50>
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F387a3882-2d08-4b4a-99ba-9c8b2529c048_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/387a3882-2d08-4b4a-99ba-9c8b2529c048_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf046c63-aff0-5623-80bb-a7603fe43dfb
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf068b5d0>
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252Fe2a8b75c-6bd3-48ac-b908-772ee7331c70_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e2a8b75c-6bd3-48ac-b908-772ee7331c70_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 204aeabf-4af5-5825-8c2d-b6fc65345f80
2025-12-02 19:09:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584133, 'registration': 'FL72JZT', 'account': 'ZEN002', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto[Comfort]', 'mileage': 55078, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-25', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a15021d4-e1fa-4ef4-a90a-1b79d3572cdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/b5910ab9-6f0d-4b25-8589-7489acbbe8b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a4f5ff8a-d972-4cd0-9950-7d5a9d21c5d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/54c699ac-52a5-4a15-8955-4c9c95b1e7ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/ba208cf4-5492-4c1b-88c2-ebc7cf281061_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/8390c62b-2af7-4711-b962-589b69e665e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/40039668-d4dc-4ada-a63c-3204bd1b7c7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/c177db20-979e-42bf-b411-713ef49c97a2_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/23-22k,', 'remarks': 'vosa states 53k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5ff6312f-254f-40fc-b14a-51c79b1c535b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584133, 'registration': 'FL72JZT', 'account': 'ZEN002', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto[Comfort]', 'mileage': 55078, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-25', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a15021d4-e1fa-4ef4-a90a-1b79d3572cdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/b5910ab9-6f0d-4b25-8589-7489acbbe8b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a4f5ff8a-d972-4cd0-9950-7d5a9d21c5d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/54c699ac-52a5-4a15-8955-4c9c95b1e7ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/ba208cf4-5492-4c1b-88c2-ebc7cf281061_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/8390c62b-2af7-4711-b962-589b69e665e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/40039668-d4dc-4ada-a63c-3204bd1b7c7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/c177db20-979e-42bf-b411-713ef49c97a2_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/23-22k,', 'remarks': 'vosa states 53k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5ff6312f-254f-40fc-b14a-51c79b1c535b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c28c62f7-a54e-585d-8aef-f346f5f7c660 with identifier: 117584133
2025-12-02 19:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c28c62f7-a54e-585d-8aef-f346f5f7c660 with scrape type 1
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c28c62f7-a54e-585d-8aef-f346f5f7c660
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252Fa15021d4-e1fa-4ef4-a90a-1b79d3572cdf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a15021d4-e1fa-4ef4-a90a-1b79d3572cdf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584826, 'registration': 'KP72GGX', 'account': 'ZEN009', 'make': 'BMW', 'model': '2 SERIES GRAN COUPE', 'derivative': 'M235i xDrive 4dr Step Auto [Tech/Pro Pack]', 'mileage': 15295, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KP72GGX/2025-12-01/image/5e947478-2b9d-42d1-bb3b-a01821ebb32f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/20f994fe-d727-43b2-926a-699eb8c10936_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/9de8cbb0-8b7a-4875-bd6b-b2490b66b562_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e4a9486b-8416-4f8b-9365-458d253d01e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/c5e016da-f29c-4bcc-8189-45188fd4d516_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/81849327-b964-487c-bf56-53c6aff35048_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e04e94ce-c4ab-402d-adbc-d568137b076a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/fc6b00d7-fba0-4b26-9cd2-6ea97766a186_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 06/24 9K 10/25 14K', 'remarks': 'vosa states 14k,SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 166, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a620b32-336f-4cfa-b2d3-fd1ed4786578.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584826, 'registration': 'KP72GGX', 'account': 'ZEN009', 'make': 'BMW', 'model': '2 SERIES GRAN COUPE', 'derivative': 'M235i xDrive 4dr Step Auto [Tech/Pro Pack]', 'mileage': 15295, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KP72GGX/2025-12-01/image/5e947478-2b9d-42d1-bb3b-a01821ebb32f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/20f994fe-d727-43b2-926a-699eb8c10936_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/9de8cbb0-8b7a-4875-bd6b-b2490b66b562_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e4a9486b-8416-4f8b-9365-458d253d01e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/c5e016da-f29c-4bcc-8189-45188fd4d516_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/81849327-b964-487c-bf56-53c6aff35048_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e04e94ce-c4ab-402d-adbc-d568137b076a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/fc6b00d7-fba0-4b26-9cd2-6ea97766a186_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 06/24 9K 10/25 14K', 'remarks': 'vosa states 14k,SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 166, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a620b32-336f-4cfa-b2d3-fd1ed4786578.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cf79778-bf82-579a-8ea0-4676b1b68e6f with identifier: 117584826
2025-12-02 19:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f with scrape type 1
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252F5e947478-2b9d-42d1-bb3b-a01821ebb32f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/5e947478-2b9d-42d1-bb3b-a01821ebb32f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72SFX/2025-11-27/image/80f484d1-13e0-4c7c-9082-ecb00974b775_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565754?view=catalogue)
2025-12-02 19:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/7f6182ca-e34a-46ec-b177-92027e30a712_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406459?view=catalogue)
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F4778f5d6-328b-44d2-a46d-08e39f557ddd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/4778f5d6-328b-44d2-a46d-08e39f557ddd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252Fe9c65861-5edf-48bb-add9-1c122dc77b66_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e9c65861-5edf-48bb-add9-1c122dc77b66_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117440946?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b44b10>
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252Fd5f9432d-0ff8-4478-ab48-e087e6dc0b08_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d5f9432d-0ff8-4478-ab48-e087e6dc0b08_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b
2025-12-02 19:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71FNE/2025-12-01/image/2bb1ce6b-20be-4e4e-a7c3-13436491d64b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117344624?view=catalogue)
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F919b135c-019e-4e6b-9953-ae280850aefa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/919b135c-019e-4e6b-9953-ae280850aefa_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252Fb5910ab9-6f0d-4b25-8589-7489acbbe8b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/b5910ab9-6f0d-4b25-8589-7489acbbe8b3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252F20f994fe-d727-43b2-926a-699eb8c10936_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/20f994fe-d727-43b2-926a-699eb8c10936_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117260057?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0688c50>
2025-12-02 19:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252F1279ce62-0ded-435b-9a80-80306f4fa1b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/1279ce62-0ded-435b-9a80-80306f4fa1b3_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 204aeabf-4af5-5825-8c2d-b6fc65345f80
2025-12-02 19:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/3801b498-db09-42d0-8295-a80d1978a514_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406459?view=catalogue)
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F482bf1d0-d6c9-495f-b85a-6e951f024b1a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/482bf1d0-d6c9-495f-b85a-6e951f024b1a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252Ffd7d86a1-4bb4-4fd2-a8f5-8b74d5776b74_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/fd7d86a1-4bb4-4fd2-a8f5-8b74d5776b74_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662195?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf065c2d0>
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F987ee527-6f1d-49bc-b22e-d995dc82b498_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/987ee527-6f1d-49bc-b22e-d995dc82b498_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf046c63-aff0-5623-80bb-a7603fe43dfb
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ffacd0>
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F6bcc7bde-4449-4b97-8b11-5e90e0ea2b9a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/6bcc7bde-4449-4b97-8b11-5e90e0ea2b9a_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b
2025-12-02 19:09:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117625064, 'registration': 'YF74HXN', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 19071, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-12-11', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF74HXN/2025-12-02/image/1b481e1b-466f-4a3b-a561-defa99687aeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/557ea71f-23a4-4ab7-b7cf-9334815f2ee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/b20bd4a4-4e73-4cec-b6d2-792a08c1c7d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/fa7d095f-f882-44a6-b260-0d4fce5fe484_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/ed941482-7ad4-4088-bab9-37f60d6bf3ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/68c5a044-e0c9-4eac-9ee3-07cebf73fa4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/540627f3-5856-42bf-88e2-35f8b3a0f153_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/5c82f323-b11b-46f6-8818-791b8cf8ea76_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/62013470-ff58-4ccd-8067-3bdb4fbb7ead_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a1226fc2-725b-478c-9217-26f7e5d30257.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117625064, 'registration': 'YF74HXN', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 19071, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-12-11', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF74HXN/2025-12-02/image/1b481e1b-466f-4a3b-a561-defa99687aeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/557ea71f-23a4-4ab7-b7cf-9334815f2ee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/b20bd4a4-4e73-4cec-b6d2-792a08c1c7d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/fa7d095f-f882-44a6-b260-0d4fce5fe484_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/ed941482-7ad4-4088-bab9-37f60d6bf3ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/68c5a044-e0c9-4eac-9ee3-07cebf73fa4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/540627f3-5856-42bf-88e2-35f8b3a0f153_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/5c82f323-b11b-46f6-8818-791b8cf8ea76_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/62013470-ff58-4ccd-8067-3bdb4fbb7ead_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a1226fc2-725b-478c-9217-26f7e5d30257.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9 with identifier: 117625064
2025-12-02 19:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9 with scrape type 1
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F1b481e1b-466f-4a3b-a561-defa99687aeb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/1b481e1b-466f-4a3b-a561-defa99687aeb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f4841b27-2a08-4edb-ad04-5087d2d04163_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565754?view=catalogue)
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252Fa4f5ff8a-d972-4cd0-9950-7d5a9d21c5d9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a4f5ff8a-d972-4cd0-9950-7d5a9d21c5d9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252F9de8cbb0-8b7a-4875-bd6b-b2490b66b562_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/9de8cbb0-8b7a-4875-bd6b-b2490b66b562_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05fc710>
2025-12-02 19:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F80f484d1-13e0-4c7c-9082-ecb00974b775_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/80f484d1-13e0-4c7c-9082-ecb00974b775_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf046c63-aff0-5623-80bb-a7603fe43dfb
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0907f50>
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252F7f6182ca-e34a-46ec-b177-92027e30a712_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/7f6182ca-e34a-46ec-b177-92027e30a712_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 204aeabf-4af5-5825-8c2d-b6fc65345f80
2025-12-02 19:09:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117440946, 'registration': 'BJ72FVF', 'account': 'ZEN002', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW M Sport Pro 80kWh 5dr Auto', 'mileage': 18680, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-10', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/df8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/eb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/d4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24 14k', 'remarks': 'VOSA STATES 18K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4cfafee3-bdb9-4240-90c3-978c282a550d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117440946, 'registration': 'BJ72FVF', 'account': 'ZEN002', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW M Sport Pro 80kWh 5dr Auto', 'mileage': 18680, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-10', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/df8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/eb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/d4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24 14k', 'remarks': 'VOSA STATES 18K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4cfafee3-bdb9-4240-90c3-978c282a550d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5 with identifier: 117440946
2025-12-02 19:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5 with scrape type 1
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252Fdf8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/df8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72SFX/2025-11-27/image/6cac10cd-0902-43fa-8341-f7ca8c78cab3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565754?view=catalogue)
2025-12-02 19:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71FNE/2025-12-01/image/0b62e6f2-de8e-4658-afce-6266602e2ccb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117344624?view=catalogue)
2025-12-02 19:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/46a69a73-a5c3-4ec3-aba3-a5de5749919a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406459?view=catalogue)
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252Ff33995c2-d7ec-4817-a703-2abf5dc9d85b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f33995c2-d7ec-4817-a703-2abf5dc9d85b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F557ea71f-23a4-4ab7-b7cf-9334815f2ee2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/557ea71f-23a4-4ab7-b7cf-9334815f2ee2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07cb590>
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F2bb1ce6b-20be-4e4e-a7c3-13436491d64b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/2bb1ce6b-20be-4e4e-a7c3-13436491d64b_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b
2025-12-02 19:09:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117480129, 'registration': 'AO23HJC', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '118d Sport 5dr Step Auto [Live Cockpit Pro]', 'mileage': 60039, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-20', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO23HJC/2025-11-27/image/56abef15-5756-48cc-a544-3b627e640ef7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/650ca303-1fc6-4767-8b51-f97629402dd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/cbaec602-46af-4f76-8674-3f91de81046f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/7235ba67-86d3-445f-8389-c0b60aaa9d21_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/1a398950-79ed-49d3-ba8e-c5716ddba31a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/150bcf4b-9d0d-4ee3-ae8c-5a825dea54cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/78da6f7d-6f20-4805-bb22-7c66a8ce5d65_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/dee27912-1308-4a30-8d26-2fd6db54759f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/05f66d7a-9631-41b8-9347-74a77dc22c01_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/e3603e60-f43a-4321-9aa7-51a4f7847016_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/324b4748-8fa0-4ea3-b911-3532b0b36775_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24 16K 10/24 30K 03/25 43K 10/25 59K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': 'TF', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe1e36fd-1ef7-4734-a03f-9b3b8ef00c6c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117480129, 'registration': 'AO23HJC', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '118d Sport 5dr Step Auto [Live Cockpit Pro]', 'mileage': 60039, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-20', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO23HJC/2025-11-27/image/56abef15-5756-48cc-a544-3b627e640ef7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/650ca303-1fc6-4767-8b51-f97629402dd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/cbaec602-46af-4f76-8674-3f91de81046f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/7235ba67-86d3-445f-8389-c0b60aaa9d21_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/1a398950-79ed-49d3-ba8e-c5716ddba31a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/150bcf4b-9d0d-4ee3-ae8c-5a825dea54cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/78da6f7d-6f20-4805-bb22-7c66a8ce5d65_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/dee27912-1308-4a30-8d26-2fd6db54759f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/05f66d7a-9631-41b8-9347-74a77dc22c01_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/e3603e60-f43a-4321-9aa7-51a4f7847016_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/324b4748-8fa0-4ea3-b911-3532b0b36775_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24 16K 10/24 30K 03/25 43K 10/25 59K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': 'TF', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe1e36fd-1ef7-4734-a03f-9b3b8ef00c6c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7eab6d9-576f-5766-bd9e-d4750768a692 with identifier: 117480129
2025-12-02 19:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7eab6d9-576f-5766-bd9e-d4750768a692 with scrape type 1
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F56abef15-5756-48cc-a544-3b627e640ef7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/56abef15-5756-48cc-a544-3b627e640ef7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117260057, 'registration': 'YH73ZDJ', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON SPORTBACK SPECIAL EDITIONS', 'derivative': '150kW 40 82.77kWh Edition 1 5dr Auto [C+S/Tech]', 'mileage': 10506, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-12', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/94e78095-cde2-4f43-90fa-b7a38716d950_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/dc8b9dfb-fcfe-43a9-a858-b39a145bae88_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/f8573d4e-3b38-44bb-a148-9b19dce424d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/fb52fef6-10f8-4a07-9cbd-edf8ae2ab297_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/73ab1999-4b39-46eb-93d0-b7b7494c556e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/22ff2cd2-fbd8-4ee6-8d8a-3fb369a78863_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/1a0ae318-404c-4efa-b9cd-985e4577327e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/297d76d6-424d-4511-9f89-54b5f31c8eff_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d05e57c6-92eb-4bc3-b454-57ed36aff544.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117260057, 'registration': 'YH73ZDJ', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON SPORTBACK SPECIAL EDITIONS', 'derivative': '150kW 40 82.77kWh Edition 1 5dr Auto [C+S/Tech]', 'mileage': 10506, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-12', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/94e78095-cde2-4f43-90fa-b7a38716d950_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/dc8b9dfb-fcfe-43a9-a858-b39a145bae88_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/f8573d4e-3b38-44bb-a148-9b19dce424d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/fb52fef6-10f8-4a07-9cbd-edf8ae2ab297_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/73ab1999-4b39-46eb-93d0-b7b7494c556e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/22ff2cd2-fbd8-4ee6-8d8a-3fb369a78863_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/1a0ae318-404c-4efa-b9cd-985e4577327e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH73ZDJ/2025-11-21/image/297d76d6-424d-4511-9f89-54b5f31c8eff_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d05e57c6-92eb-4bc3-b454-57ed36aff544.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1 with identifier: 117260057
2025-12-02 19:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1 with scrape type 2
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1 with scrape type 2
2025-12-02 19:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1, identifier: 117260057
2025-12-02 19:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a15021d4-e1fa-4ef4-a90a-1b79d3572cdf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584133?view=catalogue)
2025-12-02 19:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP72GGX/2025-12-01/image/5e947478-2b9d-42d1-bb3b-a01821ebb32f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584826?view=catalogue)
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252F54c699ac-52a5-4a15-8955-4c9c95b1e7ff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/54c699ac-52a5-4a15-8955-4c9c95b1e7ff_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252Fe4a9486b-8416-4f8b-9365-458d253d01e2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e4a9486b-8416-4f8b-9365-458d253d01e2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252F7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1 with identifier: 117260057
2025-12-02 19:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1 with identifier: 117260057
2025-12-02 19:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron sportback special editions 150kw 40 82.77kwh edition 1 5dr auto [c+s/tech]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron sportback special editions', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 10506, 'odometer_reading_unit': 'mi', 'registration_date': '2023-09-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117260057', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 40 82.77kwh edition 1 5dr auto [c+s/tech]', 'license_plate': 'yh73zdj', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1', 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'audi q4 e-tron sportback special editions', 'sanitized_make': 'audi', 'odometer_in_km': 16907} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 26,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yh73zdj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117260057',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'audi',
     'make_model': 'audi q4 e-tron sportback special editions',
     'model': 'q4 e-tron sportback special editions',
     'odometer': 10506,
     'odometer_in_km': 16907,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-09-12',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron sportback special editions 150kw 40 82.77kwh '
              'edition 1 5dr auto [c+s/tech]',
     'transmission': 'automatic',
     'trim': '150kw 40 82.77kwh edition 1 5dr auto [c+s/tech]',
     'vin': None,
     'year': 2023}
2025-12-02 19:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1 spider: astonbarclay.gb
2025-12-02 19:09:21 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron sportback special editions 150kw 40 82.77kwh edition 1 5dr auto [c+s/tech]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron sportback special editions', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 10506, 'odometer_reading_unit': 'mi', 'registration_date': '2023-09-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117260057', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 40 82.77kwh edition 1 5dr auto [c+s/tech]', 'license_plate': 'yh73zdj', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1', 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'audi q4 e-tron sportback special editions', 'sanitized_make': 'audi', 'odometer_in_km': 16907} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 26,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yh73zdj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117260057',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'audi',
     'make_model': 'audi q4 e-tron sportback special editions',
     'model': 'q4 e-tron sportback special editions',
     'odometer': 10506,
     'odometer_in_km': 16907,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-09-12',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron sportback special editions 150kw 40 82.77kwh '
              'edition 1 5dr auto [c+s/tech]',
     'transmission': 'automatic',
     'trim': '150kw 40 82.77kwh edition 1 5dr auto [c+s/tech]',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '623a98b5-c81a-59c7-acdd-c1b6a7c3c9d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YH73ZDJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117260057',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'AUDI',
 'model': 'Q4 E-TRON SPORTBACK SPECIAL EDITIONS',
 'odometer': 10506,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-12',
 'seller_name': 'Zenith',
 'title': 'AUDI Q4 E-TRON SPORTBACK SPECIAL EDITIONS 150kW 40 82.77kWh Edition '
          '1 5dr Auto [C+S/Tech]',
 'transmission': 'automatic',
 'trim': '150kW 40 82.77kWh Edition 1 5dr Auto [C+S/Tech]',
 'vin': None,
 'year': 2023}
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117260057%27 HTTP/1.1" 200 None
2025-12-02 19:09:21 [astonbarclay.gb] INFO: Saving data for 117260057: {'created_time': 1764356699.634934, 'last_price_update_time': 1764702561.20376, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117260057') HTTP/1.1" 204 0
2025-12-02 19:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0566cd0>
2025-12-02 19:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252F3801b498-db09-42d0-8295-a80d1978a514_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/3801b498-db09-42d0-8295-a80d1978a514_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 204aeabf-4af5-5825-8c2d-b6fc65345f80
2025-12-02 19:09:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662195, 'registration': 'BG18TBU', 'account': 'ARN093', 'make': 'AUDI', 'model': 'A6 DIESEL SALOON', 'derivative': '2.0 TDI Ultra S Line 4dr S Tronic', 'mileage': 99608, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-04-18', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 45k, 56k, 62k, 74k, 89k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:09:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662195, 'registration': 'BG18TBU', 'account': 'ARN093', 'make': 'AUDI', 'model': 'A6 DIESEL SALOON', 'derivative': '2.0 TDI Ultra S Line 4dr S Tronic', 'mileage': 99608, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 140}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-04-18', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 45k, 56k, 62k, 74k, 89k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eebacbf8-9590-5e7f-9efd-94be52f05bc0 with identifier: 117662195
2025-12-02 19:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eebacbf8-9590-5e7f-9efd-94be52f05bc0 with scrape type 1
2025-12-02 19:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item eebacbf8-9590-5e7f-9efd-94be52f05bc0
2025-12-02 19:09:21 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item eebacbf8-9590-5e7f-9efd-94be52f05bc0
2025-12-02 19:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eebacbf8-9590-5e7f-9efd-94be52f05bc0, identifier: 117662195
2025-12-02 19:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72SFX/2025-11-27/image/4778f5d6-328b-44d2-a46d-08e39f557ddd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565754?view=catalogue)
2025-12-02 19:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e9c65861-5edf-48bb-add9-1c122dc77b66_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406459?view=catalogue)
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252Fb20bd4a4-4e73-4cec-b6d2-792a08c1c7d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/b20bd4a4-4e73-4cec-b6d2-792a08c1c7d1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F650ca303-1fc6-4767-8b51-f97629402dd6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/650ca303-1fc6-4767-8b51-f97629402dd6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eebacbf8-9590-5e7f-9efd-94be52f05bc0 with identifier: 117662195
2025-12-02 19:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eebacbf8-9590-5e7f-9efd-94be52f05bc0 with identifier: 117662195
2025-12-02 19:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160303 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160303
2025-12-02 19:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: eebacbf8-9590-5e7f-9efd-94be52f05bc0 spider: astonbarclay.gb
2025-12-02 19:09:21 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: eebacbf8-9590-5e7f-9efd-94be52f05bc0 due to rule: high_mileage_for_country.json, error: 160303 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160303
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'eebacbf8-9590-5e7f-9efd-94be52f05bc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BG18TBU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662195',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'AUDI',
 'model': 'A6 DIESEL SALOON',
 'odometer': 99608,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-18',
 'seller_name': 'Arnold Clark',
 'title': 'AUDI A6 DIESEL SALOON 2.0 TDI Ultra S Line 4dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI Ultra S Line 4dr S Tronic',
 'vin': None,
 'year': 2018}
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662195%27 HTTP/1.1" 200 None
2025-12-02 19:09:21 [astonbarclay.gb] INFO: Saving data for 117662195: {'created_time': 1764702561.794487, 'last_price_update_time': 1764702561.794499, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662195') HTTP/1.1" 204 0
2025-12-02 19:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07e53d0>
2025-12-02 19:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252Ff4841b27-2a08-4edb-ad04-5087d2d04163_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f4841b27-2a08-4edb-ad04-5087d2d04163_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf046c63-aff0-5623-80bb-a7603fe43dfb
2025-12-02 19:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP72GGX/2025-12-01/image/20f994fe-d727-43b2-926a-699eb8c10936_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584826?view=catalogue)
2025-12-02 19:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL72JZT/2025-11-28/image/b5910ab9-6f0d-4b25-8589-7489acbbe8b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584133?view=catalogue)
2025-12-02 19:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71FNE/2025-12-01/image/18bb3521-d16c-4128-b3f0-69cffa9e9953_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117344624?view=catalogue)
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252Fba208cf4-5492-4c1b-88c2-ebc7cf281061_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/ba208cf4-5492-4c1b-88c2-ebc7cf281061_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252Fc5e016da-f29c-4bcc-8189-45188fd4d516_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/c5e016da-f29c-4bcc-8189-45188fd4d516_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252Feb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/eb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf091b0d0>
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F6cac10cd-0902-43fa-8341-f7ca8c78cab3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/6cac10cd-0902-43fa-8341-f7ca8c78cab3_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf046c63-aff0-5623-80bb-a7603fe43dfb
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04609d0>
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F0b62e6f2-de8e-4658-afce-6266602e2ccb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/0b62e6f2-de8e-4658-afce-6266602e2ccb_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0906850>
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252F46a69a73-a5c3-4ec3-aba3-a5de5749919a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/46a69a73-a5c3-4ec3-aba3-a5de5749919a_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 204aeabf-4af5-5825-8c2d-b6fc65345f80
2025-12-02 19:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72SFX/2025-11-27/image/482bf1d0-d6c9-495f-b85a-6e951f024b1a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565754?view=catalogue)
2025-12-02 19:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF74HXN/2025-12-02/image/1b481e1b-466f-4a3b-a561-defa99687aeb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625064?view=catalogue)
2025-12-02 19:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/fd7d86a1-4bb4-4fd2-a8f5-8b74d5776b74_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406459?view=catalogue)
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252Ffa7d095f-f882-44a6-b260-0d4fce5fe484_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/fa7d095f-f882-44a6-b260-0d4fce5fe484_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252Fcbaec602-46af-4f76-8674-3f91de81046f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/cbaec602-46af-4f76-8674-3f91de81046f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf037f890>
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252Fa15021d4-e1fa-4ef4-a90a-1b79d3572cdf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a15021d4-e1fa-4ef4-a90a-1b79d3572cdf_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c28c62f7-a54e-585d-8aef-f346f5f7c660
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0901ad0>
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252F5e947478-2b9d-42d1-bb3b-a01821ebb32f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/5e947478-2b9d-42d1-bb3b-a01821ebb32f_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f
2025-12-02 19:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP72GGX/2025-12-01/image/9de8cbb0-8b7a-4875-bd6b-b2490b66b562_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584826?view=catalogue)
2025-12-02 19:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/df8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117440946?view=catalogue)
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252F8390c62b-2af7-4711-b962-589b69e665e4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/8390c62b-2af7-4711-b962-589b69e665e4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252F81849327-b964-487c-bf56-53c6aff35048_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/81849327-b964-487c-bf56-53c6aff35048_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252F64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf336ee90>
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F4778f5d6-328b-44d2-a46d-08e39f557ddd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/4778f5d6-328b-44d2-a46d-08e39f557ddd_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf046c63-aff0-5623-80bb-a7603fe43dfb
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf033b0d0>
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252Fe9c65861-5edf-48bb-add9-1c122dc77b66_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e9c65861-5edf-48bb-add9-1c122dc77b66_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 204aeabf-4af5-5825-8c2d-b6fc65345f80
2025-12-02 19:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO23HJC/2025-11-27/image/56abef15-5756-48cc-a544-3b627e640ef7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue)
2025-12-02 19:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF74HXN/2025-12-02/image/557ea71f-23a4-4ab7-b7cf-9334815f2ee2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625064?view=catalogue)
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252Fed941482-7ad4-4088-bab9-37f60d6bf3ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/ed941482-7ad4-4088-bab9-37f60d6bf3ee_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F7235ba67-86d3-445f-8389-c0b60aaa9d21_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/7235ba67-86d3-445f-8389-c0b60aaa9d21_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0593f50>
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252F20f994fe-d727-43b2-926a-699eb8c10936_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/20f994fe-d727-43b2-926a-699eb8c10936_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0662c50>
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252Fb5910ab9-6f0d-4b25-8589-7489acbbe8b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/b5910ab9-6f0d-4b25-8589-7489acbbe8b3_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c28c62f7-a54e-585d-8aef-f346f5f7c660
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0663d90>
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F18bb3521-d16c-4128-b3f0-69cffa9e9953_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/18bb3521-d16c-4128-b3f0-69cffa9e9953_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b
2025-12-02 19:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e4a9486b-8416-4f8b-9365-458d253d01e2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584826?view=catalogue)
2025-12-02 19:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117440946?view=catalogue)
2025-12-02 19:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL72JZT/2025-11-28/image/54c699ac-52a5-4a15-8955-4c9c95b1e7ff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584133?view=catalogue)
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252F40039668-d4dc-4ada-a63c-3204bd1b7c7a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/40039668-d4dc-4ada-a63c-3204bd1b7c7a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252Fe04e94ce-c4ab-402d-adbc-d568137b076a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e04e94ce-c4ab-402d-adbc-d568137b076a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252Fd4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/d4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117288373?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf081c650>
2025-12-02 19:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252F482bf1d0-d6c9-495f-b85a-6e951f024b1a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/482bf1d0-d6c9-495f-b85a-6e951f024b1a_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf046c63-aff0-5623-80bb-a7603fe43dfb
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf091b490>
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F1b481e1b-466f-4a3b-a561-defa99687aeb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/1b481e1b-466f-4a3b-a561-defa99687aeb_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0608590>
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWX71NZJ%252F2025-11-26%252Fimage%252Ffd7d86a1-4bb4-4fd2-a8f5-8b74d5776b74_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/fd7d86a1-4bb4-4fd2-a8f5-8b74d5776b74_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 204aeabf-4af5-5825-8c2d-b6fc65345f80
2025-12-02 19:09:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 204aeabf-4af5-5825-8c2d-b6fc65345f80, skipping ID generation
2025-12-02 19:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 204aeabf-4af5-5825-8c2d-b6fc65345f80 with scrape type 1
2025-12-02 19:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 204aeabf-4af5-5825-8c2d-b6fc65345f80 from tracking dictionaries
2025-12-02 19:09:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 204aeabf-4af5-5825-8c2d-b6fc65345f80 sending to next pipeline
2025-12-02 19:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 204aeabf-4af5-5825-8c2d-b6fc65345f80, identifier: 117406459
2025-12-02 19:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF74HXN/2025-12-02/image/b20bd4a4-4e73-4cec-b6d2-792a08c1c7d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625064?view=catalogue)
2025-12-02 19:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f33995c2-d7ec-4817-a703-2abf5dc9d85b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565754?view=catalogue)
2025-12-02 19:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO23HJC/2025-11-27/image/650ca303-1fc6-4767-8b51-f97629402dd6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue)
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F68c5a044-e0c9-4eac-9ee3-07cebf73fa4b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/68c5a044-e0c9-4eac-9ee3-07cebf73fa4b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F1a398950-79ed-49d3-ba8e-c5716ddba31a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/1a398950-79ed-49d3-ba8e-c5716ddba31a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117006204?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 204aeabf-4af5-5825-8c2d-b6fc65345f80 with identifier: 117406459
2025-12-02 19:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 204aeabf-4af5-5825-8c2d-b6fc65345f80 with identifier: 117406459
2025-12-02 19:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 204aeabf-4af5-5825-8c2d-b6fc65345f80 with identifier: 117406459 to the API
2025-12-02 19:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/fd7d86a1-4bb4-4fd2-a8f5-8b74d5776b74_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '204aeabf-4af5-5825-8c2d-b6fc65345f80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WX71NZJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406459',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'B CLASS HATCHBACK',
 'odometer': 47814,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27120,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/2ab3d3e6-ff8c-4ffe-a0b2-ccb7068e8a7f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27425,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e2a8b75c-6bd3-48ac-b908-772ee7331c70_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27572,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/1279ce62-0ded-435b-9a80-80306f4fa1b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27980,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/7f6182ca-e34a-46ec-b177-92027e30a712_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52233,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/3801b498-db09-42d0-8295-a80d1978a514_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42106,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/46a69a73-a5c3-4ec3-aba3-a5de5749919a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42447,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/e9c65861-5edf-48bb-add9-1c122dc77b66_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204aeabf-4af5-5825-8c2d-b6fc65345f80/204aeabf-4af5-5825-8c2d-b6fc65345f80_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53935,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WX71NZJ/2025-11-26/image/fd7d86a1-4bb4-4fd2-a8f5-8b74d5776b74_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-10',
 'seller_name': 'Zenith',
 'title': 'MERCEDES-BENZ B CLASS HATCHBACK B250e AMG Line Premium Plus 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': 'B250e AMG Line Premium Plus 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406459%27 HTTP/1.1" 200 None
2025-12-02 19:09:26 [astonbarclay.gb] INFO: Saving data for 117406459: {'created_time': 1764702566.332543, 'last_price_update_time': 1764702566.332554, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117406459') HTTP/1.1" 204 0
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1e4a090>
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252F9de8cbb0-8b7a-4875-bd6b-b2490b66b562_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/9de8cbb0-8b7a-4875-bd6b-b2490b66b562_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0884b10>
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252Fdf8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/df8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5
2025-12-02 19:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP72GGX/2025-12-01/image/c5e016da-f29c-4bcc-8189-45188fd4d516_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584826?view=catalogue)
2025-12-02 19:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/eb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117440946?view=catalogue)
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252Fc177db20-979e-42bf-b411-713ef49c97a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/c177db20-979e-42bf-b411-713ef49c97a2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252Ffc6b00d7-fba0-4b26-9cd2-6ea97766a186_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/fc6b00d7-fba0-4b26-9cd2-6ea97766a186_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252F970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116996626?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117289497?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0656050>
2025-12-02 19:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F56abef15-5756-48cc-a544-3b627e640ef7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/56abef15-5756-48cc-a544-3b627e640ef7_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b5b350>
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F557ea71f-23a4-4ab7-b7cf-9334815f2ee2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/557ea71f-23a4-4ab7-b7cf-9334815f2ee2_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9
2025-12-02 19:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF74HXN/2025-12-02/image/fa7d095f-f882-44a6-b260-0d4fce5fe484_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625064?view=catalogue)
2025-12-02 19:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO23HJC/2025-11-27/image/cbaec602-46af-4f76-8674-3f91de81046f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue)
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F540627f3-5856-42bf-88e2-35f8b3a0f153_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/540627f3-5856-42bf-88e2-35f8b3a0f153_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F150bcf4b-9d0d-4ee3-ae8c-5a825dea54cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/150bcf4b-9d0d-4ee3-ae8c-5a825dea54cf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117433187?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0791d50>
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252Fe4a9486b-8416-4f8b-9365-458d253d01e2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e4a9486b-8416-4f8b-9365-458d253d01e2_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf077b350>
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252F7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf077af90>
2025-12-02 19:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252F54c699ac-52a5-4a15-8955-4c9c95b1e7ff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/54c699ac-52a5-4a15-8955-4c9c95b1e7ff_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c28c62f7-a54e-585d-8aef-f346f5f7c660
2025-12-02 19:09:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117288373, 'registration': 'YN71UNU', 'account': 'LEA004', 'make': 'BMW', 'model': '3 SERIES TOURING', 'derivative': '330e SE Pro 5dr Step Auto', 'mileage': 67183, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-05', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN71UNU/2025-11-20/image/96f5a987-3f42-4d32-99d1-5126f2652ddc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/5ca706a5-d0b5-4fc8-bd0a-3be9a9088204_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/042f30cb-9cb7-4f35-8a99-7454f12612c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/7d3cf574-56c8-4384-b6b6-68957eca7fba_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/45d47159-e964-4e01-affc-5825e35a5554_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/915a7922-6e21-444c-9426-1f1d9b10e3b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/84b193c0-0fac-4d81-b3c8-0e657a4c81f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/1f53f68a-72fc-4ad7-b3d4-6e56530774c0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/25 62K', 'remarks': 'VOSA STATES 44K 64K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 32, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/14be2ee4-dcac-4016-a7bc-49762d344d39.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117288373, 'registration': 'YN71UNU', 'account': 'LEA004', 'make': 'BMW', 'model': '3 SERIES TOURING', 'derivative': '330e SE Pro 5dr Step Auto', 'mileage': 67183, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-05', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN71UNU/2025-11-20/image/96f5a987-3f42-4d32-99d1-5126f2652ddc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/5ca706a5-d0b5-4fc8-bd0a-3be9a9088204_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/042f30cb-9cb7-4f35-8a99-7454f12612c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/7d3cf574-56c8-4384-b6b6-68957eca7fba_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/45d47159-e964-4e01-affc-5825e35a5554_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/915a7922-6e21-444c-9426-1f1d9b10e3b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/84b193c0-0fac-4d81-b3c8-0e657a4c81f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN71UNU/2025-11-20/image/1f53f68a-72fc-4ad7-b3d4-6e56530774c0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/25 62K', 'remarks': 'VOSA STATES 44K 64K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 32, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/14be2ee4-dcac-4016-a7bc-49762d344d39.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 084196d2-9a24-5ec9-8e61-99b96af055f8 with identifier: 117288373
2025-12-02 19:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 084196d2-9a24-5ec9-8e61-99b96af055f8 with scrape type 2
2025-12-02 19:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 084196d2-9a24-5ec9-8e61-99b96af055f8 with scrape type 2
2025-12-02 19:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 084196d2-9a24-5ec9-8e61-99b96af055f8, identifier: 117288373
2025-12-02 19:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP72GGX/2025-12-01/image/81849327-b964-487c-bf56-53c6aff35048_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584826?view=catalogue)
2025-12-02 19:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL72JZT/2025-11-28/image/8390c62b-2af7-4711-b962-589b69e665e4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584133?view=catalogue)
2025-12-02 19:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117440946?view=catalogue)
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252F9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 084196d2-9a24-5ec9-8e61-99b96af055f8 with identifier: 117288373
2025-12-02 19:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 084196d2-9a24-5ec9-8e61-99b96af055f8 with identifier: 117288373
2025-12-02 19:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 084196d2-9a24-5ec9-8e61-99b96af055f8 with identifier: 117288373 to the API
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117288373?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '084196d2-9a24-5ec9-8e61-99b96af055f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YN71UNU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117288373',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 67183,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-05',
 'seller_name': 'Zenith',
 'title': 'BMW 3 SERIES TOURING 330e SE Pro 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e SE Pro 5dr Step Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288373%27 HTTP/1.1" 200 None
2025-12-02 19:09:28 [astonbarclay.gb] INFO: Saving data for 117288373: {'auction_closing_time': 1764842400.0, 'created_time': 1764097337.80159, 'last_price_update_time': 1764702568.51684}
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117288373') HTTP/1.1" 204 0
2025-12-02 19:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05997d0>
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252Fb20bd4a4-4e73-4cec-b6d2-792a08c1c7d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/b20bd4a4-4e73-4cec-b6d2-792a08c1c7d1_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf090efd0>
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72SFX%252F2025-11-27%252Fimage%252Ff33995c2-d7ec-4817-a703-2abf5dc9d85b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f33995c2-d7ec-4817-a703-2abf5dc9d85b_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf046c63-aff0-5623-80bb-a7603fe43dfb
2025-12-02 19:09:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf046c63-aff0-5623-80bb-a7603fe43dfb, skipping ID generation
2025-12-02 19:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf046c63-aff0-5623-80bb-a7603fe43dfb with scrape type 1
2025-12-02 19:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf046c63-aff0-5623-80bb-a7603fe43dfb from tracking dictionaries
2025-12-02 19:09:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf046c63-aff0-5623-80bb-a7603fe43dfb sending to next pipeline
2025-12-02 19:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cf046c63-aff0-5623-80bb-a7603fe43dfb, identifier: 117565754
2025-12-02 19:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04ee390>
2025-12-02 19:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F650ca303-1fc6-4767-8b51-f97629402dd6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/650ca303-1fc6-4767-8b51-f97629402dd6_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117006204, 'registration': 'BT72DKA', 'account': 'ZEN002', 'make': 'BMW', 'model': 'I4 GRAN COUPE', 'derivative': '250kW eDrive40 Sport 83.9kWh 5dr Auto', 'mileage': 33554, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-25', 'fuel': 'Electric', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BT72DKA/2025-11-26/image/1dc01188-8af0-4aef-b00a-678dc75f3275_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/65fe6571-229a-44db-b3c2-9589eecbb1fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/e2977291-e74e-4ce8-a585-935cf9359fcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/304c7697-ea88-41d0-86cb-9234ac7e2399_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/b2d57f0a-576b-415f-9b87-45d09d39c0ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/cab92ad6-cb75-43bf-91b1-18d494653605_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/88487a53-320a-4d7b-86b7-e8bfd5d819b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/3b604309-f3da-4b84-8bab-b0b37d970f56_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/24 20K', 'remarks': 'SPARE KEY Skyscraper Grey VOSA STATES 32K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4f79b5b3-583a-4dd6-8d0c-cd9442ef26a7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117006204, 'registration': 'BT72DKA', 'account': 'ZEN002', 'make': 'BMW', 'model': 'I4 GRAN COUPE', 'derivative': '250kW eDrive40 Sport 83.9kWh 5dr Auto', 'mileage': 33554, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-25', 'fuel': 'Electric', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BT72DKA/2025-11-26/image/1dc01188-8af0-4aef-b00a-678dc75f3275_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/65fe6571-229a-44db-b3c2-9589eecbb1fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/e2977291-e74e-4ce8-a585-935cf9359fcf_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/304c7697-ea88-41d0-86cb-9234ac7e2399_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/b2d57f0a-576b-415f-9b87-45d09d39c0ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/cab92ad6-cb75-43bf-91b1-18d494653605_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/88487a53-320a-4d7b-86b7-e8bfd5d819b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72DKA/2025-11-26/image/3b604309-f3da-4b84-8bab-b0b37d970f56_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/24 20K', 'remarks': 'SPARE KEY Skyscraper Grey VOSA STATES 32K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4f79b5b3-583a-4dd6-8d0c-cd9442ef26a7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 076cc4ee-ab26-54ba-9070-56fa13208338 with identifier: 117006204
2025-12-02 19:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 076cc4ee-ab26-54ba-9070-56fa13208338 with scrape type 2
2025-12-02 19:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 076cc4ee-ab26-54ba-9070-56fa13208338 with scrape type 2
2025-12-02 19:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 076cc4ee-ab26-54ba-9070-56fa13208338, identifier: 117006204
2025-12-02 19:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF74HXN/2025-12-02/image/ed941482-7ad4-4088-bab9-37f60d6bf3ee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625064?view=catalogue)
2025-12-02 19:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL72JZT/2025-11-28/image/ba208cf4-5492-4c1b-88c2-ebc7cf281061_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584133?view=catalogue)
2025-12-02 19:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO23HJC/2025-11-27/image/7235ba67-86d3-445f-8389-c0b60aaa9d21_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue)
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F5c82f323-b11b-46f6-8818-791b8cf8ea76_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/5c82f323-b11b-46f6-8818-791b8cf8ea76_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F78da6f7d-6f20-4805-bb22-7c66a8ce5d65_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/78da6f7d-6f20-4805-bb22-7c66a8ce5d65_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cf046c63-aff0-5623-80bb-a7603fe43dfb with identifier: 117565754
2025-12-02 19:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cf046c63-aff0-5623-80bb-a7603fe43dfb with identifier: 117565754
2025-12-02 19:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cf046c63-aff0-5623-80bb-a7603fe43dfb with identifier: 117565754 to the API
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f33995c2-d7ec-4817-a703-2abf5dc9d85b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'cf046c63-aff0-5623-80bb-a7603fe43dfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MW72SFX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117565754',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL Y HATCHBACK',
 'odometer': 38454,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20641,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f9f006c0-f42f-433b-b54a-6f8930b70e94_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20776,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/387a3882-2d08-4b4a-99ba-9c8b2529c048_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21973,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/987ee527-6f1d-49bc-b22e-d995dc82b498_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22707,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/80f484d1-13e0-4c7c-9082-ecb00974b775_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31388,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f4841b27-2a08-4edb-ad04-5087d2d04163_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29758,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/6cac10cd-0902-43fa-8341-f7ca8c78cab3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31220,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/4778f5d6-328b-44d2-a46d-08e39f557ddd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38636,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/482bf1d0-d6c9-495f-b85a-6e951f024b1a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf046c63-aff0-5623-80bb-a7603fe43dfb/cf046c63-aff0-5623-80bb-a7603fe43dfb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42854,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/MW72SFX/2025-11-27/image/f33995c2-d7ec-4817-a703-2abf5dc9d85b_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL Y HATCHBACK Long Range AWD 5dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117565754%27 HTTP/1.1" 200 None
2025-12-02 19:09:29 [astonbarclay.gb] INFO: Saving data for 117565754: {'created_time': 1764702569.871677, 'last_price_update_time': 1764702569.871687, 'auction_closing_time': 1764927900.0}
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117565754') HTTP/1.1" 204 0
2025-12-02 19:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 076cc4ee-ab26-54ba-9070-56fa13208338 with identifier: 117006204
2025-12-02 19:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 076cc4ee-ab26-54ba-9070-56fa13208338 with identifier: 117006204
2025-12-02 19:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw i4 gran coupe 250kw edrive40 sport 83.9kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i4 gran coupe', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 33554, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117006204', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '250kw edrive40 sport 83.9kwh 5dr auto', 'license_plate': 'bt72dka', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '076cc4ee-ab26-54ba-9070-56fa13208338', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'bmw i4 gran coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 53999} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '076cc4ee-ab26-54ba-9070-56fa13208338',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bt72dka',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117006204',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw i4 gran coupe',
     'model': 'i4 gran coupe',
     'odometer': 33554,
     'odometer_in_km': 53999,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-25',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw i4 gran coupe 250kw edrive40 sport 83.9kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '250kw edrive40 sport 83.9kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 076cc4ee-ab26-54ba-9070-56fa13208338 spider: astonbarclay.gb
2025-12-02 19:09:30 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 076cc4ee-ab26-54ba-9070-56fa13208338 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw i4 gran coupe 250kw edrive40 sport 83.9kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i4 gran coupe', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 33554, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117006204', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '250kw edrive40 sport 83.9kwh 5dr auto', 'license_plate': 'bt72dka', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '076cc4ee-ab26-54ba-9070-56fa13208338', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'bmw i4 gran coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 53999} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '076cc4ee-ab26-54ba-9070-56fa13208338',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bt72dka',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117006204',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw i4 gran coupe',
     'model': 'i4 gran coupe',
     'odometer': 33554,
     'odometer_in_km': 53999,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-25',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw i4 gran coupe 250kw edrive40 sport 83.9kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '250kw edrive40 sport 83.9kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '076cc4ee-ab26-54ba-9070-56fa13208338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BT72DKA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117006204',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': 'I4 GRAN COUPE',
 'odometer': 33554,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seller_name': 'Zenith',
 'title': 'BMW I4 GRAN COUPE 250kW eDrive40 Sport 83.9kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '250kW eDrive40 Sport 83.9kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117006204%27 HTTP/1.1" 200 None
2025-12-02 19:09:30 [astonbarclay.gb] INFO: Saving data for 117006204: {'created_time': 1764356700.15966, 'last_price_update_time': 1764702570.090083, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117006204') HTTP/1.1" 204 0
2025-12-02 19:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf068f510>
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252Fc5e016da-f29c-4bcc-8189-45188fd4d516_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/c5e016da-f29c-4bcc-8189-45188fd4d516_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0373dd0>
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252Feb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/eb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5
2025-12-02 19:09:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116996626, 'registration': 'YC72BDZ', 'account': 'ZEN009', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Tekna 5dr', 'mileage': 34487, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-10-21', 'fuel': 'Petrol', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/6426d264-6b86-4f71-8897-abdb63a423e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/a52014b0-dfb7-4338-8aa3-cd47df84e3bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/a4ced85f-f93f-4917-a99b-a4f0b78cb248_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/150e8c7c-d0b4-4721-a6d6-6165e09c6cdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/fd24130e-e04d-440b-89ca-c8ca650c283c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/cfb73f8c-0ea9-458c-95fd-cc4029a760e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/479f8d12-3f53-463e-a17a-6058262c9e8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/66413860-c584-40bd-9fe0-a96a059264a9_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23 11K 10/24 23K', 'remarks': 'vosa states 33k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/07e320b6-ebe2-4cdc-9715-42a72a4528a1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116996626, 'registration': 'YC72BDZ', 'account': 'ZEN009', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Tekna 5dr', 'mileage': 34487, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-10-21', 'fuel': 'Petrol', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/6426d264-6b86-4f71-8897-abdb63a423e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/a52014b0-dfb7-4338-8aa3-cd47df84e3bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/a4ced85f-f93f-4917-a99b-a4f0b78cb248_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/150e8c7c-d0b4-4721-a6d6-6165e09c6cdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/fd24130e-e04d-440b-89ca-c8ca650c283c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/cfb73f8c-0ea9-458c-95fd-cc4029a760e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/479f8d12-3f53-463e-a17a-6058262c9e8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC72BDZ/2025-11-25/image/66413860-c584-40bd-9fe0-a96a059264a9_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23 11K 10/24 23K', 'remarks': 'vosa states 33k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/07e320b6-ebe2-4cdc-9715-42a72a4528a1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4033447-ae33-5551-b659-5f6a5047cffd with identifier: 116996626
2025-12-02 19:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4033447-ae33-5551-b659-5f6a5047cffd with scrape type 2
2025-12-02 19:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4033447-ae33-5551-b659-5f6a5047cffd with scrape type 2
2025-12-02 19:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f4033447-ae33-5551-b659-5f6a5047cffd, identifier: 116996626
2025-12-02 19:09:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117289497, 'registration': 'WN20SYC', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'GLC ESTATE', 'derivative': 'GLC 300e 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 80312, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-06-24', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WN20SYC/2025-11-24/image/f0cb6f01-3cc7-48be-8eec-59675fd5badd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/98a98f74-2df4-432c-983b-baebfa23c9b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/76889aca-fa85-459d-84f9-c04465aee8c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/eebef6eb-b186-4b72-a327-a1a4882fb5fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/acdda545-197c-4ccd-9008-b20a2ea4da0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/83be093c-4d29-4263-bf53-44fa591f9b31_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/2cc7c1b3-d71e-4525-ae4f-66c558a97a92_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/78c1a4c9-e5ab-4aee-9c1f-6314d0d6c983_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 06/21 17k 09/22 38k 05/24 60k 10/25 79k', 'remarks': 'SPARE KEY Metallic Paint VOSA STATES 47K 60K 72K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 61, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/817c0be8-7022-4a91-97dc-3f099385926f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117289497, 'registration': 'WN20SYC', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'GLC ESTATE', 'derivative': 'GLC 300e 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 80312, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-06-24', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WN20SYC/2025-11-24/image/f0cb6f01-3cc7-48be-8eec-59675fd5badd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/98a98f74-2df4-432c-983b-baebfa23c9b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/76889aca-fa85-459d-84f9-c04465aee8c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/eebef6eb-b186-4b72-a327-a1a4882fb5fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/acdda545-197c-4ccd-9008-b20a2ea4da0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/83be093c-4d29-4263-bf53-44fa591f9b31_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/2cc7c1b3-d71e-4525-ae4f-66c558a97a92_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN20SYC/2025-11-24/image/78c1a4c9-e5ab-4aee-9c1f-6314d0d6c983_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 06/21 17k 09/22 38k 05/24 60k 10/25 79k', 'remarks': 'SPARE KEY Metallic Paint VOSA STATES 47K 60K 72K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 61, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/817c0be8-7022-4a91-97dc-3f099385926f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60c6d57c-3dc7-5765-8736-d1453f7d0b84 with identifier: 117289497
2025-12-02 19:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c6d57c-3dc7-5765-8736-d1453f7d0b84 with scrape type 2
2025-12-02 19:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60c6d57c-3dc7-5765-8736-d1453f7d0b84 with scrape type 2
2025-12-02 19:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 60c6d57c-3dc7-5765-8736-d1453f7d0b84, identifier: 117289497
2025-12-02 19:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a4f5ff8a-d972-4cd0-9950-7d5a9d21c5d9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584133?view=catalogue)
2025-12-02 19:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/d4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117440946?view=catalogue)
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252F62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117493253?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f4033447-ae33-5551-b659-5f6a5047cffd with identifier: 116996626
2025-12-02 19:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f4033447-ae33-5551-b659-5f6a5047cffd with identifier: 116996626
2025-12-02 19:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f4033447-ae33-5551-b659-5f6a5047cffd with identifier: 116996626 to the API
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116996626?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f4033447-ae33-5551-b659-5f6a5047cffd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YC72BDZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116996626',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 34487,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seller_name': 'Zenith',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH Tekna 5dr',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116996626%27 HTTP/1.1" 200 None
2025-12-02 19:09:31 [astonbarclay.gb] INFO: Saving data for 116996626: {'auction_closing_time': 1764842400.0, 'created_time': 1764184436.491503, 'last_price_update_time': 1764702571.360558}
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116996626') HTTP/1.1" 204 0
2025-12-02 19:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 60c6d57c-3dc7-5765-8736-d1453f7d0b84 with identifier: 117289497
2025-12-02 19:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 60c6d57c-3dc7-5765-8736-d1453f7d0b84 with identifier: 117289497
2025-12-02 19:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 60c6d57c-3dc7-5765-8736-d1453f7d0b84 with identifier: 117289497 to the API
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117289497?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 61,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '60c6d57c-3dc7-5765-8736-d1453f7d0b84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WN20SYC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117289497',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'GLC ESTATE',
 'odometer': 80312,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-24',
 'seller_name': 'Zenith',
 'title': 'MERCEDES-BENZ GLC ESTATE GLC 300e 4Matic AMG Line Premium 5dr '
          '9G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLC 300e 4Matic AMG Line Premium 5dr 9G-Tronic',
 'vin': None,
 'year': 2020}
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289497%27 HTTP/1.1" 200 None
2025-12-02 19:09:31 [astonbarclay.gb] INFO: Saving data for 117289497: {'auction_closing_time': 1764842400.0, 'created_time': 1764097299.088023, 'last_price_update_time': 1764702571.700602}
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117289497') HTTP/1.1" 204 0
2025-12-02 19:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06d72d0>
2025-12-02 19:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252Ffa7d095f-f882-44a6-b260-0d4fce5fe484_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/fa7d095f-f882-44a6-b260-0d4fce5fe484_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9
2025-12-02 19:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf095e310>
2025-12-02 19:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252Fcbaec602-46af-4f76-8674-3f91de81046f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/cbaec602-46af-4f76-8674-3f91de81046f_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117433187, 'registration': 'YF71LBX', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'E-TRON ESTATE', 'derivative': '300kW 55 Quattro 95kWh Black Edition 5dr Auto', 'mileage': 100275, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-07', 'fuel': 'Electric', 'motExpiry': '2025-12-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF71LBX/2025-11-25/image/c40597eb-f84b-4f40-b0f9-6a06bb0a8afe_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/9a718149-3517-4fa4-ae22-87ec5e213d3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/5cf70d80-c9d9-46d6-9917-baeaaa66d811_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/63d583d3-ce6a-40d7-a077-19bd0bac5477_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/d6d9c37b-b613-4b7e-847b-ee6cda569bbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/54c55f49-543f-4adf-9e70-5884bc6f49e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/1a5d227d-01b9-40e8-b2d7-8224bcf4d96a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/84608425-83bb-4f56-b071-3f85e63dadd9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/22-20k, 08/23-41k, 05/24-62k, 02/25-81k,', 'remarks': 'vosa states 75k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43e1f5fe-4880-4e66-89ce-5a39655cbd5f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117433187, 'registration': 'YF71LBX', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'E-TRON ESTATE', 'derivative': '300kW 55 Quattro 95kWh Black Edition 5dr Auto', 'mileage': 100275, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-07', 'fuel': 'Electric', 'motExpiry': '2025-12-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YF71LBX/2025-11-25/image/c40597eb-f84b-4f40-b0f9-6a06bb0a8afe_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/9a718149-3517-4fa4-ae22-87ec5e213d3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/5cf70d80-c9d9-46d6-9917-baeaaa66d811_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/63d583d3-ce6a-40d7-a077-19bd0bac5477_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/d6d9c37b-b613-4b7e-847b-ee6cda569bbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/54c55f49-543f-4adf-9e70-5884bc6f49e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/1a5d227d-01b9-40e8-b2d7-8224bcf4d96a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF71LBX/2025-11-25/image/84608425-83bb-4f56-b071-3f85e63dadd9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/22-20k, 08/23-41k, 05/24-62k, 02/25-81k,', 'remarks': 'vosa states 75k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43e1f5fe-4880-4e66-89ce-5a39655cbd5f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aae1dec-9102-52f0-a6a6-c9897e3e772b with identifier: 117433187
2025-12-02 19:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aae1dec-9102-52f0-a6a6-c9897e3e772b with scrape type 2
2025-12-02 19:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aae1dec-9102-52f0-a6a6-c9897e3e772b with scrape type 2
2025-12-02 19:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0aae1dec-9102-52f0-a6a6-c9897e3e772b, identifier: 117433187
2025-12-02 19:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e04e94ce-c4ab-402d-adbc-d568137b076a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584826?view=catalogue)
2025-12-02 19:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL72JZT/2025-11-28/image/40039668-d4dc-4ada-a63c-3204bd1b7c7a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584133?view=catalogue)
2025-12-02 19:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO23HJC/2025-11-27/image/1a398950-79ed-49d3-ba8e-c5716ddba31a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue)
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F62013470-ff58-4ccd-8067-3bdb4fbb7ead_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/62013470-ff58-4ccd-8067-3bdb4fbb7ead_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252Fdee27912-1308-4a30-8d26-2fd6db54759f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/dee27912-1308-4a30-8d26-2fd6db54759f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0aae1dec-9102-52f0-a6a6-c9897e3e772b with identifier: 117433187
2025-12-02 19:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0aae1dec-9102-52f0-a6a6-c9897e3e772b with identifier: 117433187
2025-12-02 19:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 161376 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161376
2025-12-02 19:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0aae1dec-9102-52f0-a6a6-c9897e3e772b spider: astonbarclay.gb
2025-12-02 19:09:32 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0aae1dec-9102-52f0-a6a6-c9897e3e772b due to rule: high_mileage_for_country.json, error: 161376 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161376
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '0aae1dec-9102-52f0-a6a6-c9897e3e772b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YF71LBX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117433187',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'AUDI',
 'model': 'E-TRON ESTATE',
 'odometer': 100275,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seller_name': 'Zenith',
 'title': 'AUDI E-TRON ESTATE 300kW 55 Quattro 95kWh Black Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': '300kW 55 Quattro 95kWh Black Edition 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433187%27 HTTP/1.1" 200 None
2025-12-02 19:09:32 [astonbarclay.gb] INFO: Saving data for 117433187: {'auction_closing_time': 1764842400.0, 'created_time': 1764097355.321258, 'last_price_update_time': 1764702572.503772}
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117433187') HTTP/1.1" 204 0
2025-12-02 19:09:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07cf9d0>
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252F81849327-b964-487c-bf56-53c6aff35048_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/81849327-b964-487c-bf56-53c6aff35048_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0918b90>
2025-12-02 19:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252F8390c62b-2af7-4711-b962-589b69e665e4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/8390c62b-2af7-4711-b962-589b69e665e4_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c28c62f7-a54e-585d-8aef-f346f5f7c660
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03383d0>
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252F64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5
2025-12-02 19:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF74HXN/2025-12-02/image/68c5a044-e0c9-4eac-9ee3-07cebf73fa4b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625064?view=catalogue)
2025-12-02 19:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117440946?view=catalogue)
2025-12-02 19:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB71FNE/2025-12-01/image/919b135c-019e-4e6b-9953-ae280850aefa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117344624?view=catalogue)
2025-12-02 19:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0ac4290>
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252Fed941482-7ad4-4088-bab9-37f60d6bf3ee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/ed941482-7ad4-4088-bab9-37f60d6bf3ee_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf065d850>
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252Fba208cf4-5492-4c1b-88c2-ebc7cf281061_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/ba208cf4-5492-4c1b-88c2-ebc7cf281061_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c28c62f7-a54e-585d-8aef-f346f5f7c660
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03b9a50>
2025-12-02 19:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F7235ba67-86d3-445f-8389-c0b60aaa9d21_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/7235ba67-86d3-445f-8389-c0b60aaa9d21_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KP72GGX/2025-12-01/image/fc6b00d7-fba0-4b26-9cd2-6ea97766a186_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584826?view=catalogue)
2025-12-02 19:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FL72JZT/2025-11-28/image/c177db20-979e-42bf-b411-713ef49c97a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117584133?view=catalogue)
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F05f66d7a-9631-41b8-9347-74a77dc22c01_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/05f66d7a-9631-41b8-9347-74a77dc22c01_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03b96d0>
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252Fa4f5ff8a-d972-4cd0-9950-7d5a9d21c5d9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a4f5ff8a-d972-4cd0-9950-7d5a9d21c5d9_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c28c62f7-a54e-585d-8aef-f346f5f7c660
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08ce3d0>
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252Fd4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/d4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5
2025-12-02 19:09:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117493253, 'registration': 'BL72EKK', 'account': 'ZEN009', 'make': 'VOLVO', 'model': 'XC60 ESTATE', 'derivative': '2.0 B5P Core 5dr AWD Geartronic', 'mileage': 39743, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-01-16', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BL72EKK/2025-11-26/image/4e7c8df4-f248-44c7-9e9d-0f27f1f887ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f54904fa-ba57-46d2-91be-d67a5d3012ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/73b19f8e-5164-4163-8fd5-1cc0a91f9bfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/a7b7e45d-12c8-4565-b7f2-24bade4796d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/edfaea43-0801-4ebe-b44b-8fc43aee7223_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/b2ff75ad-2fab-48f3-b91a-4b49e3409a49_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/037b0a1b-8df7-425e-a67c-f95a2e4bebc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f17f3557-a156-4075-8d00-e8d89047fdce_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/24 16K 02/25 29K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 180, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b63c6329-1d94-48dd-b093-b057b5516de8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117493253, 'registration': 'BL72EKK', 'account': 'ZEN009', 'make': 'VOLVO', 'model': 'XC60 ESTATE', 'derivative': '2.0 B5P Core 5dr AWD Geartronic', 'mileage': 39743, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-01-16', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BL72EKK/2025-11-26/image/4e7c8df4-f248-44c7-9e9d-0f27f1f887ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f54904fa-ba57-46d2-91be-d67a5d3012ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/73b19f8e-5164-4163-8fd5-1cc0a91f9bfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/a7b7e45d-12c8-4565-b7f2-24bade4796d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/edfaea43-0801-4ebe-b44b-8fc43aee7223_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/b2ff75ad-2fab-48f3-b91a-4b49e3409a49_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/037b0a1b-8df7-425e-a67c-f95a2e4bebc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f17f3557-a156-4075-8d00-e8d89047fdce_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/24 16K 02/25 29K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 180, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b63c6329-1d94-48dd-b093-b057b5516de8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22fac505-0cb4-52ec-8f8d-4c4b922b32be with identifier: 117493253
2025-12-02 19:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be with scrape type 1
2025-12-02 19:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252F4e7c8df4-f248-44c7-9e9d-0f27f1f887ea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/4e7c8df4-f248-44c7-9e9d-0f27f1f887ea_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF74HXN/2025-12-02/image/540627f3-5856-42bf-88e2-35f8b3a0f153_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625064?view=catalogue)
2025-12-02 19:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117440946?view=catalogue)
2025-12-02 19:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO23HJC/2025-11-27/image/150bcf4b-9d0d-4ee3-ae8c-5a825dea54cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue)
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0312b90>
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252Fe04e94ce-c4ab-402d-adbc-d568137b076a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e04e94ce-c4ab-402d-adbc-d568137b076a_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf050c890>
2025-12-02 19:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252F40039668-d4dc-4ada-a63c-3204bd1b7c7a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/40039668-d4dc-4ada-a63c-3204bd1b7c7a_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c28c62f7-a54e-585d-8aef-f346f5f7c660
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0393490>
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F1a398950-79ed-49d3-ba8e-c5716ddba31a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/1a398950-79ed-49d3-ba8e-c5716ddba31a_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF74HXN/2025-12-02/image/5c82f323-b11b-46f6-8818-791b8cf8ea76_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625064?view=catalogue)
2025-12-02 19:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO23HJC/2025-11-27/image/78da6f7d-6f20-4805-bb22-7c66a8ce5d65_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue)
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252Fe3603e60-f43a-4321-9aa7-51a4f7847016_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/e3603e60-f43a-4321-9aa7-51a4f7847016_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252Ff54904fa-ba57-46d2-91be-d67a5d3012ea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f54904fa-ba57-46d2-91be-d67a5d3012ea_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0331c90>
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F68c5a044-e0c9-4eac-9ee3-07cebf73fa4b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/68c5a044-e0c9-4eac-9ee3-07cebf73fa4b_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0808a90>
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252F970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0780950>
2025-12-02 19:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB71FNE%252F2025-12-01%252Fimage%252F919b135c-019e-4e6b-9953-ae280850aefa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB71FNE/2025-12-01/image/919b135c-019e-4e6b-9953-ae280850aefa_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b
2025-12-02 19:09:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0061dd9e-9f66-58a7-bbb7-36252aa3e46b, skipping ID generation
2025-12-02 19:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b with scrape type 1
2025-12-02 19:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b from tracking dictionaries
2025-12-02 19:09:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0061dd9e-9f66-58a7-bbb7-36252aa3e46b sending to next pipeline
2025-12-02 19:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0061dd9e-9f66-58a7-bbb7-36252aa3e46b, identifier: 117344624
2025-12-02 19:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117440946?view=catalogue)
2025-12-02 19:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0061dd9e-9f66-58a7-bbb7-36252aa3e46b with identifier: 117344624
2025-12-02 19:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0061dd9e-9f66-58a7-bbb7-36252aa3e46b with identifier: 117344624
2025-12-02 19:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0061dd9e-9f66-58a7-bbb7-36252aa3e46b with identifier: 117344624 to the API
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LB71FNE/2025-12-01/image/919b135c-019e-4e6b-9953-ae280850aefa_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '0061dd9e-9f66-58a7-bbb7-36252aa3e46b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LB71FNE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117344624',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 23043,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31737,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/4661e44e-a752-4c73-bc8f-d5174ddf04ed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33665,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/5df7a42f-bdc2-4472-98ff-d0f87bc5bae0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33784,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d29783a6-55cd-4043-9670-afd3b9870c0c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34280,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/d5f9432d-0ff8-4478-ab48-e087e6dc0b08_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37050,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/6bcc7bde-4449-4b97-8b11-5e90e0ea2b9a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51668,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/2bb1ce6b-20be-4e4e-a7c3-13436491d64b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49764,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/0b62e6f2-de8e-4658-afce-6266602e2ccb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65126,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/18bb3521-d16c-4128-b3f0-69cffa9e9953_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0061dd9e-9f66-58a7-bbb7-36252aa3e46b/0061dd9e-9f66-58a7-bbb7-36252aa3e46b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50727,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB71FNE/2025-12-01/image/919b135c-019e-4e6b-9953-ae280850aefa_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117344624%27 HTTP/1.1" 200 None
2025-12-02 19:09:36 [astonbarclay.gb] INFO: Saving data for 117344624: {'created_time': 1764702576.638849, 'last_price_update_time': 1764702576.63886, 'auction_closing_time': 1764927900.0}
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117344624') HTTP/1.1" 204 0
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf099b490>
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKP72GGX%252F2025-12-01%252Fimage%252Ffc6b00d7-fba0-4b26-9cd2-6ea97766a186_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KP72GGX/2025-12-01/image/fc6b00d7-fba0-4b26-9cd2-6ea97766a186_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f
2025-12-02 19:09:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cf79778-bf82-579a-8ea0-4676b1b68e6f, skipping ID generation
2025-12-02 19:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f with scrape type 1
2025-12-02 19:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0cf79778-bf82-579a-8ea0-4676b1b68e6f from tracking dictionaries
2025-12-02 19:09:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cf79778-bf82-579a-8ea0-4676b1b68e6f sending to next pipeline
2025-12-02 19:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0cf79778-bf82-579a-8ea0-4676b1b68e6f, identifier: 117584826
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ff1010>
2025-12-02 19:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFL72JZT%252F2025-11-28%252Fimage%252Fc177db20-979e-42bf-b411-713ef49c97a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FL72JZT/2025-11-28/image/c177db20-979e-42bf-b411-713ef49c97a2_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c28c62f7-a54e-585d-8aef-f346f5f7c660
2025-12-02 19:09:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c28c62f7-a54e-585d-8aef-f346f5f7c660, skipping ID generation
2025-12-02 19:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c28c62f7-a54e-585d-8aef-f346f5f7c660 with scrape type 1
2025-12-02 19:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c28c62f7-a54e-585d-8aef-f346f5f7c660 from tracking dictionaries
2025-12-02 19:09:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c28c62f7-a54e-585d-8aef-f346f5f7c660 sending to next pipeline
2025-12-02 19:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c28c62f7-a54e-585d-8aef-f346f5f7c660, identifier: 117584133
2025-12-02 19:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF74HXN/2025-12-02/image/62013470-ff58-4ccd-8067-3bdb4fbb7ead_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625064?view=catalogue)
2025-12-02 19:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO23HJC/2025-11-27/image/dee27912-1308-4a30-8d26-2fd6db54759f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue)
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F324b4748-8fa0-4ea3-b911-3532b0b36775_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/324b4748-8fa0-4ea3-b911-3532b0b36775_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252F73b19f8e-5164-4163-8fd5-1cc0a91f9bfc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/73b19f8e-5164-4163-8fd5-1cc0a91f9bfc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117314112?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0cf79778-bf82-579a-8ea0-4676b1b68e6f with identifier: 117584826
2025-12-02 19:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0cf79778-bf82-579a-8ea0-4676b1b68e6f with identifier: 117584826
2025-12-02 19:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0cf79778-bf82-579a-8ea0-4676b1b68e6f with identifier: 117584826 to the API
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KP72GGX/2025-12-01/image/fc6b00d7-fba0-4b26-9cd2-6ea97766a186_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0cf79778-bf82-579a-8ea0-4676b1b68e6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KP72GGX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584826',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 15295,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31373,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/5e947478-2b9d-42d1-bb3b-a01821ebb32f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30985,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/20f994fe-d727-43b2-926a-699eb8c10936_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30157,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/9de8cbb0-8b7a-4875-bd6b-b2490b66b562_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31369,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e4a9486b-8416-4f8b-9365-458d253d01e2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50782,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/c5e016da-f29c-4bcc-8189-45188fd4d516_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42188,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/81849327-b964-487c-bf56-53c6aff35048_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41976,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/e04e94ce-c4ab-402d-adbc-d568137b076a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf79778-bf82-579a-8ea0-4676b1b68e6f/0cf79778-bf82-579a-8ea0-4676b1b68e6f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51831,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KP72GGX/2025-12-01/image/fc6b00d7-fba0-4b26-9cd2-6ea97766a186_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seller_name': 'Zenith',
 'title': 'BMW 2 SERIES GRAN COUPE M235i xDrive 4dr Step Auto [Tech/Pro Pack]',
 'transmission': 'automatic',
 'trim': 'M235i xDrive 4dr Step Auto [Tech/Pro Pack]',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584826%27 HTTP/1.1" 200 None
2025-12-02 19:09:37 [astonbarclay.gb] INFO: Saving data for 117584826: {'created_time': 1764702577.657464, 'last_price_update_time': 1764702577.657475, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584826') HTTP/1.1" 204 0
2025-12-02 19:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c28c62f7-a54e-585d-8aef-f346f5f7c660 with identifier: 117584133
2025-12-02 19:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c28c62f7-a54e-585d-8aef-f346f5f7c660 with identifier: 117584133
2025-12-02 19:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c28c62f7-a54e-585d-8aef-f346f5f7c660 with identifier: 117584133 to the API
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FL72JZT/2025-11-28/image/c177db20-979e-42bf-b411-713ef49c97a2_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'c28c62f7-a54e-585d-8aef-f346f5f7c660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FL72JZT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584133',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MINI',
 'model': 'COUNTRYMAN HATCHBACK',
 'odometer': 55078,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30751,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a15021d4-e1fa-4ef4-a90a-1b79d3572cdf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32165,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/b5910ab9-6f0d-4b25-8589-7489acbbe8b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30258,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/a4f5ff8a-d972-4cd0-9950-7d5a9d21c5d9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29508,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/54c699ac-52a5-4a15-8955-4c9c95b1e7ff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51474,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/ba208cf4-5492-4c1b-88c2-ebc7cf281061_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46801,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/8390c62b-2af7-4711-b962-589b69e665e4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51835,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/40039668-d4dc-4ada-a63c-3204bd1b7c7a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c28c62f7-a54e-585d-8aef-f346f5f7c660/c28c62f7-a54e-585d-8aef-f346f5f7c660_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57477,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FL72JZT/2025-11-28/image/c177db20-979e-42bf-b411-713ef49c97a2_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seller_name': 'Zenith',
 'title': 'MINI COUNTRYMAN HATCHBACK 1.5 Cooper S E Classic ALL4 PHEV 5dr '
          'Auto[Comfort]',
 'transmission': 'automatic',
 'trim': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto[Comfort]',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584133%27 HTTP/1.1" 200 None
2025-12-02 19:09:38 [astonbarclay.gb] INFO: Saving data for 117584133: {'created_time': 1764702578.018804, 'last_price_update_time': 1764702578.018813, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584133') HTTP/1.1" 204 0
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf031b0d0>
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F540627f3-5856-42bf-88e2-35f8b3a0f153_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/540627f3-5856-42bf-88e2-35f8b3a0f153_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0634a50>
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252F9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf3718a50>
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F150bcf4b-9d0d-4ee3-ae8c-5a825dea54cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/150bcf4b-9d0d-4ee3-ae8c-5a825dea54cf_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117391120?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf04e1fd0>
2025-12-02 19:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F5c82f323-b11b-46f6-8818-791b8cf8ea76_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/5c82f323-b11b-46f6-8818-791b8cf8ea76_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08ede50>
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F78da6f7d-6f20-4805-bb22-7c66a8ce5d65_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/78da6f7d-6f20-4805-bb22-7c66a8ce5d65_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL72EKK/2025-11-26/image/4e7c8df4-f248-44c7-9e9d-0f27f1f887ea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117493253?view=catalogue)
2025-12-02 19:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO23HJC/2025-11-27/image/05f66d7a-9631-41b8-9347-74a77dc22c01_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue)
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252Fa7b7e45d-12c8-4565-b7f2-24bade4796d6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/a7b7e45d-12c8-4565-b7f2-24bade4796d6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0591c90>
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72FVF%252F2025-11-24%252Fimage%252F62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5
2025-12-02 19:09:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5, skipping ID generation
2025-12-02 19:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5 with scrape type 1
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5 from tracking dictionaries
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5 sending to next pipeline
2025-12-02 19:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5, identifier: 117440946
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08ecc50>
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF74HXN%252F2025-12-02%252Fimage%252F62013470-ff58-4ccd-8067-3bdb4fbb7ead_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF74HXN/2025-12-02/image/62013470-ff58-4ccd-8067-3bdb4fbb7ead_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9
2025-12-02 19:09:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9, skipping ID generation
2025-12-02 19:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9 with scrape type 1
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9 from tracking dictionaries
2025-12-02 19:09:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9 sending to next pipeline
2025-12-02 19:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9, identifier: 117625064
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066c8d0>
2025-12-02 19:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252Fdee27912-1308-4a30-8d26-2fd6db54759f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/dee27912-1308-4a30-8d26-2fd6db54759f_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117314112, 'registration': 'YF72KHG', 'account': 'ZEN009', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic', 'mileage': 35029, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-01', 'fuel': 'Petrol', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YF72KHG/2025-12-01/image/362908e4-c29e-4779-91ee-b4dbccc633eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/a4893da9-d8bf-437c-a85a-49e811591ced_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/d4109bd3-503c-4ee3-a6d7-c34c54c1123d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/7ab87f0f-fe68-4abf-8bb5-5861c121cc41_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/9c779bad-c126-4dfb-ad32-a0ea9a1dc212_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/ccdc7d7b-3840-413d-ab91-dd170113559f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/793fc5e7-72aa-4636-9a88-e79c904fa5c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/2ddabab4-84f5-4295-9298-67e9a43e5dd1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/24 19K 10/25 33K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3f345203-079e-4dd9-aaf1-738db9fd2c69.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117314112, 'registration': 'YF72KHG', 'account': 'ZEN009', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic', 'mileage': 35029, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-01', 'fuel': 'Petrol', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YF72KHG/2025-12-01/image/362908e4-c29e-4779-91ee-b4dbccc633eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/a4893da9-d8bf-437c-a85a-49e811591ced_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/d4109bd3-503c-4ee3-a6d7-c34c54c1123d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/7ab87f0f-fe68-4abf-8bb5-5861c121cc41_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/9c779bad-c126-4dfb-ad32-a0ea9a1dc212_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/ccdc7d7b-3840-413d-ab91-dd170113559f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/793fc5e7-72aa-4636-9a88-e79c904fa5c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/2ddabab4-84f5-4295-9298-67e9a43e5dd1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/24 19K 10/25 33K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3f345203-079e-4dd9-aaf1-738db9fd2c69.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 672620e2-54c8-5641-b4ba-54913689dea3 with identifier: 117314112
2025-12-02 19:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 672620e2-54c8-5641-b4ba-54913689dea3 with scrape type 1
2025-12-02 19:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 672620e2-54c8-5641-b4ba-54913689dea3
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252F362908e4-c29e-4779-91ee-b4dbccc633eb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/362908e4-c29e-4779-91ee-b4dbccc633eb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252Fedfaea43-0801-4ebe-b44b-8fc43aee7223_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/edfaea43-0801-4ebe-b44b-8fc43aee7223_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5 with identifier: 117440946
2025-12-02 19:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5 with identifier: 117440946
2025-12-02 19:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw ix3 electric estate 210kw m sport pro 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'ix3 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 18680, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117440946', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '210kw m sport pro 80kwh 5dr auto', 'license_plate': 'bj72fvf', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': None, 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/df8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 25998}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27738}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/eb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27861}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27253}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/d4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 48277}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 43432}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 52394}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 46439}], 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'bmw ix3 electric estate', 'sanitized_make': 'bmw', 'odometer_in_km': 30062} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': None,
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bj72fvf',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117440946',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw ix3 electric estate',
     'model': 'ix3 electric estate',
     'odometer': 18680,
     'odometer_in_km': 30062,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25998,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/df8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27738,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27861,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/eb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27253,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48277,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/d4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43432,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52394,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46439,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-10',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw ix3 electric estate 210kw m sport pro 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw m sport pro 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5 spider: astonbarclay.gb
2025-12-02 19:09:40 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'bmw ix3 electric estate 210kw m sport pro 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'ix3 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 18680, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117440946', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '210kw m sport pro 80kwh 5dr auto', 'license_plate': 'bj72fvf', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': None, 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/df8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 25998}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27738}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/eb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27861}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27253}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/d4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 48277}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 43432}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 52394}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 46439}], 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'bmw ix3 electric estate', 'sanitized_make': 'bmw', 'odometer_in_km': 30062} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': None,
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bj72fvf',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117440946',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw ix3 electric estate',
     'model': 'ix3 electric estate',
     'odometer': 18680,
     'odometer_in_km': 30062,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25998,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/df8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27738,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27861,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/eb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27253,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48277,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/d4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43432,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52394,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46439,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-10',
     'sanitized_make': 'bmw',
     'seller_name': 'zenith',
     'title': 'bmw ix3 electric estate 210kw m sport pro 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw m sport pro 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': None,
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BJ72FVF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117440946',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': 'iX3 ELECTRIC ESTATE',
 'odometer': 18680,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25998,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/df8de65f-7d75-4810-97f1-fca5152c4896_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27738,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/7b4b1559-b7f7-4449-af9b-906dd29c6eb9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27861,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/eb500a93-acce-4b91-a383-99fd5e3bdc2c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27253,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/64d0f300-3cda-4529-b057-078e3b46aa24_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48277,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/d4fa1c5d-2849-44e8-9e70-932d26e614e2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43432,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/970f93cc-5b61-426b-80ca-7bd539af1d27_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52394,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/9e9e19ca-454d-4931-9901-fdb2c459a322_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5/dcf7bfe4-3f4f-54cf-aabc-3dd99a3d79e5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46439,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72FVF/2025-11-24/image/62e9c07a-74be-46f6-81cb-419d26dd3840_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-10',
 'seller_name': 'Zenith',
 'title': 'BMW iX3 ELECTRIC ESTATE 210kW M Sport Pro 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '210kW M Sport Pro 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440946%27 HTTP/1.1" 200 None
2025-12-02 19:09:40 [astonbarclay.gb] INFO: Saving data for 117440946: {'created_time': 1764702580.467157, 'last_price_update_time': 1764702580.467167, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117440946') HTTP/1.1" 204 0
2025-12-02 19:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9 with identifier: 117625064
2025-12-02 19:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9 with identifier: 117625064
2025-12-02 19:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9 with identifier: 117625064 to the API
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YF74HXN/2025-12-02/image/62013470-ff58-4ccd-8067-3bdb4fbb7ead_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YF74HXN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117625064',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 19071,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29164,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/1b481e1b-466f-4a3b-a561-defa99687aeb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29850,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/557ea71f-23a4-4ab7-b7cf-9334815f2ee2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29586,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/b20bd4a4-4e73-4cec-b6d2-792a08c1c7d1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29968,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/fa7d095f-f882-44a6-b260-0d4fce5fe484_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39859,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/ed941482-7ad4-4088-bab9-37f60d6bf3ee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58028,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/68c5a044-e0c9-4eac-9ee3-07cebf73fa4b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57028,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/540627f3-5856-42bf-88e2-35f8b3a0f153_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48279,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/5c82f323-b11b-46f6-8818-791b8cf8ea76_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9/92b22046-44c5-5b47-9cd6-1c0c1fcbd5a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59731,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF74HXN/2025-12-02/image/62013470-ff58-4ccd-8067-3bdb4fbb7ead_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-11',
 'seller_name': 'Liquid Fleet',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi 207 HEV 3 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6T GDi 207 HEV 3 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625064%27 HTTP/1.1" 200 None
2025-12-02 19:09:40 [astonbarclay.gb] INFO: Saving data for 117625064: {'created_time': 1764702580.853732, 'last_price_update_time': 1764702580.853744, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117625064') HTTP/1.1" 204 0
2025-12-02 19:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO23HJC/2025-11-27/image/e3603e60-f43a-4321-9aa7-51a4f7847016_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue)
2025-12-02 19:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f54904fa-ba57-46d2-91be-d67a5d3012ea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117493253?view=catalogue)
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252Fa4893da9-d8bf-437c-a85a-49e811591ced_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/a4893da9-d8bf-437c-a85a-49e811591ced_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117391120, 'registration': 'MD23FRK', 'account': 'ZEN009', 'make': 'VOLKSWAGEN', 'model': 'TAIGO HATCHBACK', 'derivative': '1.0 TSI 110 R-Line 5dr', 'mileage': 19386, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-05-31', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1906c35c-7933-4f06-8225-f2060dcabff8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/953ccccf-d481-4a94-bc52-b95dc78ec5f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5d28f19a-4ccb-48a1-843c-c8f2dbb46961_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/516025e3-ec1c-43a8-9fec-c3a861aa5af0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/ad4add40-0f6c-46e1-b224-7f7f5ff2344b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1dd8f6b3-55ba-4ff3-8071-da4a744fa716_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5b94311b-5381-4f7e-95e0-7ef6ba575494_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/f69050e6-7269-42c0-ab30-d42afa6af0b0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d350d612-04b8-485f-add3-62bd1eafecf3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117391120, 'registration': 'MD23FRK', 'account': 'ZEN009', 'make': 'VOLKSWAGEN', 'model': 'TAIGO HATCHBACK', 'derivative': '1.0 TSI 110 R-Line 5dr', 'mileage': 19386, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-05-31', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1906c35c-7933-4f06-8225-f2060dcabff8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/953ccccf-d481-4a94-bc52-b95dc78ec5f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5d28f19a-4ccb-48a1-843c-c8f2dbb46961_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/516025e3-ec1c-43a8-9fec-c3a861aa5af0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/ad4add40-0f6c-46e1-b224-7f7f5ff2344b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1dd8f6b3-55ba-4ff3-8071-da4a744fa716_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5b94311b-5381-4f7e-95e0-7ef6ba575494_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/f69050e6-7269-42c0-ab30-d42afa6af0b0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d350d612-04b8-485f-add3-62bd1eafecf3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7 with identifier: 117391120
2025-12-02 19:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7 with scrape type 1
2025-12-02 19:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F1906c35c-7933-4f06-8225-f2060dcabff8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1906c35c-7933-4f06-8225-f2060dcabff8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252Fb2ff75ad-2fab-48f3-b91a-4b49e3409a49_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/b2ff75ad-2fab-48f3-b91a-4b49e3409a49_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117500036?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117492502?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117362156?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09a9010>
2025-12-02 19:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252F4e7c8df4-f248-44c7-9e9d-0f27f1f887ea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/4e7c8df4-f248-44c7-9e9d-0f27f1f887ea_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07c01d0>
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F05f66d7a-9631-41b8-9347-74a77dc22c01_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/05f66d7a-9631-41b8-9347-74a77dc22c01_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252Fd4109bd3-503c-4ee3-a6d7-c34c54c1123d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/d4109bd3-503c-4ee3-a6d7-c34c54c1123d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F953ccccf-d481-4a94-bc52-b95dc78ec5f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/953ccccf-d481-4a94-bc52-b95dc78ec5f1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO23HJC/2025-11-27/image/324b4748-8fa0-4ea3-b911-3532b0b36775_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117480129?view=catalogue)
2025-12-02 19:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL72EKK/2025-11-26/image/73b19f8e-5164-4163-8fd5-1cc0a91f9bfc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117493253?view=catalogue)
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252F037b0a1b-8df7-425e-a67c-f95a2e4bebc6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/037b0a1b-8df7-425e-a67c-f95a2e4bebc6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72KHG/2025-12-01/image/362908e4-c29e-4779-91ee-b4dbccc633eb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117314112?view=catalogue)
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252F7ab87f0f-fe68-4abf-8bb5-5861c121cc41_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/7ab87f0f-fe68-4abf-8bb5-5861c121cc41_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F5d28f19a-4ccb-48a1-843c-c8f2dbb46961_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5d28f19a-4ccb-48a1-843c-c8f2dbb46961_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116470730?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252Ff17f3557-a156-4075-8d00-e8d89047fdce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f17f3557-a156-4075-8d00-e8d89047fdce_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06cf3d0>
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_9.jpg HTTP/1.1" 201 0
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252Fe3603e60-f43a-4321-9aa7-51a4f7847016_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/e3603e60-f43a-4321-9aa7-51a4f7847016_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf069bfd0>
2025-12-02 19:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252Ff54904fa-ba57-46d2-91be-d67a5d3012ea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f54904fa-ba57-46d2-91be-d67a5d3012ea_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be
2025-12-02 19:09:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117500036, 'registration': 'OV72JXS', 'account': 'ZEN002', 'make': 'POLESTAR', 'model': '2 FASTBACK', 'derivative': '170kW 78kWh Long Range SM [Plus] 5dr Auto', 'mileage': 11124, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-09', 'fuel': 'Electric', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OV72JXS/2025-11-26/image/5f381ff2-d211-4a42-a77f-1ee160121295_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/8c651b89-4a0b-402c-93e6-85f1bd3bacf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/72e02996-357d-432b-a105-439522854310_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/3d81260b-a4e1-424d-a6a4-dd057b2073db_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/6cde671f-e42a-4100-9036-5fbd738945e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/c890ae18-bca3-4bf4-ba79-0d92fbcdc6d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/9b73e1f6-1205-4d7f-9d05-b1f47a95b529_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/59bb0418-8b72-43a7-a7ba-1324b1669c4d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'paint  VOSA STATES 10K SPARE KEY FOB', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e45a49fd-6013-469f-9cbc-62d41de6b67b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117500036, 'registration': 'OV72JXS', 'account': 'ZEN002', 'make': 'POLESTAR', 'model': '2 FASTBACK', 'derivative': '170kW 78kWh Long Range SM [Plus] 5dr Auto', 'mileage': 11124, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-09', 'fuel': 'Electric', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OV72JXS/2025-11-26/image/5f381ff2-d211-4a42-a77f-1ee160121295_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/8c651b89-4a0b-402c-93e6-85f1bd3bacf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/72e02996-357d-432b-a105-439522854310_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/3d81260b-a4e1-424d-a6a4-dd057b2073db_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/6cde671f-e42a-4100-9036-5fbd738945e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/c890ae18-bca3-4bf4-ba79-0d92fbcdc6d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/9b73e1f6-1205-4d7f-9d05-b1f47a95b529_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV72JXS/2025-11-26/image/59bb0418-8b72-43a7-a7ba-1324b1669c4d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'paint  VOSA STATES 10K SPARE KEY FOB', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e45a49fd-6013-469f-9cbc-62d41de6b67b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02cb01c1-f47e-512b-b37b-2a3a5492d63f with identifier: 117500036
2025-12-02 19:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02cb01c1-f47e-512b-b37b-2a3a5492d63f with scrape type 2
2025-12-02 19:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02cb01c1-f47e-512b-b37b-2a3a5492d63f with scrape type 2
2025-12-02 19:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 02cb01c1-f47e-512b-b37b-2a3a5492d63f, identifier: 117500036
2025-12-02 19:09:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117492502, 'registration': 'DP74FET', 'account': 'LIQ001', 'make': 'OMODA', 'model': '5 ESTATE', 'derivative': '1.6 TGDI Noble 5dr 7DCT', 'mileage': 9944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-12-31', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DP74FET/2025-11-28/image/d0428881-2191-4ee3-82ad-74a3837360f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/60073b38-2b27-4da6-ac0b-5dce94444666_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/5cfbdabb-a60a-45ec-8422-73ffdd01d811_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/64a5689b-b614-490b-a8bd-2ee0d71cb6da_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/f6823592-2a9b-4c06-90ee-3c867cc05171_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/00ab0ce0-5778-4598-b557-bceaa49bb6c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/3a4d941d-b107-4f98-b589-c07a99ca030d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/da42a56f-68a3-4aa3-b46e-cc18ba30b6c3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 170, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9b7b5d27-7224-4ed0-a410-b14b622aa231.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117492502, 'registration': 'DP74FET', 'account': 'LIQ001', 'make': 'OMODA', 'model': '5 ESTATE', 'derivative': '1.6 TGDI Noble 5dr 7DCT', 'mileage': 9944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-12-31', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DP74FET/2025-11-28/image/d0428881-2191-4ee3-82ad-74a3837360f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/60073b38-2b27-4da6-ac0b-5dce94444666_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/5cfbdabb-a60a-45ec-8422-73ffdd01d811_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/64a5689b-b614-490b-a8bd-2ee0d71cb6da_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/f6823592-2a9b-4c06-90ee-3c867cc05171_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/00ab0ce0-5778-4598-b557-bceaa49bb6c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/3a4d941d-b107-4f98-b589-c07a99ca030d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/da42a56f-68a3-4aa3-b46e-cc18ba30b6c3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 170, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9b7b5d27-7224-4ed0-a410-b14b622aa231.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce1ab312-4e4f-5472-af61-365a2e332333 with identifier: 117492502
2025-12-02 19:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce1ab312-4e4f-5472-af61-365a2e332333 with scrape type 1
2025-12-02 19:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ce1ab312-4e4f-5472-af61-365a2e332333
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252Fd0428881-2191-4ee3-82ad-74a3837360f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/d0428881-2191-4ee3-82ad-74a3837360f9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117362156, 'registration': 'BK72NZE', 'account': 'LEA062', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'Long Range AWD 5dr Auto', 'mileage': 46000, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-24', 'fuel': 'Electric', 'motExpiry': '2026-09-23', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK72NZE/2025-11-27/image/1918646f-6aaa-4877-b17c-70793cbcec98_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/425b7bdc-6828-47e0-a17c-99917a78f480_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/acb7e8b3-a257-4cae-b31b-65e235442700_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/d0828f35-4e81-4772-a84b-f9e10eb0afc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/c2f9da73-b5ca-4dab-ac2d-8c910aa73ddd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/b7634da8-039f-4fc7-836e-8188d5f16828_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/a282d2cc-f653-4834-8fe9-f8c3b6efc039_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/7cb397ba-7c93-46d0-9b3b-16bdec9e8520_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 44K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d80a2c16-c293-4f0e-a15f-19ce41dd8535.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117362156, 'registration': 'BK72NZE', 'account': 'LEA062', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'Long Range AWD 5dr Auto', 'mileage': 46000, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-24', 'fuel': 'Electric', 'motExpiry': '2026-09-23', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK72NZE/2025-11-27/image/1918646f-6aaa-4877-b17c-70793cbcec98_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/425b7bdc-6828-47e0-a17c-99917a78f480_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/acb7e8b3-a257-4cae-b31b-65e235442700_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/d0828f35-4e81-4772-a84b-f9e10eb0afc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/c2f9da73-b5ca-4dab-ac2d-8c910aa73ddd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/b7634da8-039f-4fc7-836e-8188d5f16828_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/a282d2cc-f653-4834-8fe9-f8c3b6efc039_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NZE/2025-11-27/image/7cb397ba-7c93-46d0-9b3b-16bdec9e8520_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 44K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d80a2c16-c293-4f0e-a15f-19ce41dd8535.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee8396a5-05f0-566e-9040-9b53713e7fc8 with identifier: 117362156
2025-12-02 19:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee8396a5-05f0-566e-9040-9b53713e7fc8 with scrape type 2
2025-12-02 19:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee8396a5-05f0-566e-9040-9b53713e7fc8 with scrape type 2
2025-12-02 19:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ee8396a5-05f0-566e-9040-9b53713e7fc8, identifier: 117362156
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252F9c779bad-c126-4dfb-ad32-a0ea9a1dc212_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/9c779bad-c126-4dfb-ad32-a0ea9a1dc212_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F516025e3-ec1c-43a8-9fec-c3a861aa5af0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/516025e3-ec1c-43a8-9fec-c3a861aa5af0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 02cb01c1-f47e-512b-b37b-2a3a5492d63f with identifier: 117500036
2025-12-02 19:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 02cb01c1-f47e-512b-b37b-2a3a5492d63f with identifier: 117500036
2025-12-02 19:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'polestar 2 fastback 170kw 78kwh long range sm [plus] 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'polestar', 'model': '2 fastback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 11124, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117500036', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '170kw 78kwh long range sm [plus] 5dr auto', 'license_plate': 'ov72jxs', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '02cb01c1-f47e-512b-b37b-2a3a5492d63f', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'polestar 2 fastback', 'sanitized_make': 'polestar', 'odometer_in_km': 17902}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '02cb01c1-f47e-512b-b37b-2a3a5492d63f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ov72jxs',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117500036',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'polestar',
     'make_model': 'polestar 2 fastback',
     'model': '2 fastback',
     'odometer': 11124,
     'odometer_in_km': 17902,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-09',
     'sanitized_make': 'polestar',
     'seller_name': 'zenith',
     'title': 'polestar 2 fastback 170kw 78kwh long range sm [plus] 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '170kw 78kwh long range sm [plus] 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 02cb01c1-f47e-512b-b37b-2a3a5492d63f spider: astonbarclay.gb
2025-12-02 19:09:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 02cb01c1-f47e-512b-b37b-2a3a5492d63f due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'polestar 2 fastback 170kw 78kwh long range sm [plus] 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'polestar', 'model': '2 fastback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 11124, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117500036', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '170kw 78kwh long range sm [plus] 5dr auto', 'license_plate': 'ov72jxs', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '02cb01c1-f47e-512b-b37b-2a3a5492d63f', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'polestar 2 fastback', 'sanitized_make': 'polestar', 'odometer_in_km': 17902}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '02cb01c1-f47e-512b-b37b-2a3a5492d63f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ov72jxs',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117500036',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'polestar',
     'make_model': 'polestar 2 fastback',
     'model': '2 fastback',
     'odometer': 11124,
     'odometer_in_km': 17902,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-09',
     'sanitized_make': 'polestar',
     'seller_name': 'zenith',
     'title': 'polestar 2 fastback 170kw 78kwh long range sm [plus] 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '170kw 78kwh long range sm [plus] 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '02cb01c1-f47e-512b-b37b-2a3a5492d63f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OV72JXS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117500036',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'POLESTAR',
 'model': '2 FASTBACK',
 'odometer': 11124,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-09',
 'seller_name': 'Zenith',
 'title': 'POLESTAR 2 FASTBACK 170kW 78kWh Long Range SM [Plus] 5dr Auto',
 'transmission': 'automatic',
 'trim': '170kW 78kWh Long Range SM [Plus] 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117500036%27 HTTP/1.1" 200 None
2025-12-02 19:09:42 [astonbarclay.gb] INFO: Saving data for 117500036: {'created_time': 1764356725.995197, 'last_price_update_time': 1764702582.798729, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117500036') HTTP/1.1" 204 0
2025-12-02 19:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ee8396a5-05f0-566e-9040-9b53713e7fc8 with identifier: 117362156
2025-12-02 19:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ee8396a5-05f0-566e-9040-9b53713e7fc8 with identifier: 117362156
2025-12-02 19:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ee8396a5-05f0-566e-9040-9b53713e7fc8 with identifier: 117362156 to the API
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117362156?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'ee8396a5-05f0-566e-9040-9b53713e7fc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BK72NZE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117362156',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'TESLA',
 'model': 'MODEL Y HATCHBACK',
 'odometer': 46000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-24',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL Y HATCHBACK Long Range AWD 5dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362156%27 HTTP/1.1" 200 None
2025-12-02 19:09:43 [astonbarclay.gb] INFO: Saving data for 117362156: {'auction_closing_time': 1764842400.0, 'created_time': 1764184414.370591, 'last_price_update_time': 1764702583.086432}
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117362156') HTTP/1.1" 204 0
2025-12-02 19:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1906c35c-7933-4f06-8225-f2060dcabff8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117391120?view=catalogue)
2025-12-02 19:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL72EKK/2025-11-26/image/a7b7e45d-12c8-4565-b7f2-24bade4796d6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117493253?view=catalogue)
2025-12-02 19:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL72EKK/2025-11-26/image/b2ff75ad-2fab-48f3-b91a-4b49e3409a49_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117493253?view=catalogue)
2025-12-02 19:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72KHG/2025-12-01/image/a4893da9-d8bf-437c-a85a-49e811591ced_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117314112?view=catalogue)
2025-12-02 19:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL72EKK/2025-11-26/image/edfaea43-0801-4ebe-b44b-8fc43aee7223_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117493253?view=catalogue)
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252F60073b38-2b27-4da6-ac0b-5dce94444666_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/60073b38-2b27-4da6-ac0b-5dce94444666_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MD23FRK/2025-11-28/image/953ccccf-d481-4a94-bc52-b95dc78ec5f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117391120?view=catalogue)
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252Fccdc7d7b-3840-413d-ab91-dd170113559f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/ccdc7d7b-3840-413d-ab91-dd170113559f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252Fad4add40-0f6c-46e1-b224-7f7f5ff2344b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/ad4add40-0f6c-46e1-b224-7f7f5ff2344b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117056499?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117157384?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116016591?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a7cbd0>
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_10.jpg HTTP/1.1" 201 0
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO23HJC%252F2025-11-27%252Fimage%252F324b4748-8fa0-4ea3-b911-3532b0b36775_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO23HJC/2025-11-27/image/324b4748-8fa0-4ea3-b911-3532b0b36775_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c7eab6d9-576f-5766-bd9e-d4750768a692
2025-12-02 19:09:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7eab6d9-576f-5766-bd9e-d4750768a692, skipping ID generation
2025-12-02 19:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7eab6d9-576f-5766-bd9e-d4750768a692 with scrape type 1
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c7eab6d9-576f-5766-bd9e-d4750768a692 from tracking dictionaries
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7eab6d9-576f-5766-bd9e-d4750768a692 sending to next pipeline
2025-12-02 19:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c7eab6d9-576f-5766-bd9e-d4750768a692, identifier: 117480129
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf044cb90>
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252F73b19f8e-5164-4163-8fd5-1cc0a91f9bfc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/73b19f8e-5164-4163-8fd5-1cc0a91f9bfc_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06351d0>
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252F362908e4-c29e-4779-91ee-b4dbccc633eb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/362908e4-c29e-4779-91ee-b4dbccc633eb_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 672620e2-54c8-5641-b4ba-54913689dea3
2025-12-02 19:09:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116470730, 'registration': 'CY21KUD', 'account': 'LEA009', 'make': 'SEAT', 'model': 'LEON DIESEL HATCHBACK', 'derivative': '2.0 TDI SE 5dr', 'mileage': 56752, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-06-30', 'fuel': 'Diesel', 'motExpiry': '2026-05-05', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0edfc62-8c7b-4ad9-af76-babaaee19bdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/ba41fd7a-88bc-4f97-8610-7dfce81b7e0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0e48c20-7a41-4ee4-9556-0e618c0abc1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/4307999b-4cbe-4dde-ba6f-c9a73b159edb_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/060ae148-408c-4adf-81fc-eda3bf5c937f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/5c9ab921-a826-448a-965c-fd6f3e6ca4de_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/456e37dd-5695-4b81-a20f-8bb925f21904_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/7319bed4-9b1e-4179-b636-7bfbb6e56ec5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 02/22 24K 02/24 42K 04/25 52K 11/25 56K', 'remarks': 'VOSA STATES 45K 52K 52K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0ce2792-5c6a-4279-bf25-21ff3857536e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116470730, 'registration': 'CY21KUD', 'account': 'LEA009', 'make': 'SEAT', 'model': 'LEON DIESEL HATCHBACK', 'derivative': '2.0 TDI SE 5dr', 'mileage': 56752, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-06-30', 'fuel': 'Diesel', 'motExpiry': '2026-05-05', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0edfc62-8c7b-4ad9-af76-babaaee19bdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/ba41fd7a-88bc-4f97-8610-7dfce81b7e0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0e48c20-7a41-4ee4-9556-0e618c0abc1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/4307999b-4cbe-4dde-ba6f-c9a73b159edb_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/060ae148-408c-4adf-81fc-eda3bf5c937f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/5c9ab921-a826-448a-965c-fd6f3e6ca4de_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/456e37dd-5695-4b81-a20f-8bb925f21904_removebg.jpg?w=600', 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/7319bed4-9b1e-4179-b636-7bfbb6e56ec5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 02/22 24K 02/24 42K 04/25 52K 11/25 56K', 'remarks': 'VOSA STATES 45K 52K 52K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0ce2792-5c6a-4279-bf25-21ff3857536e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba8cd25c-3ed0-5127-9025-ad55d06e9654 with identifier: 116470730
2025-12-02 19:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba8cd25c-3ed0-5127-9025-ad55d06e9654 with scrape type 1
2025-12-02 19:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ba8cd25c-3ed0-5127-9025-ad55d06e9654
2025-12-02 19:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252Ff0edfc62-8c7b-4ad9-af76-babaaee19bdd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0edfc62-8c7b-4ad9-af76-babaaee19bdd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252F5cfbdabb-a60a-45ec-8422-73ffdd01d811_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/5cfbdabb-a60a-45ec-8422-73ffdd01d811_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117344303?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c7eab6d9-576f-5766-bd9e-d4750768a692 with identifier: 117480129
2025-12-02 19:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c7eab6d9-576f-5766-bd9e-d4750768a692 with identifier: 117480129
2025-12-02 19:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c7eab6d9-576f-5766-bd9e-d4750768a692 with identifier: 117480129 to the API
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AO23HJC/2025-11-27/image/324b4748-8fa0-4ea3-b911-3532b0b36775_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c7eab6d9-576f-5766-bd9e-d4750768a692',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AO23HJC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117480129',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 60039,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29623,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/56abef15-5756-48cc-a544-3b627e640ef7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29789,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/650ca303-1fc6-4767-8b51-f97629402dd6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29418,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/cbaec602-46af-4f76-8674-3f91de81046f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28462,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/7235ba67-86d3-445f-8389-c0b60aaa9d21_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55184,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/1a398950-79ed-49d3-ba8e-c5716ddba31a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52612,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/150bcf4b-9d0d-4ee3-ae8c-5a825dea54cf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58692,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/78da6f7d-6f20-4805-bb22-7c66a8ce5d65_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47517,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/dee27912-1308-4a30-8d26-2fd6db54759f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45361,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/05f66d7a-9631-41b8-9347-74a77dc22c01_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47218,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/e3603e60-f43a-4321-9aa7-51a4f7847016_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7eab6d9-576f-5766-bd9e-d4750768a692/c7eab6d9-576f-5766-bd9e-d4750768a692_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55914,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO23HJC/2025-11-27/image/324b4748-8fa0-4ea3-b911-3532b0b36775_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-20',
 'seller_name': 'Zenith',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 118d Sport 5dr Step Auto [Live '
          'Cockpit Pro]',
 'transmission': 'automatic',
 'trim': '118d Sport 5dr Step Auto [Live Cockpit Pro]',
 'vin': None,
 'year': 2023}
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117480129%27 HTTP/1.1" 200 None
2025-12-02 19:09:44 [astonbarclay.gb] INFO: Saving data for 117480129: {'created_time': 1764702584.394697, 'last_price_update_time': 1764702584.39471, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117480129') HTTP/1.1" 204 0
2025-12-02 19:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL72EKK/2025-11-26/image/037b0a1b-8df7-425e-a67c-f95a2e4bebc6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117493253?view=catalogue)
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252F793fc5e7-72aa-4636-9a88-e79c904fa5c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/793fc5e7-72aa-4636-9a88-e79c904fa5c2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F1dd8f6b3-55ba-4ff3-8071-da4a744fa716_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1dd8f6b3-55ba-4ff3-8071-da4a744fa716_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252Fba41fd7a-88bc-4f97-8610-7dfce81b7e0e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/ba41fd7a-88bc-4f97-8610-7dfce81b7e0e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252F64a5689b-b614-490b-a8bd-2ee0d71cb6da_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/64a5689b-b614-490b-a8bd-2ee0d71cb6da_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf032c290>
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F1906c35c-7933-4f06-8225-f2060dcabff8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1906c35c-7933-4f06-8225-f2060dcabff8_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06afe90>
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252Fa7b7e45d-12c8-4565-b7f2-24bade4796d6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/a7b7e45d-12c8-4565-b7f2-24bade4796d6_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f07890>
2025-12-02 19:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252Fb2ff75ad-2fab-48f3-b91a-4b49e3409a49_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/b2ff75ad-2fab-48f3-b91a-4b49e3409a49_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09497d0>
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252Fa4893da9-d8bf-437c-a85a-49e811591ced_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/a4893da9-d8bf-437c-a85a-49e811591ced_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 672620e2-54c8-5641-b4ba-54913689dea3
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05cf650>
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252Fedfaea43-0801-4ebe-b44b-8fc43aee7223_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/edfaea43-0801-4ebe-b44b-8fc43aee7223_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06ad650>
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F953ccccf-d481-4a94-bc52-b95dc78ec5f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/953ccccf-d481-4a94-bc52-b95dc78ec5f1_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7
2025-12-02 19:09:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117056499, 'registration': 'BV22UEW', 'account': 'ZEN009', 'make': 'CUPRA', 'model': 'LEON ESTATE', 'derivative': '1.4 eHybrid VZ2 5dr DSG', 'mileage': 19092, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-05-31', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-05-30', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BV22UEW/2025-11-27/image/53747f76-7f57-41e2-983a-12f2cce55435_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/798d945b-76c6-4e24-9011-0905c3060ca8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/99b0a7c4-f607-4dcb-bbee-dd74c9c4a30a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/2e4affa8-2afb-4861-97e3-cc263780c122_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/787eb532-4f5a-4159-9119-a476974e9ff1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/1bb03fa8-9015-4772-bb08-cb68a50ef7ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/9cb499df-ac6a-4829-86f8-b7781a64c631_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/74e4adbd-2315-4b30-b653-0432ebcba264_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/23 5K 05/24 11K 05/25 16K', 'remarks': 'VOSA STATES 16K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7b6b31b4-3786-45b8-9e73-7bab149cb1f6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117056499, 'registration': 'BV22UEW', 'account': 'ZEN009', 'make': 'CUPRA', 'model': 'LEON ESTATE', 'derivative': '1.4 eHybrid VZ2 5dr DSG', 'mileage': 19092, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-05-31', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-05-30', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BV22UEW/2025-11-27/image/53747f76-7f57-41e2-983a-12f2cce55435_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/798d945b-76c6-4e24-9011-0905c3060ca8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/99b0a7c4-f607-4dcb-bbee-dd74c9c4a30a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/2e4affa8-2afb-4861-97e3-cc263780c122_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/787eb532-4f5a-4159-9119-a476974e9ff1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/1bb03fa8-9015-4772-bb08-cb68a50ef7ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/9cb499df-ac6a-4829-86f8-b7781a64c631_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/74e4adbd-2315-4b30-b653-0432ebcba264_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/23 5K 05/24 11K 05/25 16K', 'remarks': 'VOSA STATES 16K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7b6b31b4-3786-45b8-9e73-7bab149cb1f6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2f948b8-7be4-53e3-8b32-272b3e94e748 with identifier: 117056499
2025-12-02 19:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2f948b8-7be4-53e3-8b32-272b3e94e748 with scrape type 1
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b2f948b8-7be4-53e3-8b32-272b3e94e748
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F53747f76-7f57-41e2-983a-12f2cce55435_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/53747f76-7f57-41e2-983a-12f2cce55435_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117157384, 'registration': 'VN71YFO', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto [C+S/Tech Pack]', 'mileage': 124526, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-01-13', 'fuel': 'Electric', 'motExpiry': '2026-01-12', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN71YFO/2025-11-18/image/850a38e3-c3e9-452c-855c-bceac31157e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/2f62e027-a8f2-4bf7-b6d2-5ee08464c95c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/8bce61dd-07c5-4203-a2d8-2d8eb52a1df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/6e8147c2-0e18-4bba-91ea-7200b6b56f8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/02be7a85-7fc8-4166-bf82-531b60c59f68_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/36a4427b-cf82-4f14-8acb-6d0f89016f9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/49956315-e6a1-41e3-b1bd-e51a88208999_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/8dfa87b7-bd02-4cb5-9df2-375c54b3b2d3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/22-23k, 07/23-49k, 07/24-86k,', 'remarks': 'vosa states 105k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/28ee9578-ed3b-4b85-ad7b-0245a73c8ce7.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117157384, 'registration': 'VN71YFO', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto [C+S/Tech Pack]', 'mileage': 124526, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-01-13', 'fuel': 'Electric', 'motExpiry': '2026-01-12', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN71YFO/2025-11-18/image/850a38e3-c3e9-452c-855c-bceac31157e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/2f62e027-a8f2-4bf7-b6d2-5ee08464c95c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/8bce61dd-07c5-4203-a2d8-2d8eb52a1df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/6e8147c2-0e18-4bba-91ea-7200b6b56f8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/02be7a85-7fc8-4166-bf82-531b60c59f68_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/36a4427b-cf82-4f14-8acb-6d0f89016f9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/49956315-e6a1-41e3-b1bd-e51a88208999_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71YFO/2025-11-18/image/8dfa87b7-bd02-4cb5-9df2-375c54b3b2d3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/22-23k, 07/23-49k, 07/24-86k,', 'remarks': 'vosa states 105k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/28ee9578-ed3b-4b85-ad7b-0245a73c8ce7.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d00b106-0a57-5580-ac06-000dd3987471 with identifier: 117157384
2025-12-02 19:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d00b106-0a57-5580-ac06-000dd3987471 with scrape type 2
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d00b106-0a57-5580-ac06-000dd3987471 with scrape type 2
2025-12-02 19:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6d00b106-0a57-5580-ac06-000dd3987471, identifier: 117157384
2025-12-02 19:09:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116016591, 'registration': 'RV25UVT', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 15966, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RV25UVT/2025-10-02/image/51d107d3-6a0d-40d9-9365-2699eaa52a2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/c68f1d1c-a453-4954-8571-1cb710f193c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/8a865e38-17d4-4bc0-93b8-0e53793b22ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/98b976cc-f091-4330-a10f-8365a4e7d8ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/a737b923-d39e-4b37-beff-e76a6e3633bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/92393a48-768b-45e1-a4c5-b36d7f30e217_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/c87c1800-f2e4-4880-b45c-77f8b944f06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/d90156c8-1374-44c9-8a8c-720593805b99_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/7ac8dd29-0689-44c9-8cb7-29da899a351f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b66a2cb-dfba-4438-92a6-27e3e3d9796f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116016591, 'registration': 'RV25UVT', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 15966, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RV25UVT/2025-10-02/image/51d107d3-6a0d-40d9-9365-2699eaa52a2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/c68f1d1c-a453-4954-8571-1cb710f193c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/8a865e38-17d4-4bc0-93b8-0e53793b22ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/98b976cc-f091-4330-a10f-8365a4e7d8ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/a737b923-d39e-4b37-beff-e76a6e3633bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/92393a48-768b-45e1-a4c5-b36d7f30e217_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/c87c1800-f2e4-4880-b45c-77f8b944f06e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/d90156c8-1374-44c9-8a8c-720593805b99_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV25UVT/2025-10-02/image/7ac8dd29-0689-44c9-8cb7-29da899a351f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b66a2cb-dfba-4438-92a6-27e3e3d9796f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5721406-ef77-5d92-96af-aa9c3f0a041d with identifier: 116016591
2025-12-02 19:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5721406-ef77-5d92-96af-aa9c3f0a041d with scrape type 2
2025-12-02 19:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5721406-ef77-5d92-96af-aa9c3f0a041d with scrape type 2
2025-12-02 19:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b5721406-ef77-5d92-96af-aa9c3f0a041d, identifier: 116016591
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP74FET/2025-11-28/image/d0428881-2191-4ee3-82ad-74a3837360f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492502?view=catalogue)
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5d28f19a-4ccb-48a1-843c-c8f2dbb46961_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117391120?view=catalogue)
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MD23FRK/2025-11-28/image/516025e3-ec1c-43a8-9fec-c3a861aa5af0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117391120?view=catalogue)
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252F2ddabab4-84f5-4295-9298-67e9a43e5dd1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/2ddabab4-84f5-4295-9298-67e9a43e5dd1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F5b94311b-5381-4f7e-95e0-7ef6ba575494_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5b94311b-5381-4f7e-95e0-7ef6ba575494_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252Ff0e48c20-7a41-4ee4-9556-0e618c0abc1a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0e48c20-7a41-4ee4-9556-0e618c0abc1a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6d00b106-0a57-5580-ac06-000dd3987471 with identifier: 117157384
2025-12-02 19:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6d00b106-0a57-5580-ac06-000dd3987471 with identifier: 117157384
2025-12-02 19:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s/tech pack]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 124526, 'odometer_reading_unit': 'mi', 'registration_date': '2022-01-13', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117157384', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto [c+s/tech pack]', 'license_plate': 'vn71yfo', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '6d00b106-0a57-5580-ac06-000dd3987471', 'current_year_diff': 3, 'age_in_months': 46, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 200404}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 46,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '6d00b106-0a57-5580-ac06-000dd3987471',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vn71yfo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117157384',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 124526,
     'odometer_in_km': 200404,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-01-13',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto '
              '[c+s/tech pack]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto [c+s/tech pack]',
     'vin': None,
     'year': 2022}
2025-12-02 19:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 6d00b106-0a57-5580-ac06-000dd3987471 spider: astonbarclay.gb
2025-12-02 19:09:46 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6d00b106-0a57-5580-ac06-000dd3987471 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s/tech pack]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 124526, 'odometer_reading_unit': 'mi', 'registration_date': '2022-01-13', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117157384', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto [c+s/tech pack]', 'license_plate': 'vn71yfo', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '6d00b106-0a57-5580-ac06-000dd3987471', 'current_year_diff': 3, 'age_in_months': 46, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 200404}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 46,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '6d00b106-0a57-5580-ac06-000dd3987471',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vn71yfo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117157384',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 124526,
     'odometer_in_km': 200404,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-01-13',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto '
              '[c+s/tech pack]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto [c+s/tech pack]',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '6d00b106-0a57-5580-ac06-000dd3987471',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VN71YFO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117157384',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'AUDI',
 'model': 'Q4 E-TRON ESTATE',
 'odometer': 124526,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seller_name': 'Zenith',
 'title': 'AUDI Q4 E-TRON ESTATE 150kW 40 82kWh S Line 5dr Auto [C+S/Tech '
          'Pack]',
 'transmission': 'automatic',
 'trim': '150kW 40 82kWh S Line 5dr Auto [C+S/Tech Pack]',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117157384%27 HTTP/1.1" 200 None
2025-12-02 19:09:46 [astonbarclay.gb] INFO: Saving data for 117157384: {'auction_closing_time': 1764842400.0, 'created_time': 1764097397.12889, 'last_price_update_time': 1764702586.282733}
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117157384') HTTP/1.1" 204 0
2025-12-02 19:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b5721406-ef77-5d92-96af-aa9c3f0a041d with identifier: 116016591
2025-12-02 19:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b5721406-ef77-5d92-96af-aa9c3f0a041d with identifier: 116016591
2025-12-02 19:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b5721406-ef77-5d92-96af-aa9c3f0a041d with identifier: 116016591 to the API
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116016591?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'b5721406-ef77-5d92-96af-aa9c3f0a041d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RV25UVT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116016591',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 15966,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-27',
 'seller_name': 'Liquid Fleet',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi 207 HEV 3 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6T GDi 207 HEV 3 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116016591%27 HTTP/1.1" 200 None
2025-12-02 19:09:46 [astonbarclay.gb] INFO: Saving data for 116016591: {'auction_closing_time': 1764842400.0, 'created_time': 1759863781.188372, 'last_price_update_time': 1764702586.59368}
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116016591') HTTP/1.1" 204 0
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72KHG/2025-12-01/image/7ab87f0f-fe68-4abf-8bb5-5861c121cc41_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117314112?view=catalogue)
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f17f3557-a156-4075-8d00-e8d89047fdce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117493253?view=catalogue)
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72KHG/2025-12-01/image/9c779bad-c126-4dfb-ad32-a0ea9a1dc212_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117314112?view=catalogue)
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP74FET/2025-11-28/image/60073b38-2b27-4da6-ac0b-5dce94444666_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492502?view=catalogue)
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72KHG/2025-12-01/image/d4109bd3-503c-4ee3-a6d7-c34c54c1123d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117314112?view=catalogue)
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252Ff6823592-2a9b-4c06-90ee-3c867cc05171_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/f6823592-2a9b-4c06-90ee-3c867cc05171_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F798d945b-76c6-4e24-9011-0905c3060ca8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/798d945b-76c6-4e24-9011-0905c3060ca8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117344303, 'registration': 'BK71TVV', 'account': 'ZEN009', 'make': 'CUPRA', 'model': 'LEON HATCHBACK', 'derivative': '1.4 eHybrid VZ2 5dr DSG', 'mileage': 27081, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-29', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-28', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK71TVV/2025-11-26/image/edf55e92-031c-4649-a2c1-eeef2acc6454_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/9dac6586-372b-4670-b544-e12ecdc10afd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/bde58298-e803-4f60-99e5-3fb1019af0f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/58c9f928-c1e0-4bdf-b2d4-f0c4b9d02400_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/c31c11ef-1609-4502-baae-c6de0deee6c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/c32a5ff4-6c5c-4804-b6db-3a89670c3820_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/53065489-2b9c-4de3-a7e5-37e17d148460_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/5af22438-0d7d-469c-9d18-29fe83f73803_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 20K 27K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 30, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5ae98148-8942-425e-a909-5302a73be10d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117344303, 'registration': 'BK71TVV', 'account': 'ZEN009', 'make': 'CUPRA', 'model': 'LEON HATCHBACK', 'derivative': '1.4 eHybrid VZ2 5dr DSG', 'mileage': 27081, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-29', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-28', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK71TVV/2025-11-26/image/edf55e92-031c-4649-a2c1-eeef2acc6454_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/9dac6586-372b-4670-b544-e12ecdc10afd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/bde58298-e803-4f60-99e5-3fb1019af0f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/58c9f928-c1e0-4bdf-b2d4-f0c4b9d02400_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/c31c11ef-1609-4502-baae-c6de0deee6c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/c32a5ff4-6c5c-4804-b6db-3a89670c3820_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/53065489-2b9c-4de3-a7e5-37e17d148460_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71TVV/2025-11-26/image/5af22438-0d7d-469c-9d18-29fe83f73803_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 20K 27K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 30, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5ae98148-8942-425e-a909-5302a73be10d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83fe41c9-0f5b-58f8-8725-f3ff246bf7ac with identifier: 117344303
2025-12-02 19:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83fe41c9-0f5b-58f8-8725-f3ff246bf7ac with scrape type 2
2025-12-02 19:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83fe41c9-0f5b-58f8-8725-f3ff246bf7ac with scrape type 2
2025-12-02 19:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 83fe41c9-0f5b-58f8-8725-f3ff246bf7ac, identifier: 117344303
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252Ff69050e6-7269-42c0-ab30-d42afa6af0b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/f69050e6-7269-42c0-ab30-d42afa6af0b0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252F4307999b-4cbe-4dde-ba6f-c9a73b159edb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/4307999b-4cbe-4dde-ba6f-c9a73b159edb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117431475?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115997019?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117457493?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117121049?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 83fe41c9-0f5b-58f8-8725-f3ff246bf7ac with identifier: 117344303
2025-12-02 19:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 83fe41c9-0f5b-58f8-8725-f3ff246bf7ac with identifier: 117344303
2025-12-02 19:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 83fe41c9-0f5b-58f8-8725-f3ff246bf7ac with identifier: 117344303 to the API
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117344303?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '83fe41c9-0f5b-58f8-8725-f3ff246bf7ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BK71TVV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117344303',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'CUPRA',
 'model': 'LEON HATCHBACK',
 'odometer': 27081,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': 'Zenith',
 'title': 'CUPRA LEON HATCHBACK 1.4 eHybrid VZ2 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 eHybrid VZ2 5dr DSG',
 'vin': None,
 'year': 2021}
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117344303%27 HTTP/1.1" 200 None
2025-12-02 19:09:47 [astonbarclay.gb] INFO: Saving data for 117344303: {'auction_closing_time': 1764842400.0, 'created_time': 1764184436.852904, 'last_price_update_time': 1764702587.097504}
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117344303') HTTP/1.1" 204 0
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252F00ab0ce0-5778-4598-b557-bceaa49bb6c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/00ab0ce0-5778-4598-b557-bceaa49bb6c2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F99b0a7c4-f607-4dcb-bbee-dd74c9c4a30a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/99b0a7c4-f607-4dcb-bbee-dd74c9c4a30a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0edfc62-8c7b-4ad9-af76-babaaee19bdd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116470730?view=catalogue)
2025-12-02 19:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MD23FRK/2025-11-28/image/ad4add40-0f6c-46e1-b224-7f7f5ff2344b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117391120?view=catalogue)
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252F060ae148-408c-4adf-81fc-eda3bf5c937f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/060ae148-408c-4adf-81fc-eda3bf5c937f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf080d2d0>
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252F037b0a1b-8df7-425e-a67c-f95a2e4bebc6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/037b0a1b-8df7-425e-a67c-f95a2e4bebc6_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03100d0>
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252Fd0428881-2191-4ee3-82ad-74a3837360f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/d0428881-2191-4ee3-82ad-74a3837360f9_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce1ab312-4e4f-5472-af61-365a2e332333
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d96e10>
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F5d28f19a-4ccb-48a1-843c-c8f2dbb46961_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5d28f19a-4ccb-48a1-843c-c8f2dbb46961_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf031a110>
2025-12-02 19:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F516025e3-ec1c-43a8-9fec-c3a861aa5af0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/516025e3-ec1c-43a8-9fec-c3a861aa5af0_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098a250>
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252F7ab87f0f-fe68-4abf-8bb5-5861c121cc41_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/7ab87f0f-fe68-4abf-8bb5-5861c121cc41_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 672620e2-54c8-5641-b4ba-54913689dea3
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07b4990>
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL72EKK%252F2025-11-26%252Fimage%252Ff17f3557-a156-4075-8d00-e8d89047fdce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f17f3557-a156-4075-8d00-e8d89047fdce_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be
2025-12-02 19:09:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22fac505-0cb4-52ec-8f8d-4c4b922b32be, skipping ID generation
2025-12-02 19:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be with scrape type 1
2025-12-02 19:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 22fac505-0cb4-52ec-8f8d-4c4b922b32be from tracking dictionaries
2025-12-02 19:09:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22fac505-0cb4-52ec-8f8d-4c4b922b32be sending to next pipeline
2025-12-02 19:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 22fac505-0cb4-52ec-8f8d-4c4b922b32be, identifier: 117493253
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0997a10>
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252F9c779bad-c126-4dfb-ad32-a0ea9a1dc212_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/9c779bad-c126-4dfb-ad32-a0ea9a1dc212_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 672620e2-54c8-5641-b4ba-54913689dea3
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf086f450>
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252F60073b38-2b27-4da6-ac0b-5dce94444666_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/60073b38-2b27-4da6-ac0b-5dce94444666_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce1ab312-4e4f-5472-af61-365a2e332333
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf081c850>
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252Fd4109bd3-503c-4ee3-a6d7-c34c54c1123d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/d4109bd3-503c-4ee3-a6d7-c34c54c1123d_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 672620e2-54c8-5641-b4ba-54913689dea3
2025-12-02 19:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV22UEW/2025-11-27/image/53747f76-7f57-41e2-983a-12f2cce55435_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056499?view=catalogue)
2025-12-02 19:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CY21KUD/2025-11-28/image/ba41fd7a-88bc-4f97-8610-7dfce81b7e0e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116470730?view=catalogue)
2025-12-02 19:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1dd8f6b3-55ba-4ff3-8071-da4a744fa716_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117391120?view=catalogue)
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252F3a4d941d-b107-4f98-b589-c07a99ca030d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/3a4d941d-b107-4f98-b589-c07a99ca030d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F2e4affa8-2afb-4861-97e3-cc263780c122_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/2e4affa8-2afb-4861-97e3-cc263780c122_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 22fac505-0cb4-52ec-8f8d-4c4b922b32be with identifier: 117493253
2025-12-02 19:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 22fac505-0cb4-52ec-8f8d-4c4b922b32be with identifier: 117493253
2025-12-02 19:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 22fac505-0cb4-52ec-8f8d-4c4b922b32be with identifier: 117493253 to the API
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f17f3557-a156-4075-8d00-e8d89047fdce_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '22fac505-0cb4-52ec-8f8d-4c4b922b32be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BL72EKK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117493253',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLVO',
 'model': 'XC60 ESTATE',
 'odometer': 39743,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25316,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/4e7c8df4-f248-44c7-9e9d-0f27f1f887ea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26764,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f54904fa-ba57-46d2-91be-d67a5d3012ea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28318,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/73b19f8e-5164-4163-8fd5-1cc0a91f9bfc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25500,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/a7b7e45d-12c8-4565-b7f2-24bade4796d6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40792,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/edfaea43-0801-4ebe-b44b-8fc43aee7223_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44271,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/b2ff75ad-2fab-48f3-b91a-4b49e3409a49_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47261,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/037b0a1b-8df7-425e-a67c-f95a2e4bebc6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22fac505-0cb4-52ec-8f8d-4c4b922b32be/22fac505-0cb4-52ec-8f8d-4c4b922b32be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45037,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL72EKK/2025-11-26/image/f17f3557-a156-4075-8d00-e8d89047fdce_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-16',
 'seller_name': 'Zenith',
 'title': 'VOLVO XC60 ESTATE 2.0 B5P Core 5dr AWD Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 B5P Core 5dr AWD Geartronic',
 'vin': None,
 'year': 2023}
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117493253%27 HTTP/1.1" 200 None
2025-12-02 19:09:50 [astonbarclay.gb] INFO: Saving data for 117493253: {'created_time': 1764702590.093204, 'last_price_update_time': 1764702590.093215, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117493253') HTTP/1.1" 204 0
2025-12-02 19:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP74FET/2025-11-28/image/64a5689b-b614-490b-a8bd-2ee0d71cb6da_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492502?view=catalogue)
2025-12-02 19:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72KHG/2025-12-01/image/793fc5e7-72aa-4636-9a88-e79c904fa5c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117314112?view=catalogue)
2025-12-02 19:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP74FET/2025-11-28/image/5cfbdabb-a60a-45ec-8422-73ffdd01d811_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492502?view=catalogue)
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252F5c9ab921-a826-448a-965c-fd6f3e6ca4de_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/5c9ab921-a826-448a-965c-fd6f3e6ca4de_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117431475, 'registration': 'FH22LND', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [136] M Sport 5dr Step Auto [LCP]', 'mileage': 84822, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-08-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-10', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FH22LND/2025-11-24/image/d0f85c07-7fb9-4967-ad2c-ac4199c83f9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/30547ce1-f7eb-4c9d-8815-1d9256a7f564_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/91d06a5a-5dc0-4f11-b49b-a4bc720fd077_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/267cd7b0-dc19-419c-894b-bc5f810ada2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/01bbbda6-6c44-4b2f-8eb6-73bb228e74f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/e77bf140-c44a-4fd9-b329-b4f3e1df8fb8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/b3c51308-fa63-44d2-9dcb-85c7729ee4a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/0ef82f22-6274-45fb-b5da-daac72a1e4f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/bead9f72-a414-4f2b-8816-8b5e15485386_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/203ea4af-6787-408a-a540-f05c2f898cab_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/ed081557-b409-407d-8fb5-883ed1ab2ab3_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 05/23-16k, 06/23-19k, 09/23-31k, 11/23-37k, 02/24-46k, 12/24-73k, 01/25-75k,', 'remarks': 'vosa states 80k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a2386a89-0529-4cfd-9388-cd64f93801cd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117431475, 'registration': 'FH22LND', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [136] M Sport 5dr Step Auto [LCP]', 'mileage': 84822, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-08-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-10', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FH22LND/2025-11-24/image/d0f85c07-7fb9-4967-ad2c-ac4199c83f9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/30547ce1-f7eb-4c9d-8815-1d9256a7f564_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/91d06a5a-5dc0-4f11-b49b-a4bc720fd077_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/267cd7b0-dc19-419c-894b-bc5f810ada2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/01bbbda6-6c44-4b2f-8eb6-73bb228e74f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/e77bf140-c44a-4fd9-b329-b4f3e1df8fb8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/b3c51308-fa63-44d2-9dcb-85c7729ee4a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/0ef82f22-6274-45fb-b5da-daac72a1e4f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/bead9f72-a414-4f2b-8816-8b5e15485386_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/203ea4af-6787-408a-a540-f05c2f898cab_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22LND/2025-11-24/image/ed081557-b409-407d-8fb5-883ed1ab2ab3_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 05/23-16k, 06/23-19k, 09/23-31k, 11/23-37k, 02/24-46k, 12/24-73k, 01/25-75k,', 'remarks': 'vosa states 80k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a2386a89-0529-4cfd-9388-cd64f93801cd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78fefd6f-1977-5f30-9f64-8fef2ed6c2c5 with identifier: 117431475
2025-12-02 19:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78fefd6f-1977-5f30-9f64-8fef2ed6c2c5 with scrape type 2
2025-12-02 19:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78fefd6f-1977-5f30-9f64-8fef2ed6c2c5 with scrape type 2
2025-12-02 19:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 78fefd6f-1977-5f30-9f64-8fef2ed6c2c5, identifier: 117431475
2025-12-02 19:09:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 115997019, 'registration': 'DV74NXU', 'account': 'LIQ001', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.0 [63] Advance 5dr Auto [Nav]', 'mileage': 17951, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV74NXU/2025-11-27/image/19fd1cb2-9e77-4be4-a653-1e47ca1212da_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/ffcdaafb-cc11-46d9-b4f5-361af0fca428_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/c92cf0d4-9667-45ac-b8c3-85c37f0c9cf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/7c18f191-2872-481a-8e65-6f01206c7209_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/ba4398ca-568b-4267-82a6-7e1e16aa5868_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/8f1fa20c-a411-4af4-a27e-42b2d18bec71_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/f7351af6-3a0f-4903-9c6c-ff7a9a6c049b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/84648c76-07e7-4dee-99f7-507c7112a80d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital 06/25-10k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b98d7179-7ffd-4dc1-b9be-cad22f470b08.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 115997019, 'registration': 'DV74NXU', 'account': 'LIQ001', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.0 [63] Advance 5dr Auto [Nav]', 'mileage': 17951, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV74NXU/2025-11-27/image/19fd1cb2-9e77-4be4-a653-1e47ca1212da_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/ffcdaafb-cc11-46d9-b4f5-361af0fca428_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/c92cf0d4-9667-45ac-b8c3-85c37f0c9cf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/7c18f191-2872-481a-8e65-6f01206c7209_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/ba4398ca-568b-4267-82a6-7e1e16aa5868_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/8f1fa20c-a411-4af4-a27e-42b2d18bec71_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/f7351af6-3a0f-4903-9c6c-ff7a9a6c049b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV74NXU/2025-11-27/image/84648c76-07e7-4dee-99f7-507c7112a80d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital 06/25-10k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b98d7179-7ffd-4dc1-b9be-cad22f470b08.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e2eac4f-ac05-534a-9d7c-6021bf62e9a1 with identifier: 115997019
2025-12-02 19:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2eac4f-ac05-534a-9d7c-6021bf62e9a1 with scrape type 2
2025-12-02 19:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e2eac4f-ac05-534a-9d7c-6021bf62e9a1 with scrape type 2
2025-12-02 19:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4e2eac4f-ac05-534a-9d7c-6021bf62e9a1, identifier: 115997019
2025-12-02 19:09:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117457493, 'registration': 'GX74KUK', 'account': 'LIQ001', 'make': 'BMW', 'model': '3 SERIES DIESEL SALOON', 'derivative': '320d MHT M Sport 4dr Step Auto', 'mileage': 13354, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 4, 'engineSize': 1995, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GX74KUK/2025-11-27/image/3a4212c0-f83f-46b2-bea0-8397c572bc97_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/9249982d-3200-4f48-ac7a-52b427f6030e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/18400653-c4f5-4cfa-8f76-d11ff9da2cfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/79d5bd72-f195-4382-9973-fc479e09cd9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/d82b4210-727a-4d1d-8527-4c3c8bcf09fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/61cd8128-5365-4bb1-a2e4-051ff7176161_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/f6d6fa5a-0291-4eae-90a3-21be3c4f9b61_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/05e83308-ab90-4629-ba19-140c690b69b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/0617a17f-b53e-4ee8-b4f6-44726694b61a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/25-11k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a14e9db1-3bf5-45f9-b0ef-d759e5daff06.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117457493, 'registration': 'GX74KUK', 'account': 'LIQ001', 'make': 'BMW', 'model': '3 SERIES DIESEL SALOON', 'derivative': '320d MHT M Sport 4dr Step Auto', 'mileage': 13354, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 4, 'engineSize': 1995, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GX74KUK/2025-11-27/image/3a4212c0-f83f-46b2-bea0-8397c572bc97_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/9249982d-3200-4f48-ac7a-52b427f6030e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/18400653-c4f5-4cfa-8f76-d11ff9da2cfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/79d5bd72-f195-4382-9973-fc479e09cd9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/d82b4210-727a-4d1d-8527-4c3c8bcf09fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/61cd8128-5365-4bb1-a2e4-051ff7176161_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/f6d6fa5a-0291-4eae-90a3-21be3c4f9b61_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/05e83308-ab90-4629-ba19-140c690b69b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/0617a17f-b53e-4ee8-b4f6-44726694b61a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/25-11k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a14e9db1-3bf5-45f9-b0ef-d759e5daff06.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a19554b-bcb7-5bc2-8a06-afa0bc3df866 with identifier: 117457493
2025-12-02 19:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866 with scrape type 1
2025-12-02 19:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F3a4212c0-f83f-46b2-bea0-8397c572bc97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/3a4212c0-f83f-46b2-bea0-8397c572bc97_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117121049, 'registration': 'SF22FNE', 'account': 'GAP001', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '40 TFSI e Sport 5dr S Tronic', 'mileage': 51156, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-04-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-05-08', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SF22FNE/2025-11-18/image/9da496be-f5e7-4600-a862-f07bf25cb6d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/abb16437-7f6e-4ae2-8420-7df80d7d2d4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/2f97140c-359f-4deb-bee9-47698542df4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/777431d2-f9be-4da3-a3e3-8ad73f4ebcc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/c91bfa98-bc01-4734-bc51-f38e94b6d04b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/09a4b1a9-aa83-4246-a49a-f7a8735ca544_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/43e3e775-9c57-4cdf-9578-8a4e6cbccccd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/31124d76-9707-4dba-ad3c-6dad918227c6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 05/24-33k, 05/25-40k,', 'remarks': '*V5 doc ref number*', 'virtual': False, 'seller': 'SIXT Van & Truck', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 26, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1f71a517-9b6b-4196-bf4e-dbafd34dd3c0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117121049, 'registration': 'SF22FNE', 'account': 'GAP001', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '40 TFSI e Sport 5dr S Tronic', 'mileage': 51156, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-04-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-05-08', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SF22FNE/2025-11-18/image/9da496be-f5e7-4600-a862-f07bf25cb6d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/abb16437-7f6e-4ae2-8420-7df80d7d2d4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/2f97140c-359f-4deb-bee9-47698542df4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/777431d2-f9be-4da3-a3e3-8ad73f4ebcc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/c91bfa98-bc01-4734-bc51-f38e94b6d04b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/09a4b1a9-aa83-4246-a49a-f7a8735ca544_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/43e3e775-9c57-4cdf-9578-8a4e6cbccccd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SF22FNE/2025-11-18/image/31124d76-9707-4dba-ad3c-6dad918227c6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 05/24-33k, 05/25-40k,', 'remarks': '*V5 doc ref number*', 'virtual': False, 'seller': 'SIXT Van & Truck', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 26, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1f71a517-9b6b-4196-bf4e-dbafd34dd3c0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 992969e5-a2fa-5f9c-a173-398dd327c300 with identifier: 117121049
2025-12-02 19:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 992969e5-a2fa-5f9c-a173-398dd327c300 with scrape type 2
2025-12-02 19:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 992969e5-a2fa-5f9c-a173-398dd327c300 with scrape type 2
2025-12-02 19:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 992969e5-a2fa-5f9c-a173-398dd327c300, identifier: 117121049
2025-12-02 19:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72KHG/2025-12-01/image/ccdc7d7b-3840-413d-ab91-dd170113559f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117314112?view=catalogue)
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252Fda42a56f-68a3-4aa3-b46e-cc18ba30b6c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/da42a56f-68a3-4aa3-b46e-cc18ba30b6c3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F787eb532-4f5a-4159-9119-a476974e9ff1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/787eb532-4f5a-4159-9119-a476974e9ff1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116496702?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 78fefd6f-1977-5f30-9f64-8fef2ed6c2c5 with identifier: 117431475
2025-12-02 19:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 78fefd6f-1977-5f30-9f64-8fef2ed6c2c5 with identifier: 117431475
2025-12-02 19:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 78fefd6f-1977-5f30-9f64-8fef2ed6c2c5 with identifier: 117431475 to the API
2025-12-02 19:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117431475?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '78fefd6f-1977-5f30-9f64-8fef2ed6c2c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FH22LND',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117431475',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 84822,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-31',
 'seller_name': 'Zenith',
 'title': 'BMW 1 SERIES HATCHBACK 118i [136] M Sport 5dr Step Auto [LCP]',
 'transmission': 'automatic',
 'trim': '118i [136] M Sport 5dr Step Auto [LCP]',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117431475%27 HTTP/1.1" 200 None
2025-12-02 19:09:51 [astonbarclay.gb] INFO: Saving data for 117431475: {'auction_closing_time': 1764842400.0, 'created_time': 1764097313.250854, 'last_price_update_time': 1764702591.320042}
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117431475') HTTP/1.1" 204 0
2025-12-02 19:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4e2eac4f-ac05-534a-9d7c-6021bf62e9a1 with identifier: 115997019
2025-12-02 19:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4e2eac4f-ac05-534a-9d7c-6021bf62e9a1 with identifier: 115997019
2025-12-02 19:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4e2eac4f-ac05-534a-9d7c-6021bf62e9a1 with identifier: 115997019 to the API
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115997019?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4e2eac4f-ac05-534a-9d7c-6021bf62e9a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV74NXU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115997019',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'HYUNDAI',
 'model': 'I10 HATCHBACK',
 'odometer': 17951,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-30',
 'seller_name': 'Liquid Fleet',
 'title': 'HYUNDAI I10 HATCHBACK 1.0 [63] Advance 5dr Auto [Nav]',
 'transmission': 'automatic',
 'trim': '1.0 [63] Advance 5dr Auto [Nav]',
 'vin': None,
 'year': 2024}
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115997019%27 HTTP/1.1" 200 None
2025-12-02 19:09:51 [astonbarclay.gb] INFO: Saving data for 115997019: {'auction_closing_time': 1764842400.0, 'created_time': 1760469051.202992, 'last_price_update_time': 1764702591.646416}
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115997019') HTTP/1.1" 204 0
2025-12-02 19:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 992969e5-a2fa-5f9c-a173-398dd327c300 with identifier: 117121049
2025-12-02 19:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 992969e5-a2fa-5f9c-a173-398dd327c300 with identifier: 117121049
2025-12-02 19:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 992969e5-a2fa-5f9c-a173-398dd327c300 with identifier: 117121049 to the API
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27992969e5-a2fa-5f9c-a173-398dd327c300%27 HTTP/1.1" 200 None
2025-12-02 19:09:51 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 992969e5-a2fa-5f9c-a173-398dd327c300: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:09:51 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117121049?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 26,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '992969e5-a2fa-5f9c-a173-398dd327c300',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SF22FNE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117121049',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 51156,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seller_name': 'SIXT Van & Truck',
 'title': 'AUDI A3 SPORTBACK 40 TFSI e Sport 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '40 TFSI e Sport 5dr S Tronic',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121049%27 HTTP/1.1" 200 None
2025-12-02 19:09:51 [astonbarclay.gb] INFO: Saving data for 117121049: {'auction_closing_time': 1764842400.0, 'created_time': 1763406219.593756, 'last_price_update_time': 1764702591.930824}
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117121049') HTTP/1.1" 204 0
2025-12-02 19:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf067e910>
2025-12-02 19:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252Ff0edfc62-8c7b-4ad9-af76-babaaee19bdd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0edfc62-8c7b-4ad9-af76-babaaee19bdd_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba8cd25c-3ed0-5127-9025-ad55d06e9654
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf054a390>
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252Fad4add40-0f6c-46e1-b224-7f7f5ff2344b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/ad4add40-0f6c-46e1-b224-7f7f5ff2344b_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7
2025-12-02 19:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MD23FRK/2025-11-28/image/f69050e6-7269-42c0-ab30-d42afa6af0b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117391120?view=catalogue)
2025-12-02 19:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CY21KUD/2025-11-28/image/4307999b-4cbe-4dde-ba6f-c9a73b159edb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116470730?view=catalogue)
2025-12-02 19:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV22UEW/2025-11-27/image/798d945b-76c6-4e24-9011-0905c3060ca8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056499?view=catalogue)
2025-12-02 19:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP74FET/2025-11-28/image/f6823592-2a9b-4c06-90ee-3c867cc05171_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492502?view=catalogue)
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252F456e37dd-5695-4b81-a20f-8bb925f21904_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/456e37dd-5695-4b81-a20f-8bb925f21904_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F9249982d-3200-4f48-ac7a-52b427f6030e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/9249982d-3200-4f48-ac7a-52b427f6030e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5b94311b-5381-4f7e-95e0-7ef6ba575494_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117391120?view=catalogue)
2025-12-02 19:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0e48c20-7a41-4ee4-9556-0e618c0abc1a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116470730?view=catalogue)
2025-12-02 19:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV22UEW/2025-11-27/image/99b0a7c4-f607-4dcb-bbee-dd74c9c4a30a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056499?view=catalogue)
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F1bb03fa8-9015-4772-bb08-cb68a50ef7ef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/1bb03fa8-9015-4772-bb08-cb68a50ef7ef_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0427ed0>
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F53747f76-7f57-41e2-983a-12f2cce55435_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/53747f76-7f57-41e2-983a-12f2cce55435_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2f948b8-7be4-53e3-8b32-272b3e94e748
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf038c610>
2025-12-02 19:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252Fba41fd7a-88bc-4f97-8610-7dfce81b7e0e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/ba41fd7a-88bc-4f97-8610-7dfce81b7e0e_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ba8cd25c-3ed0-5127-9025-ad55d06e9654
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf069f650>
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F1dd8f6b3-55ba-4ff3-8071-da4a744fa716_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1dd8f6b3-55ba-4ff3-8071-da4a744fa716_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf038d690>
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252F64a5689b-b614-490b-a8bd-2ee0d71cb6da_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/64a5689b-b614-490b-a8bd-2ee0d71cb6da_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce1ab312-4e4f-5472-af61-365a2e332333
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1b537d0>
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252F793fc5e7-72aa-4636-9a88-e79c904fa5c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/793fc5e7-72aa-4636-9a88-e79c904fa5c2_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 672620e2-54c8-5641-b4ba-54913689dea3
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0425710>
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252F5cfbdabb-a60a-45ec-8422-73ffdd01d811_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/5cfbdabb-a60a-45ec-8422-73ffdd01d811_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce1ab312-4e4f-5472-af61-365a2e332333
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252F7319bed4-9b1e-4179-b636-7bfbb6e56ec5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/7319bed4-9b1e-4179-b636-7bfbb6e56ec5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F18400653-c4f5-4cfa-8f76-d11ff9da2cfc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/18400653-c4f5-4cfa-8f76-d11ff9da2cfc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117605321?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP74FET/2025-11-28/image/00ab0ce0-5778-4598-b557-bceaa49bb6c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492502?view=catalogue)
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F9cb499df-ac6a-4829-86f8-b7781a64c631_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/9cb499df-ac6a-4829-86f8-b7781a64c631_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf052a790>
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252Fccdc7d7b-3840-413d-ab91-dd170113559f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/ccdc7d7b-3840-413d-ab91-dd170113559f_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 672620e2-54c8-5641-b4ba-54913689dea3
2025-12-02 19:09:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116496702, 'registration': 'VN25ZXV', 'account': 'LIQ001', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 Hybrid 136 GT 5dr e-DSC6', 'mileage': 676, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-07-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/eb294593-6edc-4b32-8961-a6b97bdc8389_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/6240b492-d2fa-46bb-a5af-2cebabc6130a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/3398cc38-7948-478b-a428-87f090ea9a27_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/fc62756b-6a5b-44b9-b205-a89176ec09b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/55414cc6-bcc5-47d5-8ea0-670ae12efe86_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/5ec0c209-db7b-4612-af7f-1381e70cc611_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/0b240c5a-bf6d-4aa0-bb28-92e53d0254fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/1a18063c-0412-457f-a4cd-ac0daad12416_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/c259c8bd-5202-4e48-b1be-dbb62f151400_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa46cc0a-7a3a-44b1-a66f-0779e1eae991.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116496702, 'registration': 'VN25ZXV', 'account': 'LIQ001', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 Hybrid 136 GT 5dr e-DSC6', 'mileage': 676, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-07-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/eb294593-6edc-4b32-8961-a6b97bdc8389_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/6240b492-d2fa-46bb-a5af-2cebabc6130a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/3398cc38-7948-478b-a428-87f090ea9a27_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/fc62756b-6a5b-44b9-b205-a89176ec09b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/55414cc6-bcc5-47d5-8ea0-670ae12efe86_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/5ec0c209-db7b-4612-af7f-1381e70cc611_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/0b240c5a-bf6d-4aa0-bb28-92e53d0254fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/1a18063c-0412-457f-a4cd-ac0daad12416_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/c259c8bd-5202-4e48-b1be-dbb62f151400_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa46cc0a-7a3a-44b1-a66f-0779e1eae991.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with identifier: 116496702
2025-12-02 19:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with scrape type 2
2025-12-02 19:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with scrape type 2
2025-12-02 19:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3595f4f7-74a9-572e-a905-90eb5ce1a5f2, identifier: 116496702
2025-12-02 19:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV22UEW/2025-11-27/image/2e4affa8-2afb-4861-97e3-cc263780c122_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056499?view=catalogue)
2025-12-02 19:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CY21KUD/2025-11-28/image/060ae148-408c-4adf-81fc-eda3bf5c937f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116470730?view=catalogue)
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F79d5bd72-f195-4382-9973-fc479e09cd9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/79d5bd72-f195-4382-9973-fc479e09cd9e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with identifier: 116496702
2025-12-02 19:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with identifier: 116496702
2025-12-02 19:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3595f4f7-74a9-572e-a905-90eb5ce1a5f2 with identifier: 116496702 to the API
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116496702?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3595f4f7-74a9-572e-a905-90eb5ce1a5f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VN25ZXV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116496702',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'PEUGEOT',
 'model': '3008 ESTATE',
 'odometer': 676,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-07-21',
 'seller_name': 'Liquid Fleet',
 'title': 'PEUGEOT 3008 ESTATE 1.2 Hybrid 136 GT 5dr e-DSC6',
 'transmission': 'automatic',
 'trim': '1.2 Hybrid 136 GT 5dr e-DSC6',
 'vin': None,
 'year': 2025}
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116496702%27 HTTP/1.1" 200 None
2025-12-02 19:09:54 [astonbarclay.gb] INFO: Saving data for 116496702: {'auction_closing_time': 1764842400.0, 'created_time': 1761764902.846453, 'last_price_update_time': 1764702594.725233}
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116496702') HTTP/1.1" 204 0
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0692050>
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252Ff69050e6-7269-42c0-ab30-d42afa6af0b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/f69050e6-7269-42c0-ab30-d42afa6af0b0_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf059f9d0>
2025-12-02 19:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252F4307999b-4cbe-4dde-ba6f-c9a73b159edb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/4307999b-4cbe-4dde-ba6f-c9a73b159edb_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ba8cd25c-3ed0-5127-9025-ad55d06e9654
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0425990>
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F798d945b-76c6-4e24-9011-0905c3060ca8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/798d945b-76c6-4e24-9011-0905c3060ca8_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2f948b8-7be4-53e3-8b32-272b3e94e748
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf374c4d0>
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252Ff6823592-2a9b-4c06-90ee-3c867cc05171_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/f6823592-2a9b-4c06-90ee-3c867cc05171_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce1ab312-4e4f-5472-af61-365a2e332333
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf08e4a10>
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMD23FRK%252F2025-11-28%252Fimage%252F5b94311b-5381-4f7e-95e0-7ef6ba575494_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5b94311b-5381-4f7e-95e0-7ef6ba575494_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7
2025-12-02 19:09:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7, skipping ID generation
2025-12-02 19:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7 with scrape type 1
2025-12-02 19:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7 from tracking dictionaries
2025-12-02 19:09:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7 sending to next pipeline
2025-12-02 19:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7, identifier: 117391120
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1cfa5d0>
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252Ff0e48c20-7a41-4ee4-9556-0e618c0abc1a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0e48c20-7a41-4ee4-9556-0e618c0abc1a_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ba8cd25c-3ed0-5127-9025-ad55d06e9654
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0788490>
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F99b0a7c4-f607-4dcb-bbee-dd74c9c4a30a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/99b0a7c4-f607-4dcb-bbee-dd74c9c4a30a_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2f948b8-7be4-53e3-8b32-272b3e94e748
2025-12-02 19:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX74KUK/2025-11-27/image/3a4212c0-f83f-46b2-bea0-8397c572bc97_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457493?view=catalogue)
2025-12-02 19:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CY21KUD/2025-11-28/image/5c9ab921-a826-448a-965c-fd6f3e6ca4de_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116470730?view=catalogue)
2025-12-02 19:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV22UEW/2025-11-27/image/787eb532-4f5a-4159-9119-a476974e9ff1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056499?view=catalogue)
2025-12-02 19:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YF72KHG/2025-12-01/image/2ddabab4-84f5-4295-9298-67e9a43e5dd1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117314112?view=catalogue)
2025-12-02 19:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP74FET/2025-11-28/image/da42a56f-68a3-4aa3-b46e-cc18ba30b6c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492502?view=catalogue)
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F74e4adbd-2315-4b30-b653-0432ebcba264_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/74e4adbd-2315-4b30-b653-0432ebcba264_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7 with identifier: 117391120
2025-12-02 19:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7 with identifier: 117391120
2025-12-02 19:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 429c3b4a-5bc2-5bd0-94b7-b078486b3ce7 with identifier: 117391120 to the API
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5b94311b-5381-4f7e-95e0-7ef6ba575494_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '429c3b4a-5bc2-5bd0-94b7-b078486b3ce7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MD23FRK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117391120',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'TAIGO HATCHBACK',
 'odometer': 19386,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27553,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1906c35c-7933-4f06-8225-f2060dcabff8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29795,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/953ccccf-d481-4a94-bc52-b95dc78ec5f1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27965,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5d28f19a-4ccb-48a1-843c-c8f2dbb46961_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27135,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/516025e3-ec1c-43a8-9fec-c3a861aa5af0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44732,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/ad4add40-0f6c-46e1-b224-7f7f5ff2344b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44621,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/1dd8f6b3-55ba-4ff3-8071-da4a744fa716_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56724,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/5b94311b-5381-4f7e-95e0-7ef6ba575494_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_429c3b4a-5bc2-5bd0-94b7-b078486b3ce7/429c3b4a-5bc2-5bd0-94b7-b078486b3ce7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51066,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MD23FRK/2025-11-28/image/f69050e6-7269-42c0-ab30-d42afa6af0b0_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-31',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN TAIGO HATCHBACK 1.0 TSI 110 R-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI 110 R-Line 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117391120%27 HTTP/1.1" 200 None
2025-12-02 19:09:56 [astonbarclay.gb] INFO: Saving data for 117391120: {'created_time': 1764702596.88029, 'last_price_update_time': 1764702596.880301, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117391120') HTTP/1.1" 204 0
2025-12-02 19:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP74FET/2025-11-28/image/3a4d941d-b107-4f98-b589-c07a99ca030d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492502?view=catalogue)
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252Fd82b4210-727a-4d1d-8527-4c3c8bcf09fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/d82b4210-727a-4d1d-8527-4c3c8bcf09fb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117577591?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116954790?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116655276?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117605321, 'registration': 'DC23CJO', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 25404, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23CJO/2025-12-02/image/5cb9f5fd-258e-448c-8621-be3bc5c9b012_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/2607febc-d736-46ff-bcc9-cc423999ae83_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/cc725061-7620-4b7f-a33f-029bde46cc56_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/48b76a9e-11aa-45a5-9740-c1e34ca28ad6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/3e35b147-3626-4626-81d2-83a95eae6681_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/fdfc4219-7133-4f8d-b1f3-38bce65da532_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/5f6aa27a-4beb-40ce-9c92-57d1994a4354_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/52b748fa-4d97-410e-a3c0-4d9ba3cb1dc8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 02/23 18k', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b117f4f6-b2de-4eab-af7f-f662978d66c7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117605321, 'registration': 'DC23CJO', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 25404, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23CJO/2025-12-02/image/5cb9f5fd-258e-448c-8621-be3bc5c9b012_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/2607febc-d736-46ff-bcc9-cc423999ae83_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/cc725061-7620-4b7f-a33f-029bde46cc56_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/48b76a9e-11aa-45a5-9740-c1e34ca28ad6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/3e35b147-3626-4626-81d2-83a95eae6681_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/fdfc4219-7133-4f8d-b1f3-38bce65da532_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/5f6aa27a-4beb-40ce-9c92-57d1994a4354_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23CJO/2025-12-02/image/52b748fa-4d97-410e-a3c0-4d9ba3cb1dc8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 02/23 18k', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b117f4f6-b2de-4eab-af7f-f662978d66c7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea85f3e0-3c6c-5794-af12-9fcc24722d7c with identifier: 117605321
2025-12-02 19:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea85f3e0-3c6c-5794-af12-9fcc24722d7c with scrape type 2
2025-12-02 19:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea85f3e0-3c6c-5794-af12-9fcc24722d7c with scrape type 2
2025-12-02 19:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ea85f3e0-3c6c-5794-af12-9fcc24722d7c, identifier: 117605321
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06e1e10>
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252F00ab0ce0-5778-4598-b557-bceaa49bb6c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/00ab0ce0-5778-4598-b557-bceaa49bb6c2_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce1ab312-4e4f-5472-af61-365a2e332333
2025-12-02 19:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV22UEW/2025-11-27/image/1bb03fa8-9015-4772-bb08-cb68a50ef7ef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056499?view=catalogue)
2025-12-02 19:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX74KUK/2025-11-27/image/9249982d-3200-4f48-ac7a-52b427f6030e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457493?view=catalogue)
2025-12-02 19:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ea85f3e0-3c6c-5794-af12-9fcc24722d7c with identifier: 117605321
2025-12-02 19:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ea85f3e0-3c6c-5794-af12-9fcc24722d7c with identifier: 117605321
2025-12-02 19:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ea85f3e0-3c6c-5794-af12-9fcc24722d7c with identifier: 117605321 to the API
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ea85f3e0-3c6c-5794-af12-9fcc24722d7c%27 HTTP/1.1" 200 None
2025-12-02 19:09:57 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ea85f3e0-3c6c-5794-af12-9fcc24722d7c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:09:57 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117605321?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ea85f3e0-3c6c-5794-af12-9fcc24722d7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23CJO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117605321',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 25404,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605321%27 HTTP/1.1" 200 None
2025-12-02 19:09:57 [astonbarclay.gb] INFO: Saving data for 117605321: {'auction_closing_time': 1764842400.0, 'created_time': 1764356578.726464, 'last_price_update_time': 1764702597.54773}
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117605321') HTTP/1.1" 204 0
2025-12-02 19:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F61cd8128-5365-4bb1-a2e4-051ff7176161_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/61cd8128-5365-4bb1-a2e4-051ff7176161_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06bab90>
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F2e4affa8-2afb-4861-97e3-cc263780c122_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/2e4affa8-2afb-4861-97e3-cc263780c122_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2f948b8-7be4-53e3-8b32-272b3e94e748
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf202ae50>
2025-12-02 19:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252F060ae148-408c-4adf-81fc-eda3bf5c937f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/060ae148-408c-4adf-81fc-eda3bf5c937f_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ba8cd25c-3ed0-5127-9025-ad55d06e9654
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1215c50>
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F3a4212c0-f83f-46b2-bea0-8397c572bc97_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/3a4212c0-f83f-46b2-bea0-8397c572bc97_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0893890>
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252F5c9ab921-a826-448a-965c-fd6f3e6ca4de_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/5c9ab921-a826-448a-965c-fd6f3e6ca4de_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ba8cd25c-3ed0-5127-9025-ad55d06e9654
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06a2fd0>
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F787eb532-4f5a-4159-9119-a476974e9ff1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/787eb532-4f5a-4159-9119-a476974e9ff1_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2f948b8-7be4-53e3-8b32-272b3e94e748
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03f5cd0>
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYF72KHG%252F2025-12-01%252Fimage%252F2ddabab4-84f5-4295-9298-67e9a43e5dd1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YF72KHG/2025-12-01/image/2ddabab4-84f5-4295-9298-67e9a43e5dd1_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 672620e2-54c8-5641-b4ba-54913689dea3
2025-12-02 19:09:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 672620e2-54c8-5641-b4ba-54913689dea3, skipping ID generation
2025-12-02 19:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 672620e2-54c8-5641-b4ba-54913689dea3 with scrape type 1
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 672620e2-54c8-5641-b4ba-54913689dea3 from tracking dictionaries
2025-12-02 19:09:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 672620e2-54c8-5641-b4ba-54913689dea3 sending to next pipeline
2025-12-02 19:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 672620e2-54c8-5641-b4ba-54913689dea3, identifier: 117314112
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1c8b710>
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252Fda42a56f-68a3-4aa3-b46e-cc18ba30b6c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/da42a56f-68a3-4aa3-b46e-cc18ba30b6c3_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce1ab312-4e4f-5472-af61-365a2e332333
2025-12-02 19:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CY21KUD/2025-11-28/image/7319bed4-9b1e-4179-b636-7bfbb6e56ec5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116470730?view=catalogue)
2025-12-02 19:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX74KUK/2025-11-27/image/18400653-c4f5-4cfa-8f76-d11ff9da2cfc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457493?view=catalogue)
2025-12-02 19:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 672620e2-54c8-5641-b4ba-54913689dea3 with identifier: 117314112
2025-12-02 19:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 672620e2-54c8-5641-b4ba-54913689dea3 with identifier: 117314112
2025-12-02 19:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 672620e2-54c8-5641-b4ba-54913689dea3 with identifier: 117314112 to the API
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YF72KHG/2025-12-01/image/2ddabab4-84f5-4295-9298-67e9a43e5dd1_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '672620e2-54c8-5641-b4ba-54913689dea3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YF72KHG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117314112',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 35029,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30774,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/362908e4-c29e-4779-91ee-b4dbccc633eb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30210,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/a4893da9-d8bf-437c-a85a-49e811591ced_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30434,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/d4109bd3-503c-4ee3-a6d7-c34c54c1123d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30553,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/7ab87f0f-fe68-4abf-8bb5-5861c121cc41_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44686,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/9c779bad-c126-4dfb-ad32-a0ea9a1dc212_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49727,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/ccdc7d7b-3840-413d-ab91-dd170113559f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44016,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/793fc5e7-72aa-4636-9a88-e79c904fa5c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672620e2-54c8-5641-b4ba-54913689dea3/672620e2-54c8-5641-b4ba-54913689dea3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58886,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YF72KHG/2025-12-01/image/2ddabab4-84f5-4295-9298-67e9a43e5dd1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seller_name': 'Zenith',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 Acenta Premium 5dr '
          'Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic',
 'vin': None,
 'year': 2022}
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117314112%27 HTTP/1.1" 200 None
2025-12-02 19:09:59 [astonbarclay.gb] INFO: Saving data for 117314112: {'created_time': 1764702599.646486, 'last_price_update_time': 1764702599.646495, 'auction_closing_time': 1764842400.0}
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117314112') HTTP/1.1" 204 0
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf066e910>
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP74FET%252F2025-11-28%252Fimage%252F3a4d941d-b107-4f98-b589-c07a99ca030d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP74FET/2025-11-28/image/3a4d941d-b107-4f98-b589-c07a99ca030d_removebg.jpg?w=600 saved to cache
2025-12-02 19:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce1ab312-4e4f-5472-af61-365a2e332333
2025-12-02 19:09:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce1ab312-4e4f-5472-af61-365a2e332333, skipping ID generation
2025-12-02 19:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce1ab312-4e4f-5472-af61-365a2e332333 with scrape type 1
2025-12-02 19:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ce1ab312-4e4f-5472-af61-365a2e332333 from tracking dictionaries
2025-12-02 19:09:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce1ab312-4e4f-5472-af61-365a2e332333 sending to next pipeline
2025-12-02 19:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ce1ab312-4e4f-5472-af61-365a2e332333, identifier: 117492502
2025-12-02 19:09:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117577591, 'registration': 'FH21ETU', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d SE 5dr Step Auto', 'mileage': 45330, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-08', 'fuel': 'Diesel', 'motExpiry': '2026-06-04', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FH21ETU/2025-12-01/image/603a8b43-b975-4877-98c2-830cbdd23aaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/1a92524b-0aa3-4ab2-ad6e-096ad8c5170b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/5659703a-03ef-44d1-9f62-2a8a5d093878_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/58d6cc17-40f0-4c9f-84ca-83ae647105dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0693eca2-1bdb-4b73-b12e-d09f6e47a69b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/3bf6b552-0272-4736-a9ab-dc4d25c442d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0e7c6f79-bbd7-4812-8fb0-f227fae971ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/b5a4e6d7-b5af-4d09-9ea9-2496fc8f070f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/22 12K 03/24 32K 05/24 34K 09/25 43K', 'remarks': 'Jet Black VOSA STATES 34K 41K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3574ef91-959b-49fb-ad3b-7c38c4eb0557.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:09:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117577591, 'registration': 'FH21ETU', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d SE 5dr Step Auto', 'mileage': 45330, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-08', 'fuel': 'Diesel', 'motExpiry': '2026-06-04', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FH21ETU/2025-12-01/image/603a8b43-b975-4877-98c2-830cbdd23aaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/1a92524b-0aa3-4ab2-ad6e-096ad8c5170b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/5659703a-03ef-44d1-9f62-2a8a5d093878_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/58d6cc17-40f0-4c9f-84ca-83ae647105dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0693eca2-1bdb-4b73-b12e-d09f6e47a69b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/3bf6b552-0272-4736-a9ab-dc4d25c442d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0e7c6f79-bbd7-4812-8fb0-f227fae971ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/b5a4e6d7-b5af-4d09-9ea9-2496fc8f070f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/22 12K 03/24 32K 05/24 34K 09/25 43K', 'remarks': 'Jet Black VOSA STATES 34K 41K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3574ef91-959b-49fb-ad3b-7c38c4eb0557.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b37d27-1b6f-5649-815f-6b1a139a8ed5 with identifier: 117577591
2025-12-02 19:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5 with scrape type 1
2025-12-02 19:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F603a8b43-b975-4877-98c2-830cbdd23aaa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/603a8b43-b975-4877-98c2-830cbdd23aaa_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:09:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116954790, 'registration': 'BK72NHV', 'account': 'ZEN002', 'make': 'FORD', 'model': 'FOCUS ZETEC TDCI', 'derivative': None, 'mileage': 14913, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-01-12', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK72NHV/2025-11-05/image/19009496-1f5f-4403-9ee0-d1fd3d02df4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/8d04808b-4f67-423e-9e1e-958ee9ed19c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/60a688ef-96df-4bc4-babc-41739956cc17_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/3d8d1ccf-1f73-4e82-97ba-0fc38171516d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/d65921c7-154d-4b97-9881-10f07488f43a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/97f0047d-8a6a-4cac-ac46-31680a0f5d01_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/f6f11c4f-a090-4f5d-840d-1e7ccefb31ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/b5673934-f79d-4442-9b73-d2ce77bebf53_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e79f8649-8f26-4791-a12f-8238b18ecbf8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:09:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116954790, 'registration': 'BK72NHV', 'account': 'ZEN002', 'make': 'FORD', 'model': 'FOCUS ZETEC TDCI', 'derivative': None, 'mileage': 14913, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-01-12', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK72NHV/2025-11-05/image/19009496-1f5f-4403-9ee0-d1fd3d02df4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/8d04808b-4f67-423e-9e1e-958ee9ed19c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/60a688ef-96df-4bc4-babc-41739956cc17_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/3d8d1ccf-1f73-4e82-97ba-0fc38171516d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/d65921c7-154d-4b97-9881-10f07488f43a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/97f0047d-8a6a-4cac-ac46-31680a0f5d01_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/f6f11c4f-a090-4f5d-840d-1e7ccefb31ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK72NHV/2025-11-05/image/b5673934-f79d-4442-9b73-d2ce77bebf53_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e79f8649-8f26-4791-a12f-8238b18ecbf8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54b76ba1-89cb-5eda-8799-63b41f974a7b with identifier: 116954790
2025-12-02 19:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54b76ba1-89cb-5eda-8799-63b41f974a7b with scrape type 2
2025-12-02 19:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54b76ba1-89cb-5eda-8799-63b41f974a7b with scrape type 2
2025-12-02 19:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 54b76ba1-89cb-5eda-8799-63b41f974a7b, identifier: 116954790
2025-12-02 19:10:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116655276, 'registration': 'KW74GZD', 'account': 'REG024', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 157 48V ISG GT-Line 5dr DCT', 'mileage': 17836, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-01-20', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KW74GZD/2025-11-10/image/399dd806-5c67-4359-9466-4d42f686d7d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/ae6eb2e9-d845-4861-8fce-1b396fe43f75_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/b4318e32-78bc-40dd-a9a7-2a598b069dd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/bee91274-6450-4957-bbe3-2158886da2b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/b2e1a39e-18a5-4797-a7f0-d44176e2b958_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/45fcda24-415a-4fa9-b70d-990f188fb98b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/1e3b4ce9-1f56-4321-9b99-a0183b02787c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/c367e2ac-0629-4d2f-a782-adeced352501_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Regulus Asset Management', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4c121feb-fb5d-4488-81cd-c0ad26f71b42.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116655276, 'registration': 'KW74GZD', 'account': 'REG024', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 157 48V ISG GT-Line 5dr DCT', 'mileage': 17836, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-01-20', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KW74GZD/2025-11-10/image/399dd806-5c67-4359-9466-4d42f686d7d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/ae6eb2e9-d845-4861-8fce-1b396fe43f75_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/b4318e32-78bc-40dd-a9a7-2a598b069dd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/bee91274-6450-4957-bbe3-2158886da2b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/b2e1a39e-18a5-4797-a7f0-d44176e2b958_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/45fcda24-415a-4fa9-b70d-990f188fb98b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/1e3b4ce9-1f56-4321-9b99-a0183b02787c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW74GZD/2025-11-10/image/c367e2ac-0629-4d2f-a782-adeced352501_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Regulus Asset Management', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4c121feb-fb5d-4488-81cd-c0ad26f71b42.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c3e453c-c293-5b26-8500-3ce8de04311d with identifier: 116655276
2025-12-02 19:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c3e453c-c293-5b26-8500-3ce8de04311d with scrape type 2
2025-12-02 19:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c3e453c-c293-5b26-8500-3ce8de04311d with scrape type 2
2025-12-02 19:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5c3e453c-c293-5b26-8500-3ce8de04311d, identifier: 116655276
2025-12-02 19:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CY21KUD/2025-11-28/image/456e37dd-5695-4b81-a20f-8bb925f21904_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116470730?view=catalogue)
2025-12-02 19:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV22UEW/2025-11-27/image/9cb499df-ac6a-4829-86f8-b7781a64c631_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056499?view=catalogue)
2025-12-02 19:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX74KUK/2025-11-27/image/79d5bd72-f195-4382-9973-fc479e09cd9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457493?view=catalogue)
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252Ff6d6fa5a-0291-4eae-90a3-21be3c4f9b61_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/f6d6fa5a-0291-4eae-90a3-21be3c4f9b61_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ce1ab312-4e4f-5472-af61-365a2e332333 with identifier: 117492502
2025-12-02 19:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ce1ab312-4e4f-5472-af61-365a2e332333 with identifier: 117492502
2025-12-02 19:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ce1ab312-4e4f-5472-af61-365a2e332333 with identifier: 117492502 to the API
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DP74FET/2025-11-28/image/3a4d941d-b107-4f98-b589-c07a99ca030d_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ce1ab312-4e4f-5472-af61-365a2e332333',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DP74FET',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117492502',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'OMODA',
 'model': '5 ESTATE',
 'odometer': 9944,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33686,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/d0428881-2191-4ee3-82ad-74a3837360f9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32711,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/60073b38-2b27-4da6-ac0b-5dce94444666_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33010,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/5cfbdabb-a60a-45ec-8422-73ffdd01d811_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33072,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/64a5689b-b614-490b-a8bd-2ee0d71cb6da_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47840,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/f6823592-2a9b-4c06-90ee-3c867cc05171_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52267,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/00ab0ce0-5778-4598-b557-bceaa49bb6c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51674,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/3a4d941d-b107-4f98-b589-c07a99ca030d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1ab312-4e4f-5472-af61-365a2e332333/ce1ab312-4e4f-5472-af61-365a2e332333_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59298,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP74FET/2025-11-28/image/da42a56f-68a3-4aa3-b46e-cc18ba30b6c3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-31',
 'seller_name': 'Liquid Fleet',
 'title': 'OMODA 5 ESTATE 1.6 TGDI Noble 5dr 7DCT',
 'transmission': 'automatic',
 'trim': '1.6 TGDI Noble 5dr 7DCT',
 'vin': None,
 'year': 2024}
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492502%27 HTTP/1.1" 200 None
2025-12-02 19:10:00 [astonbarclay.gb] INFO: Saving data for 117492502: {'created_time': 1764702600.712589, 'last_price_update_time': 1764702600.712599, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117492502') HTTP/1.1" 204 0
2025-12-02 19:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 54b76ba1-89cb-5eda-8799-63b41f974a7b with identifier: 116954790
2025-12-02 19:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 54b76ba1-89cb-5eda-8799-63b41f974a7b with identifier: 116954790
2025-12-02 19:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 54b76ba1-89cb-5eda-8799-63b41f974a7b with identifier: 116954790 to the API
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:10:00 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 54b76ba1-89cb-5eda-8799-63b41f974a7b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"Trim","ErrorMessage":"car trim can\u0027t be null","ErrorCode":0}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:10:00 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116954790?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '54b76ba1-89cb-5eda-8799-63b41f974a7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BK72NHV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116954790',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FORD',
 'model': 'FOCUS ZETEC TDCI',
 'odometer': 14913,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-12',
 'seller_name': 'Zenith',
 'title': 'FORD FOCUS ZETEC TDCI None',
 'transmission': 'manual',
 'trim': None,
 'vin': None,
 'year': 2023}
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116954790%27 HTTP/1.1" 200 None
2025-12-02 19:10:00 [astonbarclay.gb] INFO: Saving data for 116954790: {'auction_closing_time': 1764842400.0, 'created_time': 1762888329.480318, 'last_price_update_time': 1764702600.986734}
2025-12-02 19:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116954790') HTTP/1.1" 204 0
2025-12-02 19:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5c3e453c-c293-5b26-8500-3ce8de04311d with identifier: 116655276
2025-12-02 19:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5c3e453c-c293-5b26-8500-3ce8de04311d with identifier: 116655276
2025-12-02 19:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5c3e453c-c293-5b26-8500-3ce8de04311d with identifier: 116655276 to the API
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275c3e453c-c293-5b26-8500-3ce8de04311d%27 HTTP/1.1" 200 None
2025-12-02 19:10:01 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5c3e453c-c293-5b26-8500-3ce8de04311d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:10:01 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116655276?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5c3e453c-c293-5b26-8500-3ce8de04311d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KW74GZD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116655276',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 17836,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-20',
 'seller_name': 'Regulus Asset Management',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi 157 48V ISG GT-Line 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.6T GDi 157 48V ISG GT-Line 5dr DCT',
 'vin': None,
 'year': 2025}
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116655276%27 HTTP/1.1" 200 None
2025-12-02 19:10:01 [astonbarclay.gb] INFO: Saving data for 116655276: {'auction_closing_time': 1764842400.0, 'created_time': 1761332598.424959, 'last_price_update_time': 1764702601.298379}
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116655276') HTTP/1.1" 204 0
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d30bd0>
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F1bb03fa8-9015-4772-bb08-cb68a50ef7ef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/1bb03fa8-9015-4772-bb08-cb68a50ef7ef_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2f948b8-7be4-53e3-8b32-272b3e94e748
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf2018450>
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F9249982d-3200-4f48-ac7a-52b427f6030e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/9249982d-3200-4f48-ac7a-52b427f6030e_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866
2025-12-02 19:10:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BV22UEW/2025-11-27/image/74e4adbd-2315-4b30-b653-0432ebcba264_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117056499?view=catalogue)
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F1a92524b-0aa3-4ab2-ad6e-096ad8c5170b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/1a92524b-0aa3-4ab2-ad6e-096ad8c5170b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117190866?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116725518?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117381561?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F05e83308-ab90-4629-ba19-140c690b69b6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/05e83308-ab90-4629-ba19-140c690b69b6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0338e90>
2025-12-02 19:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252F7319bed4-9b1e-4179-b636-7bfbb6e56ec5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/7319bed4-9b1e-4179-b636-7bfbb6e56ec5_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ba8cd25c-3ed0-5127-9025-ad55d06e9654
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1bcf190>
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F18400653-c4f5-4cfa-8f76-d11ff9da2cfc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/18400653-c4f5-4cfa-8f76-d11ff9da2cfc_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866
2025-12-02 19:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX74KUK/2025-11-27/image/d82b4210-727a-4d1d-8527-4c3c8bcf09fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457493?view=catalogue)
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F5659703a-03ef-44d1-9f62-2a8a5d093878_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/5659703a-03ef-44d1-9f62-2a8a5d093878_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf062ba10>
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCY21KUD%252F2025-11-28%252Fimage%252F456e37dd-5695-4b81-a20f-8bb925f21904_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CY21KUD/2025-11-28/image/456e37dd-5695-4b81-a20f-8bb925f21904_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ba8cd25c-3ed0-5127-9025-ad55d06e9654
2025-12-02 19:10:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba8cd25c-3ed0-5127-9025-ad55d06e9654, skipping ID generation
2025-12-02 19:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba8cd25c-3ed0-5127-9025-ad55d06e9654 with scrape type 1
2025-12-02 19:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ba8cd25c-3ed0-5127-9025-ad55d06e9654 from tracking dictionaries
2025-12-02 19:10:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba8cd25c-3ed0-5127-9025-ad55d06e9654 sending to next pipeline
2025-12-02 19:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ba8cd25c-3ed0-5127-9025-ad55d06e9654, identifier: 116470730
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03e1bd0>
2025-12-02 19:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F9cb499df-ac6a-4829-86f8-b7781a64c631_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/9cb499df-ac6a-4829-86f8-b7781a64c631_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2f948b8-7be4-53e3-8b32-272b3e94e748
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d94290>
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F79d5bd72-f195-4382-9973-fc479e09cd9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/79d5bd72-f195-4382-9973-fc479e09cd9e_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866
2025-12-02 19:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX74KUK/2025-11-27/image/61cd8128-5365-4bb1-a2e4-051ff7176161_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457493?view=catalogue)
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F0617a17f-b53e-4ee8-b4f6-44726694b61a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/0617a17f-b53e-4ee8-b4f6-44726694b61a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ba8cd25c-3ed0-5127-9025-ad55d06e9654 with identifier: 116470730
2025-12-02 19:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ba8cd25c-3ed0-5127-9025-ad55d06e9654 with identifier: 116470730
2025-12-02 19:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ba8cd25c-3ed0-5127-9025-ad55d06e9654 with identifier: 116470730 to the API
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/CY21KUD/2025-11-28/image/456e37dd-5695-4b81-a20f-8bb925f21904_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ba8cd25c-3ed0-5127-9025-ad55d06e9654',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'CY21KUD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116470730',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SEAT',
 'model': 'LEON DIESEL HATCHBACK',
 'odometer': 56752,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30759,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0edfc62-8c7b-4ad9-af76-babaaee19bdd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30851,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/ba41fd7a-88bc-4f97-8610-7dfce81b7e0e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31194,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/f0e48c20-7a41-4ee4-9556-0e618c0abc1a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30746,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/4307999b-4cbe-4dde-ba6f-c9a73b159edb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49310,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/060ae148-408c-4adf-81fc-eda3bf5c937f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56995,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/5c9ab921-a826-448a-965c-fd6f3e6ca4de_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37268,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/456e37dd-5695-4b81-a20f-8bb925f21904_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8cd25c-3ed0-5127-9025-ad55d06e9654/ba8cd25c-3ed0-5127-9025-ad55d06e9654_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57647,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CY21KUD/2025-11-28/image/7319bed4-9b1e-4179-b636-7bfbb6e56ec5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': 'Zenith',
 'title': 'SEAT LEON DIESEL HATCHBACK 2.0 TDI SE 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI SE 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116470730%27 HTTP/1.1" 200 None
2025-12-02 19:10:03 [astonbarclay.gb] INFO: Saving data for 116470730: {'created_time': 1764702603.812874, 'last_price_update_time': 1764702603.81289, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116470730') HTTP/1.1" 204 0
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0958490>
2025-12-02 19:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBV22UEW%252F2025-11-27%252Fimage%252F74e4adbd-2315-4b30-b653-0432ebcba264_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BV22UEW/2025-11-27/image/74e4adbd-2315-4b30-b653-0432ebcba264_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2f948b8-7be4-53e3-8b32-272b3e94e748
2025-12-02 19:10:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2f948b8-7be4-53e3-8b32-272b3e94e748, skipping ID generation
2025-12-02 19:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2f948b8-7be4-53e3-8b32-272b3e94e748 with scrape type 1
2025-12-02 19:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b2f948b8-7be4-53e3-8b32-272b3e94e748 from tracking dictionaries
2025-12-02 19:10:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2f948b8-7be4-53e3-8b32-272b3e94e748 sending to next pipeline
2025-12-02 19:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b2f948b8-7be4-53e3-8b32-272b3e94e748, identifier: 117056499
2025-12-02 19:10:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117190866, 'registration': 'YB73NSN', 'account': 'THE109', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [136] M Sport 5dr Step Auto [LCP]', 'mileage': 9909, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-11-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB73NSN/2025-11-19/image/37560904-0693-431a-8be6-3f97dba2a861_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/13b81b1c-c97a-45f6-bfe6-bb4caffe5121_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/ac869241-f9d9-413e-97d9-3896e7a12f2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/35bd7b14-459c-4d7f-ac1e-5d9c3c024bef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/b6a7c12a-e23e-4ba9-a787-029e90d47aa1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/e7ad0e61-50ed-4aef-aeaf-d81d67e20fb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/8f7481ee-f7bf-4f0e-b256-aa3e57413eb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/8f57ce15-d2fa-4bf6-bbfe-f4879a09ed44_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/25 8k', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d0880a90-b52f-4a5a-bc67-baff62d50cbd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117190866, 'registration': 'YB73NSN', 'account': 'THE109', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [136] M Sport 5dr Step Auto [LCP]', 'mileage': 9909, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-11-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB73NSN/2025-11-19/image/37560904-0693-431a-8be6-3f97dba2a861_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/13b81b1c-c97a-45f6-bfe6-bb4caffe5121_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/ac869241-f9d9-413e-97d9-3896e7a12f2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/35bd7b14-459c-4d7f-ac1e-5d9c3c024bef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/b6a7c12a-e23e-4ba9-a787-029e90d47aa1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/e7ad0e61-50ed-4aef-aeaf-d81d67e20fb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/8f7481ee-f7bf-4f0e-b256-aa3e57413eb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB73NSN/2025-11-19/image/8f57ce15-d2fa-4bf6-bbfe-f4879a09ed44_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/25 8k', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d0880a90-b52f-4a5a-bc67-baff62d50cbd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 756c318b-b3b6-5bba-9638-8c1e55d550b2 with identifier: 117190866
2025-12-02 19:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 756c318b-b3b6-5bba-9638-8c1e55d550b2 with scrape type 2
2025-12-02 19:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 756c318b-b3b6-5bba-9638-8c1e55d550b2 with scrape type 2
2025-12-02 19:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 756c318b-b3b6-5bba-9638-8c1e55d550b2, identifier: 117190866
2025-12-02 19:10:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116725518, 'registration': 'RV74FBY', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 6532, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RV74FBY/2025-11-05/image/636246a8-e013-4e8a-a90e-c5422ed2c95e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/2a5e5b4c-43db-4a4e-9b36-cdc518fccf7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/ef936d0a-b455-4218-8a78-25545943bc36_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/158467a6-b778-4b00-892d-76bb1433e7ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/edb72e34-1f27-4415-b23b-9eee8acda8e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/6bfe3d91-f287-454c-8a99-a88da7181a84_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/346a9f46-fba2-48d1-8b1b-1cf781ba7d14_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/e4fb60ef-f597-49fa-815e-cf50603128fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/0e35a783-8662-4c7e-9bf7-b1803dd8f8a0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/265b5495-8ae4-4f0d-9f08-14b34c03ba81.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116725518, 'registration': 'RV74FBY', 'account': 'LIQ001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 207 HEV 3 5dr Auto', 'mileage': 6532, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RV74FBY/2025-11-05/image/636246a8-e013-4e8a-a90e-c5422ed2c95e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/2a5e5b4c-43db-4a4e-9b36-cdc518fccf7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/ef936d0a-b455-4218-8a78-25545943bc36_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/158467a6-b778-4b00-892d-76bb1433e7ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/edb72e34-1f27-4415-b23b-9eee8acda8e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/6bfe3d91-f287-454c-8a99-a88da7181a84_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/346a9f46-fba2-48d1-8b1b-1cf781ba7d14_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/e4fb60ef-f597-49fa-815e-cf50603128fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV74FBY/2025-11-05/image/0e35a783-8662-4c7e-9bf7-b1803dd8f8a0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Liquid Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/265b5495-8ae4-4f0d-9f08-14b34c03ba81.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a3c07a5-34b0-558d-8200-b87e2997e01d with identifier: 116725518
2025-12-02 19:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a3c07a5-34b0-558d-8200-b87e2997e01d with scrape type 2
2025-12-02 19:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a3c07a5-34b0-558d-8200-b87e2997e01d with scrape type 2
2025-12-02 19:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1a3c07a5-34b0-558d-8200-b87e2997e01d, identifier: 116725518
2025-12-02 19:10:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117381561, 'registration': 'BT21YRD', 'account': 'LEA004', 'make': 'FORD', 'model': 'FOCUS DIESEL HATCHBACK', 'derivative': '1.5 EcoBlue 120 Zetec 5dr', 'mileage': 70028, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-03-02', 'fuel': 'Diesel', 'motExpiry': '2026-03-01', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BT21YRD/2025-11-26/image/3193c2cb-ccd0-4f2e-b52f-389eac7292d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ad381034-3890-49d1-9148-6a7bd5f1ba3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/cf0678df-3a46-4ea0-9c31-910acbe20124_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ff90ffb9-bea3-43f0-a5d3-9f64759856d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/fe4fb5bd-8109-4fce-8de5-9c7080c271fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/521e5277-44cf-4766-8bc1-439027450da2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/9150b06a-7d7f-4a6e-a524-559f283ff188_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/a97a20c1-840f-408c-a786-39af0f11c178_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 02/24-47k, 05/25-66k,', 'remarks': 'vosa states 47k, 63k,', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': 'TF', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/973f6c71-0224-448e-ac15-6e107aebf23a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117381561, 'registration': 'BT21YRD', 'account': 'LEA004', 'make': 'FORD', 'model': 'FOCUS DIESEL HATCHBACK', 'derivative': '1.5 EcoBlue 120 Zetec 5dr', 'mileage': 70028, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-03-02', 'fuel': 'Diesel', 'motExpiry': '2026-03-01', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BT21YRD/2025-11-26/image/3193c2cb-ccd0-4f2e-b52f-389eac7292d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ad381034-3890-49d1-9148-6a7bd5f1ba3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/cf0678df-3a46-4ea0-9c31-910acbe20124_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ff90ffb9-bea3-43f0-a5d3-9f64759856d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/fe4fb5bd-8109-4fce-8de5-9c7080c271fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/521e5277-44cf-4766-8bc1-439027450da2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/9150b06a-7d7f-4a6e-a524-559f283ff188_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/a97a20c1-840f-408c-a786-39af0f11c178_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 02/24-47k, 05/25-66k,', 'remarks': 'vosa states 47k, 63k,', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': 'TF', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/973f6c71-0224-448e-ac15-6e107aebf23a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef with identifier: 117381561
2025-12-02 19:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef with scrape type 1
2025-12-02 19:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252F3193c2cb-ccd0-4f2e-b52f-389eac7292d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/3193c2cb-ccd0-4f2e-b52f-389eac7292d4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FH21ETU/2025-12-01/image/603a8b43-b975-4877-98c2-830cbdd23aaa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117577591?view=catalogue)
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F58d6cc17-40f0-4c9f-84ca-83ae647105dc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/58d6cc17-40f0-4c9f-84ca-83ae647105dc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b2f948b8-7be4-53e3-8b32-272b3e94e748 with identifier: 117056499
2025-12-02 19:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b2f948b8-7be4-53e3-8b32-272b3e94e748 with identifier: 117056499
2025-12-02 19:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b2f948b8-7be4-53e3-8b32-272b3e94e748 with identifier: 117056499 to the API
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BV22UEW/2025-11-27/image/74e4adbd-2315-4b30-b653-0432ebcba264_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'b2f948b8-7be4-53e3-8b32-272b3e94e748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BV22UEW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117056499',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'CUPRA',
 'model': 'LEON ESTATE',
 'odometer': 19092,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28987,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/53747f76-7f57-41e2-983a-12f2cce55435_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28898,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/798d945b-76c6-4e24-9011-0905c3060ca8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30789,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/99b0a7c4-f607-4dcb-bbee-dd74c9c4a30a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30702,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/2e4affa8-2afb-4861-97e3-cc263780c122_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50153,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/787eb532-4f5a-4159-9119-a476974e9ff1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43202,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/1bb03fa8-9015-4772-bb08-cb68a50ef7ef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54596,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/9cb499df-ac6a-4829-86f8-b7781a64c631_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f948b8-7be4-53e3-8b32-272b3e94e748/b2f948b8-7be4-53e3-8b32-272b3e94e748_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43824,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BV22UEW/2025-11-27/image/74e4adbd-2315-4b30-b653-0432ebcba264_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seller_name': 'Zenith',
 'title': 'CUPRA LEON ESTATE 1.4 eHybrid VZ2 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 eHybrid VZ2 5dr DSG',
 'vin': None,
 'year': 2022}
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117056499%27 HTTP/1.1" 200 None
2025-12-02 19:10:04 [astonbarclay.gb] INFO: Saving data for 117056499: {'created_time': 1764702604.910266, 'last_price_update_time': 1764702604.910277, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117056499') HTTP/1.1" 204 0
2025-12-02 19:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 756c318b-b3b6-5bba-9638-8c1e55d550b2 with identifier: 117190866
2025-12-02 19:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 756c318b-b3b6-5bba-9638-8c1e55d550b2 with identifier: 117190866
2025-12-02 19:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 756c318b-b3b6-5bba-9638-8c1e55d550b2 with identifier: 117190866 to the API
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27756c318b-b3b6-5bba-9638-8c1e55d550b2%27 HTTP/1.1" 200 None
2025-12-02 19:10:05 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 756c318b-b3b6-5bba-9638-8c1e55d550b2: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 02 Dec 2025 19:10:04 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-02 19:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117190866?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '756c318b-b3b6-5bba-9638-8c1e55d550b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YB73NSN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117190866',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 9909,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-21',
 'seller_name': 'TCB Group - Prime',
 'title': 'BMW 1 SERIES HATCHBACK 118i [136] M Sport 5dr Step Auto [LCP]',
 'transmission': 'automatic',
 'trim': '118i [136] M Sport 5dr Step Auto [LCP]',
 'vin': None,
 'year': 2023}
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117190866%27 HTTP/1.1" 200 None
2025-12-02 19:10:05 [astonbarclay.gb] INFO: Saving data for 117190866: {'auction_closing_time': 1764842400.0, 'created_time': 1763406104.86994, 'last_price_update_time': 1764702605.205983}
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117190866') HTTP/1.1" 204 0
2025-12-02 19:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1a3c07a5-34b0-558d-8200-b87e2997e01d with identifier: 116725518
2025-12-02 19:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1a3c07a5-34b0-558d-8200-b87e2997e01d with identifier: 116725518
2025-12-02 19:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1a3c07a5-34b0-558d-8200-b87e2997e01d with identifier: 116725518 to the API
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116725518?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '1a3c07a5-34b0-558d-8200-b87e2997e01d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RV74FBY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116725518',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 6532,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-30',
 'seller_name': 'Liquid Fleet',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi 207 HEV 3 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6T GDi 207 HEV 3 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116725518%27 HTTP/1.1" 200 None
2025-12-02 19:10:05 [astonbarclay.gb] INFO: Saving data for 116725518: {'auction_closing_time': 1764842400.0, 'created_time': 1762283163.539627, 'last_price_update_time': 1764702605.506064}
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116725518') HTTP/1.1" 204 0
2025-12-02 19:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX74KUK/2025-11-27/image/f6d6fa5a-0291-4eae-90a3-21be3c4f9b61_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457493?view=catalogue)
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252Fad381034-3890-49d1-9148-6a7bd5f1ba3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ad381034-3890-49d1-9148-6a7bd5f1ba3d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117381174?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117383402?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0460f10>
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252Fd82b4210-727a-4d1d-8527-4c3c8bcf09fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/d82b4210-727a-4d1d-8527-4c3c8bcf09fb_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866
2025-12-02 19:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FH21ETU/2025-12-01/image/1a92524b-0aa3-4ab2-ad6e-096ad8c5170b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117577591?view=catalogue)
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F0693eca2-1bdb-4b73-b12e-d09f6e47a69b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0693eca2-1bdb-4b73-b12e-d09f6e47a69b_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 19:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117220839?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf038ea90>
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F61cd8128-5365-4bb1-a2e4-051ff7176161_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/61cd8128-5365-4bb1-a2e4-051ff7176161_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866
2025-12-02 19:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX74KUK/2025-11-27/image/05e83308-ab90-4629-ba19-140c690b69b6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457493?view=catalogue)
2025-12-02 19:10:05 [scrapy.extensions.logstats] INFO: Crawled 465 pages (at 36 pages/min), scraped 328 items (at 32 items/min)
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252Fcf0678df-3a46-4ea0-9c31-910acbe20124_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/cf0678df-3a46-4ea0-9c31-910acbe20124_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05efed0>
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F603a8b43-b975-4877-98c2-830cbdd23aaa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/603a8b43-b975-4877-98c2-830cbdd23aaa_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5
2025-12-02 19:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FH21ETU/2025-12-01/image/5659703a-03ef-44d1-9f62-2a8a5d093878_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117577591?view=catalogue)
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F3bf6b552-0272-4736-a9ab-dc4d25c442d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/3bf6b552-0272-4736-a9ab-dc4d25c442d8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf051aad0>
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252Ff6d6fa5a-0291-4eae-90a3-21be3c4f9b61_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/f6d6fa5a-0291-4eae-90a3-21be3c4f9b61_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866
2025-12-02 19:10:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117381174, 'registration': 'FV22KNY', 'account': 'ZEN002', 'make': 'SKODA', 'model': 'KAMIQ HATCHBACK', 'derivative': '1.0 TSI 110 Monte Carlo 5dr DSG', 'mileage': 79346, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-06-23', 'fuel': 'Petrol', 'motExpiry': '2026-06-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FV22KNY/2025-11-25/image/a6d5f6d0-b821-424c-ac69-099f11fd0079_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/0c5478a1-ec77-4f06-902f-e6a5387236eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/1c45d20f-77e7-4d36-8d5e-c1146b7199dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/5848cdc1-38ca-49c4-8edd-a3cee1de1244_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/4b84213f-16e2-4a0c-bfce-577570b6445f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/6ce891aa-dd38-49a9-9536-da985670fa5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/39a04a44-2340-499b-b0c8-ec372247e57d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/df9aa7d9-e4a3-4bb2-9ae9-86e39d5567cf_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/24 48K 01/25 59K 06/25 72K', 'remarks': 'VOSA STATES 71 K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': 'TF', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cac0ba37-e383-41d9-b07b-e85d92aab006.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117381174, 'registration': 'FV22KNY', 'account': 'ZEN002', 'make': 'SKODA', 'model': 'KAMIQ HATCHBACK', 'derivative': '1.0 TSI 110 Monte Carlo 5dr DSG', 'mileage': 79346, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-06-23', 'fuel': 'Petrol', 'motExpiry': '2026-06-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FV22KNY/2025-11-25/image/a6d5f6d0-b821-424c-ac69-099f11fd0079_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/0c5478a1-ec77-4f06-902f-e6a5387236eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/1c45d20f-77e7-4d36-8d5e-c1146b7199dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/5848cdc1-38ca-49c4-8edd-a3cee1de1244_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/4b84213f-16e2-4a0c-bfce-577570b6445f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/6ce891aa-dd38-49a9-9536-da985670fa5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/39a04a44-2340-499b-b0c8-ec372247e57d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KNY/2025-11-25/image/df9aa7d9-e4a3-4bb2-9ae9-86e39d5567cf_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/24 48K 01/25 59K 06/25 72K', 'remarks': 'VOSA STATES 71 K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': 'TF', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cac0ba37-e383-41d9-b07b-e85d92aab006.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43b7986d-11f1-58f6-9c74-f4fd8fefb993 with identifier: 117381174
2025-12-02 19:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b7986d-11f1-58f6-9c74-f4fd8fefb993 with scrape type 2
2025-12-02 19:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43b7986d-11f1-58f6-9c74-f4fd8fefb993 with scrape type 2
2025-12-02 19:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 43b7986d-11f1-58f6-9c74-f4fd8fefb993, identifier: 117381174
2025-12-02 19:10:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117383402, 'registration': 'AO70ZYE', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e SE Pro 4dr Step Auto', 'mileage': 109558, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-11-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-09', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/eee1774f-3d90-4af4-a5f2-8e88a70495cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/0668e358-91e0-42d6-82cf-07d3251b03d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/80e5c6b5-b7c6-4cfa-a7f8-7bacfdfe7668_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/1b331f74-debc-4b69-9e04-e2527b97bc5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/9eb115dd-03cf-47fb-8b3a-74fdec7881c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/b759e5b9-94cd-475d-bde3-9e64465096c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/c57870b0-1dcc-4699-b957-54989a4bb04c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/71158325-2b72-45a9-bc34-438eea0ba676_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/24-84k, 09/25-108k,', 'remarks': 'vosa states 63k, 84k, 108k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': 'TF', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a3b00c1-4b5b-499d-a134-075bd17930c0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117383402, 'registration': 'AO70ZYE', 'account': 'ZEN002', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e SE Pro 4dr Step Auto', 'mileage': 109558, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-11-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-09', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/eee1774f-3d90-4af4-a5f2-8e88a70495cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/0668e358-91e0-42d6-82cf-07d3251b03d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/80e5c6b5-b7c6-4cfa-a7f8-7bacfdfe7668_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/1b331f74-debc-4b69-9e04-e2527b97bc5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/9eb115dd-03cf-47fb-8b3a-74fdec7881c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/b759e5b9-94cd-475d-bde3-9e64465096c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/c57870b0-1dcc-4699-b957-54989a4bb04c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/71158325-2b72-45a9-bc34-438eea0ba676_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/24-84k, 09/25-108k,', 'remarks': 'vosa states 63k, 84k, 108k, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': 'TF', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a3b00c1-4b5b-499d-a134-075bd17930c0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e7b736-65b4-565c-a173-ae5c8ad6be2c with identifier: 117383402
2025-12-02 19:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c with scrape type 1
2025-12-02 19:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252Feee1774f-3d90-4af4-a5f2-8e88a70495cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/eee1774f-3d90-4af4-a5f2-8e88a70495cc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT21YRD/2025-11-26/image/3193c2cb-ccd0-4f2e-b52f-389eac7292d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381561?view=catalogue)
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252Fff90ffb9-bea3-43f0-a5d3-9f64759856d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ff90ffb9-bea3-43f0-a5d3-9f64759856d7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 43b7986d-11f1-58f6-9c74-f4fd8fefb993 with identifier: 117381174
2025-12-02 19:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 43b7986d-11f1-58f6-9c74-f4fd8fefb993 with identifier: 117381174
2025-12-02 19:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 43b7986d-11f1-58f6-9c74-f4fd8fefb993 with identifier: 117381174 to the API
2025-12-02 19:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117381174?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '43b7986d-11f1-58f6-9c74-f4fd8fefb993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FV22KNY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117381174',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SKODA',
 'model': 'KAMIQ HATCHBACK',
 'odometer': 79346,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seller_name': 'Zenith',
 'title': 'SKODA KAMIQ HATCHBACK 1.0 TSI 110 Monte Carlo 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI 110 Monte Carlo 5dr DSG',
 'vin': None,
 'year': 2022}
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381174%27 HTTP/1.1" 200 None
2025-12-02 19:10:07 [astonbarclay.gb] INFO: Saving data for 117381174: {'auction_closing_time': 1764842400.0, 'created_time': 1764184434.209834, 'last_price_update_time': 1764702607.152751}
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117381174') HTTP/1.1" 204 0
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf068af90>
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F1a92524b-0aa3-4ab2-ad6e-096ad8c5170b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/1a92524b-0aa3-4ab2-ad6e-096ad8c5170b_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5
2025-12-02 19:10:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117220839, 'registration': 'AO71YJT', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '118d SE 5dr [Live Cockpit Professional]', 'mileage': 74476, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-11-29', 'fuel': 'Diesel', 'motExpiry': '2025-11-28', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO71YJT/2025-11-28/image/19128cc3-aaa2-418f-a74a-dc5d3149e49e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/320c20b8-2c5b-4794-aa54-d94392c01a65_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/72983bef-defa-43be-99d6-6031c1a8d242_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/e8f69fbd-0e61-4bbc-968a-14d311ba94fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/6678538a-e926-4b67-adab-7fbe49361d38_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/73fce540-6955-453b-80f6-66b879a2a0a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/345d8be4-b289-45f9-8a1f-0159a4fea2e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/d3fb8524-6130-4d58-b436-52d8d7998648_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/22 18k 08/23 34k 10/24 52k 08/25 70k', 'remarks': 'Phytonic Blue VOSA STATES 55K 74K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fcf69e3b-c4f0-4e6c-b6f7-e9cd6ba2d85a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117220839, 'registration': 'AO71YJT', 'account': 'ZEN002', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '118d SE 5dr [Live Cockpit Professional]', 'mileage': 74476, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-11-29', 'fuel': 'Diesel', 'motExpiry': '2025-11-28', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO71YJT/2025-11-28/image/19128cc3-aaa2-418f-a74a-dc5d3149e49e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/320c20b8-2c5b-4794-aa54-d94392c01a65_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/72983bef-defa-43be-99d6-6031c1a8d242_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/e8f69fbd-0e61-4bbc-968a-14d311ba94fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/6678538a-e926-4b67-adab-7fbe49361d38_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/73fce540-6955-453b-80f6-66b879a2a0a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/345d8be4-b289-45f9-8a1f-0159a4fea2e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/d3fb8524-6130-4d58-b436-52d8d7998648_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/22 18k 08/23 34k 10/24 52k 08/25 70k', 'remarks': 'Phytonic Blue VOSA STATES 55K 74K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fcf69e3b-c4f0-4e6c-b6f7-e9cd6ba2d85a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 641d4232-3d98-5933-8db7-3d4c20144670 with identifier: 117220839
2025-12-02 19:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 641d4232-3d98-5933-8db7-3d4c20144670 with scrape type 1
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 641d4232-3d98-5933-8db7-3d4c20144670
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F19128cc3-aaa2-418f-a74a-dc5d3149e49e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/19128cc3-aaa2-418f-a74a-dc5d3149e49e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FH21ETU/2025-12-01/image/58d6cc17-40f0-4c9f-84ca-83ae647105dc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117577591?view=catalogue)
2025-12-02 19:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GX74KUK/2025-11-27/image/0617a17f-b53e-4ee8-b4f6-44726694b61a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457493?view=catalogue)
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F0e7c6f79-bbd7-4812-8fb0-f227fae971ba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0e7c6f79-bbd7-4812-8fb0-f227fae971ba_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252F0668e358-91e0-42d6-82cf-07d3251b03d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/0668e358-91e0-42d6-82cf-07d3251b03d4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf2005e90>
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F05e83308-ab90-4629-ba19-140c690b69b6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/05e83308-ab90-4629-ba19-140c690b69b6_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866
2025-12-02 19:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ad381034-3890-49d1-9148-6a7bd5f1ba3d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381561?view=catalogue)
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252Ffe4fb5bd-8109-4fce-8de5-9c7080c271fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/fe4fb5bd-8109-4fce-8de5-9c7080c271fb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F320c20b8-2c5b-4794-aa54-d94392c01a65_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/320c20b8-2c5b-4794-aa54-d94392c01a65_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117536701?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098b890>
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F5659703a-03ef-44d1-9f62-2a8a5d093878_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/5659703a-03ef-44d1-9f62-2a8a5d093878_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252Fb5a4e6d7-b5af-4d09-9ea9-2496fc8f070f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/b5a4e6d7-b5af-4d09-9ea9-2496fc8f070f_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252F80e5c6b5-b7c6-4cfa-a7f8-7bacfdfe7668_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/80e5c6b5-b7c6-4cfa-a7f8-7bacfdfe7668_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117429174?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116560193?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116995130?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf11e66d0>
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252F3193c2cb-ccd0-4f2e-b52f-389eac7292d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/3193c2cb-ccd0-4f2e-b52f-389eac7292d4_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef
2025-12-02 19:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT21YRD/2025-11-26/image/cf0678df-3a46-4ea0-9c31-910acbe20124_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381561?view=catalogue)
2025-12-02 19:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0693eca2-1bdb-4b73-b12e-d09f6e47a69b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117577591?view=catalogue)
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252F521e5277-44cf-4766-8bc1-439027450da2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/521e5277-44cf-4766-8bc1-439027450da2_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F72983bef-defa-43be-99d6-6031c1a8d242_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/72983bef-defa-43be-99d6-6031c1a8d242_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf046ab10>
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F58d6cc17-40f0-4c9f-84ca-83ae647105dc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/58d6cc17-40f0-4c9f-84ca-83ae647105dc_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06a3a10>
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_8.jpg HTTP/1.1" 201 0
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGX74KUK%252F2025-11-27%252Fimage%252F0617a17f-b53e-4ee8-b4f6-44726694b61a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX74KUK/2025-11-27/image/0617a17f-b53e-4ee8-b4f6-44726694b61a_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866
2025-12-02 19:10:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a19554b-bcb7-5bc2-8a06-afa0bc3df866, skipping ID generation
2025-12-02 19:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866 with scrape type 1
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866 from tracking dictionaries
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a19554b-bcb7-5bc2-8a06-afa0bc3df866 sending to next pipeline
2025-12-02 19:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2a19554b-bcb7-5bc2-8a06-afa0bc3df866, identifier: 117457493
2025-12-02 19:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/eee1774f-3d90-4af4-a5f2-8e88a70495cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117383402?view=catalogue)
2025-12-02 19:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FH21ETU/2025-12-01/image/3bf6b552-0272-4736-a9ab-dc4d25c442d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117577591?view=catalogue)
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252F1b331f74-debc-4b69-9e04-e2527b97bc5d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/1b331f74-debc-4b69-9e04-e2527b97bc5d_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2a19554b-bcb7-5bc2-8a06-afa0bc3df866 with identifier: 117457493
2025-12-02 19:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2a19554b-bcb7-5bc2-8a06-afa0bc3df866 with identifier: 117457493
2025-12-02 19:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2a19554b-bcb7-5bc2-8a06-afa0bc3df866 with identifier: 117457493 to the API
2025-12-02 19:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/GX74KUK/2025-11-27/image/0617a17f-b53e-4ee8-b4f6-44726694b61a_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '2a19554b-bcb7-5bc2-8a06-afa0bc3df866',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GX74KUK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117457493',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '3 SERIES DIESEL SALOON',
 'odometer': 13354,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30093,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/3a4212c0-f83f-46b2-bea0-8397c572bc97_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31402,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/9249982d-3200-4f48-ac7a-52b427f6030e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31329,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/18400653-c4f5-4cfa-8f76-d11ff9da2cfc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30163,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/79d5bd72-f195-4382-9973-fc479e09cd9e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55816,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/d82b4210-727a-4d1d-8527-4c3c8bcf09fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59665,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/61cd8128-5365-4bb1-a2e4-051ff7176161_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56242,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/f6d6fa5a-0291-4eae-90a3-21be3c4f9b61_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60488,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/05e83308-ab90-4629-ba19-140c690b69b6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a19554b-bcb7-5bc2-8a06-afa0bc3df866/2a19554b-bcb7-5bc2-8a06-afa0bc3df866_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79693,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/GX74KUK/2025-11-27/image/0617a17f-b53e-4ee8-b4f6-44726694b61a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-30',
 'seller_name': 'Liquid Fleet',
 'title': 'BMW 3 SERIES DIESEL SALOON 320d MHT M Sport 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '320d MHT M Sport 4dr Step Auto',
 'vin': None,
 'year': 2024}
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457493%27 HTTP/1.1" 200 None
2025-12-02 19:10:09 [astonbarclay.gb] INFO: Saving data for 117457493: {'created_time': 1764702609.226466, 'last_price_update_time': 1764702609.226476, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117457493') HTTP/1.1" 204 0
2025-12-02 19:10:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05e7890>
2025-12-02 19:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252Fad381034-3890-49d1-9148-6a7bd5f1ba3d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ad381034-3890-49d1-9148-6a7bd5f1ba3d_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef
2025-12-02 19:10:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117536701, 'registration': 'BT71AYC', 'account': 'ZEN002', 'make': 'SKODA', 'model': 'ENYAQ IV ESTATE', 'derivative': '132kW 60 Suite Nav 62kWh 5dr Auto', 'mileage': 40618, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-22', 'fuel': 'Electric', 'motExpiry': '2026-11-21', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BT71AYC/2025-11-27/image/f57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/ecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/bb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/24 20K', 'remarks': 'VOSA STATES 29K 40K \t 100 Kw Dc Charging\t20in Vega Silver Metallic Alloy\tChrome Package Climate Package Basic\tDouble Sided Boot Floor\tDrive Sport Package Basic Metallic Paint\tParking Package Basic\tRear Side Airbags, spare key', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0d810ede-504b-4778-ae00-2216e7a77e02.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117536701, 'registration': 'BT71AYC', 'account': 'ZEN002', 'make': 'SKODA', 'model': 'ENYAQ IV ESTATE', 'derivative': '132kW 60 Suite Nav 62kWh 5dr Auto', 'mileage': 40618, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-22', 'fuel': 'Electric', 'motExpiry': '2026-11-21', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BT71AYC/2025-11-27/image/f57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/ecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/bb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 01/24 20K', 'remarks': 'VOSA STATES 29K 40K \t 100 Kw Dc Charging\t20in Vega Silver Metallic Alloy\tChrome Package Climate Package Basic\tDouble Sided Boot Floor\tDrive Sport Package Basic Metallic Paint\tParking Package Basic\tRear Side Airbags, spare key', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0d810ede-504b-4778-ae00-2216e7a77e02.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef9d0ba-8596-5781-8113-6a23560ff892 with identifier: 117536701
2025-12-02 19:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef9d0ba-8596-5781-8113-6a23560ff892 with scrape type 1
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3ef9d0ba-8596-5781-8113-6a23560ff892
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252Ff57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/f57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71YJT/2025-11-28/image/19128cc3-aaa2-418f-a74a-dc5d3149e49e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117220839?view=catalogue)
2025-12-02 19:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ff90ffb9-bea3-43f0-a5d3-9f64759856d7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381561?view=catalogue)
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252F9150b06a-7d7f-4a6e-a524-559f283ff188_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/9150b06a-7d7f-4a6e-a524-559f283ff188_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252Fe8f69fbd-0e61-4bbc-968a-14d311ba94fd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/e8f69fbd-0e61-4bbc-968a-14d311ba94fd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116305284?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117429174, 'registration': 'LD71KWK', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 61138, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-24', 'fuel': 'Electric', 'motExpiry': '2026-09-23', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LD71KWK/2025-11-26/image/93b18e2f-ec66-4df7-b939-ab58125d28dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/e163278a-9978-4f4b-a97a-0c355ae43f11_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/99cf92a6-25d9-4441-96e0-4ef790699e89_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/b65d3236-047b-4e78-a06f-df5b971db80a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/709d13ed-77df-4852-96e0-102b111e72bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/5e1b628d-2acb-4fab-920e-087f1e35f2d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/cf893de7-56c7-4b28-b290-42ba98251a08_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/2f42f206-49bd-4fe2-829b-1536fb085e4c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 34K 56K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2b87050d-da96-4fcd-ba6e-62b0af6569c9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117429174, 'registration': 'LD71KWK', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 61138, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-24', 'fuel': 'Electric', 'motExpiry': '2026-09-23', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LD71KWK/2025-11-26/image/93b18e2f-ec66-4df7-b939-ab58125d28dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/e163278a-9978-4f4b-a97a-0c355ae43f11_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/99cf92a6-25d9-4441-96e0-4ef790699e89_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/b65d3236-047b-4e78-a06f-df5b971db80a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/709d13ed-77df-4852-96e0-102b111e72bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/5e1b628d-2acb-4fab-920e-087f1e35f2d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/cf893de7-56c7-4b28-b290-42ba98251a08_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/2f42f206-49bd-4fe2-829b-1536fb085e4c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 34K 56K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2b87050d-da96-4fcd-ba6e-62b0af6569c9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-02 19:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99beba97-1913-5102-8e25-4e317b739c26 with identifier: 117429174
2025-12-02 19:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99beba97-1913-5102-8e25-4e317b739c26 with scrape type 1
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 99beba97-1913-5102-8e25-4e317b739c26
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252F93b18e2f-ec66-4df7-b939-ab58125d28dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/93b18e2f-ec66-4df7-b939-ab58125d28dd_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116560193, 'registration': 'BV71NZA', 'account': 'KIN032', 'make': 'SKODA', 'model': 'OCTAVIA DIESEL ESTATE', 'derivative': '2.0 TDI 150 SE L 5dr', 'mileage': 84386, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 235, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-10-25', 'fuel': 'Diesel', 'motExpiry': '2026-10-24', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BV71NZA/2025-10-22/image/09813134-8796-4071-ba57-da7cf2e16cb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/e2103bf7-18ef-4123-9cc4-60a22e19d9c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/574c388a-25a7-43ea-8446-5289d82f13fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/2bf12276-7bbb-4440-a2db-5af8913f530c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/b0032ff0-49c3-4af8-83d5-129577c2cadb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/43492d82-eaaa-476b-b66c-fbb07af3e608_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/d2e60a6d-397d-4168-89a4-ab3f5e48f1d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/ad72da2b-cc02-46fc-ad5d-46f271657265_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/24 51K 06/25 77K', 'remarks': 'VOSA STATES 62K 83K SPARE KEY, Pearl - Black magic, 18"" Perseus anthracite alloy wheels / 8 speakers / Boot lid release from inside vehicle (electrically) / Climatronic dual-zone electronic air conditioning / Crew protection assist and front central airbags / Drive mode selector / Driver fatigue sensor / Electric adjustable/heated/folding door mirrors with driver side auto dimming / Front and rear parking sensors with manoeuvre assist / Head up Display / Height adjustable driver seat with lumbar support / LED front fog lights / LED headlights with LED daytime running lights / LED interior light pack - Octavia / Manual rear child locks / Microsuede cloth - Black / Rear-view parking camera Inc Rear LED lights (high) and dynamic indicators / Tetris black fabric with grey stitching  in dash board pads / Travel assist / Variable boot floor / Winter pack - Octavia', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dbfb5f05-90c2-44c4-ae56-ae9a78d5aa88.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116560193, 'registration': 'BV71NZA', 'account': 'KIN032', 'make': 'SKODA', 'model': 'OCTAVIA DIESEL ESTATE', 'derivative': '2.0 TDI 150 SE L 5dr', 'mileage': 84386, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 235, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-10-25', 'fuel': 'Diesel', 'motExpiry': '2026-10-24', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BV71NZA/2025-10-22/image/09813134-8796-4071-ba57-da7cf2e16cb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/e2103bf7-18ef-4123-9cc4-60a22e19d9c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/574c388a-25a7-43ea-8446-5289d82f13fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/2bf12276-7bbb-4440-a2db-5af8913f530c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/b0032ff0-49c3-4af8-83d5-129577c2cadb_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/43492d82-eaaa-476b-b66c-fbb07af3e608_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/d2e60a6d-397d-4168-89a4-ab3f5e48f1d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV71NZA/2025-10-22/image/ad72da2b-cc02-46fc-ad5d-46f271657265_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/24 51K 06/25 77K', 'remarks': 'VOSA STATES 62K 83K SPARE KEY, Pearl - Black magic, 18"" Perseus anthracite alloy wheels / 8 speakers / Boot lid release from inside vehicle (electrically) / Climatronic dual-zone electronic air conditioning / Crew protection assist and front central airbags / Drive mode selector / Driver fatigue sensor / Electric adjustable/heated/folding door mirrors with driver side auto dimming / Front and rear parking sensors with manoeuvre assist / Head up Display / Height adjustable driver seat with lumbar support / LED front fog lights / LED headlights with LED daytime running lights / LED interior light pack - Octavia / Manual rear child locks / Microsuede cloth - Black / Rear-view parking camera Inc Rear LED lights (high) and dynamic indicators / Tetris black fabric with grey stitching  in dash board pads / Travel assist / Variable boot floor / Winter pack - Octavia', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dbfb5f05-90c2-44c4-ae56-ae9a78d5aa88.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b482aeb-11b1-500e-afe5-de20ca9990f0 with identifier: 116560193
2025-12-02 19:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b482aeb-11b1-500e-afe5-de20ca9990f0 with scrape type 2
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b482aeb-11b1-500e-afe5-de20ca9990f0 with scrape type 2
2025-12-02 19:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7b482aeb-11b1-500e-afe5-de20ca9990f0, identifier: 116560193
2025-12-02 19:10:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116995130, 'registration': 'OV71FGG', 'account': 'KIN032', 'make': 'SKODA', 'model': 'OCTAVIA ESTATE', 'derivative': '1.4 TSI iV SE Technology DSG 5dr', 'mileage': 83899, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 238, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-29', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-04', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71FGG/2025-11-06/image/1158b840-9028-478a-84f1-61ee0e1f10fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/97fdb768-64b7-4885-8df7-77d5e26a8680_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/95a286e6-ff6c-4142-9fd7-a99c072a0f88_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/907838d0-b377-4ee2-85dd-5557a8ab829c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/caca6e59-a38e-4021-bec1-39a0d1593cad_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/9ab138e3-e31e-43a6-a3b6-bc91911417b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/ae4eafb6-1fc5-4037-b242-8c690a2929a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/19bba388-f361-48ad-b883-7f5d4dcc548e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/22 8K 10/23 26K', 'remarks': 'VOSA STATES 56K 79K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/63526e95-4a91-4ff0-b752-3d66b7569a5a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116995130, 'registration': 'OV71FGG', 'account': 'KIN032', 'make': 'SKODA', 'model': 'OCTAVIA ESTATE', 'derivative': '1.4 TSI iV SE Technology DSG 5dr', 'mileage': 83899, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 238, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-29', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-04', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71FGG/2025-11-06/image/1158b840-9028-478a-84f1-61ee0e1f10fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/97fdb768-64b7-4885-8df7-77d5e26a8680_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/95a286e6-ff6c-4142-9fd7-a99c072a0f88_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/907838d0-b377-4ee2-85dd-5557a8ab829c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/caca6e59-a38e-4021-bec1-39a0d1593cad_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/9ab138e3-e31e-43a6-a3b6-bc91911417b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/ae4eafb6-1fc5-4037-b242-8c690a2929a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/19bba388-f361-48ad-b883-7f5d4dcc548e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/22 8K 10/23 26K', 'remarks': 'VOSA STATES 56K 79K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/63526e95-4a91-4ff0-b752-3d66b7569a5a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642 with identifier: 116995130
2025-12-02 19:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642 with scrape type 1
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F1158b840-9028-478a-84f1-61ee0e1f10fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/1158b840-9028-478a-84f1-61ee0e1f10fb_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/0668e358-91e0-42d6-82cf-07d3251b03d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117383402?view=catalogue)
2025-12-02 19:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0e7c6f79-bbd7-4812-8fb0-f227fae971ba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117577591?view=catalogue)
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252F9eb115dd-03cf-47fb-8b3a-74fdec7881c9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/9eb115dd-03cf-47fb-8b3a-74fdec7881c9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252Fecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/ecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117407917?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117140776?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-02 19:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7b482aeb-11b1-500e-afe5-de20ca9990f0 with identifier: 116560193
2025-12-02 19:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7b482aeb-11b1-500e-afe5-de20ca9990f0 with identifier: 116560193
2025-12-02 19:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7b482aeb-11b1-500e-afe5-de20ca9990f0 with identifier: 116560193 to the API
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116560193?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7b482aeb-11b1-500e-afe5-de20ca9990f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BV71NZA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116560193',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SKODA',
 'model': 'OCTAVIA DIESEL ESTATE',
 'odometer': 84386,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seller_name': 'Kinto',
 'title': 'SKODA OCTAVIA DIESEL ESTATE 2.0 TDI 150 SE L 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI 150 SE L 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116560193%27 HTTP/1.1" 200 None
2025-12-02 19:10:09 [astonbarclay.gb] INFO: Saving data for 116560193: {'auction_closing_time': 1764842400.0, 'created_time': 1763147118.690274, 'last_price_update_time': 1764702609.960093}
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116560193') HTTP/1.1" 204 0
2025-12-02 19:10:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ff8b50>
2025-12-02 19:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252Fcf0678df-3a46-4ea0-9c31-910acbe20124_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/cf0678df-3a46-4ea0-9c31-910acbe20124_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06d5110>
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F0693eca2-1bdb-4b73-b12e-d09f6e47a69b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0693eca2-1bdb-4b73-b12e-d09f6e47a69b_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5
2025-12-02 19:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT21YRD/2025-11-26/image/fe4fb5bd-8109-4fce-8de5-9c7080c271fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381561?view=catalogue)
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252Fa97a20c1-840f-408c-a786-39af0f11c178_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/a97a20c1-840f-408c-a786-39af0f11c178_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F6678538a-e926-4b67-adab-7fbe49361d38_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/6678538a-e926-4b67-adab-7fbe49361d38_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252Fe163278a-9978-4f4b-a97a-0c355ae43f11_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/e163278a-9978-4f4b-a97a-0c355ae43f11_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F97fdb768-64b7-4885-8df7-77d5e26a8680_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/97fdb768-64b7-4885-8df7-77d5e26a8680_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f1af10>
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252Feee1774f-3d90-4af4-a5f2-8e88a70495cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/eee1774f-3d90-4af4-a5f2-8e88a70495cc_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07b0850>
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F3bf6b552-0272-4736-a9ab-dc4d25c442d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/3bf6b552-0272-4736-a9ab-dc4d25c442d8_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5
2025-12-02 19:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/80e5c6b5-b7c6-4cfa-a7f8-7bacfdfe7668_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117383402?view=catalogue)
2025-12-02 19:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71YJT/2025-11-28/image/320c20b8-2c5b-4794-aa54-d94392c01a65_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117220839?view=catalogue)
2025-12-02 19:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FH21ETU/2025-12-01/image/b5a4e6d7-b5af-4d09-9ea9-2496fc8f070f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117577591?view=catalogue)
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252Fb759e5b9-94cd-475d-bde3-9e64465096c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/b759e5b9-94cd-475d-bde3-9e64465096c4_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252Fa5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf085e9d0>
2025-12-02 19:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F19128cc3-aaa2-418f-a74a-dc5d3149e49e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/19128cc3-aaa2-418f-a74a-dc5d3149e49e_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 641d4232-3d98-5933-8db7-3d4c20144670
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0773e10>
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252Fff90ffb9-bea3-43f0-a5d3-9f64759856d7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ff90ffb9-bea3-43f0-a5d3-9f64759856d7_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef
2025-12-02 19:10:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116305284, 'registration': 'HV21ZTU', 'account': 'KIN032', 'make': 'SEAT', 'model': 'LEON ESTATE', 'derivative': '1.5 TSI EVO 150 Xcellence 5dr', 'mileage': 66595, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 239, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-06-27', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/d43d49d0-697b-4039-80d4-1e7b62a9eacc_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/bffda8b0-5b68-44b6-ad84-bd5b2b85f0b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ffa386e6-dbe9-4064-9a18-a419e81cc971_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/0cac893e-fade-44c9-8953-4ddc91b6f397_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/f0fae644-d3fc-4db5-a7eb-577caddbd7c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ba0f019c-2904-490e-bea0-236564b9b5c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/aa99ccc0-6331-4e88-ac48-97fbdd467c89_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/1979d0e2-f78c-41ea-9ae6-b8bf98e61c04_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/25 58K', 'remarks': 'VOSA STATES 47K 58K, Cruise control with speed limiter / Emergency tyre repair kit / Microsuede cloth - Soul black', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5db711e7-00fd-46df-85e7-098077ccfc7a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116305284, 'registration': 'HV21ZTU', 'account': 'KIN032', 'make': 'SEAT', 'model': 'LEON ESTATE', 'derivative': '1.5 TSI EVO 150 Xcellence 5dr', 'mileage': 66595, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 239, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-06-27', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/d43d49d0-697b-4039-80d4-1e7b62a9eacc_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/bffda8b0-5b68-44b6-ad84-bd5b2b85f0b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ffa386e6-dbe9-4064-9a18-a419e81cc971_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/0cac893e-fade-44c9-8953-4ddc91b6f397_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/f0fae644-d3fc-4db5-a7eb-577caddbd7c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ba0f019c-2904-490e-bea0-236564b9b5c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/aa99ccc0-6331-4e88-ac48-97fbdd467c89_removebg.jpg?w=600', 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/1979d0e2-f78c-41ea-9ae6-b8bf98e61c04_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/25 58K', 'remarks': 'VOSA STATES 47K 58K, Cruise control with speed limiter / Emergency tyre repair kit / Microsuede cloth - Soul black', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5db711e7-00fd-46df-85e7-098077ccfc7a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283bf0d5-6bad-50db-9564-14c39392202b with identifier: 116305284
2025-12-02 19:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283bf0d5-6bad-50db-9564-14c39392202b with scrape type 1
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 283bf0d5-6bad-50db-9564-14c39392202b
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Fd43d49d0-697b-4039-80d4-1e7b62a9eacc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/d43d49d0-697b-4039-80d4-1e7b62a9eacc_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT21YRD/2025-11-26/image/521e5277-44cf-4766-8bc1-439027450da2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381561?view=catalogue)
2025-12-02 19:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71YJT/2025-11-28/image/72983bef-defa-43be-99d6-6031c1a8d242_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117220839?view=catalogue)
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F73fce540-6955-453b-80f6-66b879a2a0a0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/73fce540-6955-453b-80f6-66b879a2a0a0_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252F99cf92a6-25d9-4441-96e0-4ef790699e89_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/99cf92a6-25d9-4441-96e0-4ef790699e89_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F95a286e6-ff6c-4142-9fd7-a99c072a0f88_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/95a286e6-ff6c-4142-9fd7-a99c072a0f88_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0879dd0>
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252F0668e358-91e0-42d6-82cf-07d3251b03d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/0668e358-91e0-42d6-82cf-07d3251b03d4_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03e6a50>
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252F0e7c6f79-bbd7-4812-8fb0-f227fae971ba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0e7c6f79-bbd7-4812-8fb0-f227fae971ba_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5
2025-12-02 19:10:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117407917, 'registration': 'EA72FJN', 'account': 'KIN032', 'make': 'MG MOTOR UK', 'model': 'ZS ELECTRIC HATCHBACK', 'derivative': '130kW Trophy Connect EV 51kWh 5dr Auto', 'mileage': 63012, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 208, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-17', 'fuel': 'Electric', 'motExpiry': '2026-11-16', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA72FJN/2025-11-28/image/a06905b8-3750-4800-8455-e5f999ea517a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/acebf158-867d-4064-816d-5025fdc24985_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/264a395a-0003-41d4-b6f2-e3b4b405ac6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/f554eda3-81c9-46a5-bb95-b9b45f4d073b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/d6e26e60-67bd-4138-85f9-27fc296b1c32_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/9b2120cb-3ca8-461d-9747-2393cb05580d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/4a05dc08-e28a-404c-b7d4-6e8b91fe4ace_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/d52336d1-3cab-4a04-9c28-e8f3b90fec33_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/23 15K', 'remarks': 'SPARE KEY, *Metallic - Black pearl, Hard Wired Dashcam / Leather - Black with contrast stitching / PP*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b9c5b4b6-83d4-46ee-a124-3a5d2413c6c5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117407917, 'registration': 'EA72FJN', 'account': 'KIN032', 'make': 'MG MOTOR UK', 'model': 'ZS ELECTRIC HATCHBACK', 'derivative': '130kW Trophy Connect EV 51kWh 5dr Auto', 'mileage': 63012, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 208, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-17', 'fuel': 'Electric', 'motExpiry': '2026-11-16', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA72FJN/2025-11-28/image/a06905b8-3750-4800-8455-e5f999ea517a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/acebf158-867d-4064-816d-5025fdc24985_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/264a395a-0003-41d4-b6f2-e3b4b405ac6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/f554eda3-81c9-46a5-bb95-b9b45f4d073b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/d6e26e60-67bd-4138-85f9-27fc296b1c32_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/9b2120cb-3ca8-461d-9747-2393cb05580d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/4a05dc08-e28a-404c-b7d4-6e8b91fe4ace_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72FJN/2025-11-28/image/d52336d1-3cab-4a04-9c28-e8f3b90fec33_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/23 15K', 'remarks': 'SPARE KEY, *Metallic - Black pearl, Hard Wired Dashcam / Leather - Black with contrast stitching / PP*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b9c5b4b6-83d4-46ee-a124-3a5d2413c6c5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba790056-2b52-50ec-be3a-985cc83fdb7d with identifier: 117407917
2025-12-02 19:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba790056-2b52-50ec-be3a-985cc83fdb7d with scrape type 2
2025-12-02 19:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba790056-2b52-50ec-be3a-985cc83fdb7d with scrape type 2
2025-12-02 19:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ba790056-2b52-50ec-be3a-985cc83fdb7d, identifier: 117407917
2025-12-02 19:10:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117140776, 'registration': 'HW72MSO', 'account': 'KIN032', 'make': 'BMW', 'model': 'I4 GRAN COUPE', 'derivative': '400kW M50 83.9kWh 5dr Auto', 'mileage': 34008, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 207, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-10', 'fuel': 'Electric', 'motExpiry': '2026-11-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HW72MSO/2025-11-28/image/c3f30bed-2d90-45a7-917f-c0d3c4ecc9b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/394d84c2-9af3-4563-99c0-3efea04822cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/7a136e95-48fb-4a71-99da-435a5fec2e04_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/af048de7-e135-4ff8-b114-aebfc44d3800_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/6e2405f7-426c-46a6-8bcc-c9f396f12342_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/216e46d6-ad6f-4cb6-ba12-4c701ce844e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/0533e941-dde8-4baf-8c02-481be634d1b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/2be9e962-33c1-4163-b4d3-411d3eba4d0e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY, VOSA STATES 33K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1e59d49d-29ae-481d-aa00-527d787254b5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117140776, 'registration': 'HW72MSO', 'account': 'KIN032', 'make': 'BMW', 'model': 'I4 GRAN COUPE', 'derivative': '400kW M50 83.9kWh 5dr Auto', 'mileage': 34008, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 217}, 'saleStart': '2025-12-04T10:00Z', 'lot': 207, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-10', 'fuel': 'Electric', 'motExpiry': '2026-11-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HW72MSO/2025-11-28/image/c3f30bed-2d90-45a7-917f-c0d3c4ecc9b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/394d84c2-9af3-4563-99c0-3efea04822cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/7a136e95-48fb-4a71-99da-435a5fec2e04_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/af048de7-e135-4ff8-b114-aebfc44d3800_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/6e2405f7-426c-46a6-8bcc-c9f396f12342_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/216e46d6-ad6f-4cb6-ba12-4c701ce844e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/0533e941-dde8-4baf-8c02-481be634d1b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HW72MSO/2025-11-28/image/2be9e962-33c1-4163-b4d3-411d3eba4d0e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY, VOSA STATES 33K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1e59d49d-29ae-481d-aa00-527d787254b5.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-02 19:10:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec30d10c-e2b3-50fb-9c44-10e45cf572ca with identifier: 117140776
2025-12-02 19:10:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec30d10c-e2b3-50fb-9c44-10e45cf572ca with scrape type 2
2025-12-02 19:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec30d10c-e2b3-50fb-9c44-10e45cf572ca with scrape type 2
2025-12-02 19:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec30d10c-e2b3-50fb-9c44-10e45cf572ca, identifier: 117140776
2025-12-02 19:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT71AYC/2025-11-27/image/f57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536701?view=catalogue)
2025-12-02 19:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/1b331f74-debc-4b69-9e04-e2527b97bc5d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117383402?view=catalogue)
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252Fc57870b0-1dcc-4699-b957-54989a4bb04c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/c57870b0-1dcc-4699-b957-54989a4bb04c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252F756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Fbffda8b0-5b68-44b6-ad84-bd5b2b85f0b7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/bffda8b0-5b68-44b6-ad84-bd5b2b85f0b7_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ba790056-2b52-50ec-be3a-985cc83fdb7d with identifier: 117407917
2025-12-02 19:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ba790056-2b52-50ec-be3a-985cc83fdb7d with identifier: 117407917
2025-12-02 19:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mg motor uk zs electric hatchback 130kw trophy connect ev 51kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'zs electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 63012, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-17', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407917', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '130kw trophy connect ev 51kwh 5dr auto', 'license_plate': 'ea72fjn', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ba790056-2b52-50ec-be3a-985cc83fdb7d', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'mg motor uk zs electric hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 101407} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'ba790056-2b52-50ec-be3a-985cc83fdb7d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ea72fjn',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407917',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk zs electric hatchback',
     'model': 'zs electric hatchback',
     'odometer': 63012,
     'odometer_in_km': 101407,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-17',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'kinto',
     'title': 'mg motor uk zs electric hatchback 130kw trophy connect ev '
              '51kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '130kw trophy connect ev 51kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: ba790056-2b52-50ec-be3a-985cc83fdb7d spider: astonbarclay.gb
2025-12-02 19:10:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ba790056-2b52-50ec-be3a-985cc83fdb7d due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mg motor uk zs electric hatchback 130kw trophy connect ev 51kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'zs electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 63012, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-17', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407917', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '130kw trophy connect ev 51kwh 5dr auto', 'license_plate': 'ea72fjn', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ba790056-2b52-50ec-be3a-985cc83fdb7d', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'mg motor uk zs electric hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 101407} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'ba790056-2b52-50ec-be3a-985cc83fdb7d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ea72fjn',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407917',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk zs electric hatchback',
     'model': 'zs electric hatchback',
     'odometer': 63012,
     'odometer_in_km': 101407,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-17',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'kinto',
     'title': 'mg motor uk zs electric hatchback 130kw trophy connect ev '
              '51kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '130kw trophy connect ev 51kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'ba790056-2b52-50ec-be3a-985cc83fdb7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'EA72FJN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407917',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MG MOTOR UK',
 'model': 'ZS ELECTRIC HATCHBACK',
 'odometer': 63012,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seller_name': 'Kinto',
 'title': 'MG MOTOR UK ZS ELECTRIC HATCHBACK 130kW Trophy Connect EV 51kWh 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '130kW Trophy Connect EV 51kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407917%27 HTTP/1.1" 200 None
2025-12-02 19:10:12 [astonbarclay.gb] INFO: Saving data for 117407917: {'auction_closing_time': 1764842400.0, 'created_time': 1764356601.178394, 'last_price_update_time': 1764702612.383285}
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117407917') HTTP/1.1" 204 0
2025-12-02 19:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec30d10c-e2b3-50fb-9c44-10e45cf572ca with identifier: 117140776
2025-12-02 19:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec30d10c-e2b3-50fb-9c44-10e45cf572ca with identifier: 117140776
2025-12-02 19:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'bmw i4 gran coupe 400kw m50 83.9kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i4 gran coupe', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 34008, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117140776', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '400kw m50 83.9kwh 5dr auto', 'license_plate': 'hw72mso', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ec30d10c-e2b3-50fb-9c44-10e45cf572ca', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'bmw i4 gran coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 54730} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'ec30d10c-e2b3-50fb-9c44-10e45cf572ca',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'hw72mso',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117140776',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw i4 gran coupe',
     'model': 'i4 gran coupe',
     'odometer': 34008,
     'odometer_in_km': 54730,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-10',
     'sanitized_make': 'bmw',
     'seller_name': 'kinto',
     'title': 'bmw i4 gran coupe 400kw m50 83.9kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '400kw m50 83.9kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-02 19:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: ec30d10c-e2b3-50fb-9c44-10e45cf572ca spider: astonbarclay.gb
2025-12-02 19:10:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ec30d10c-e2b3-50fb-9c44-10e45cf572ca due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'bmw i4 gran coupe 400kw m50 83.9kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'i4 gran coupe', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 34008, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117140776', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '400kw m50 83.9kwh 5dr auto', 'license_plate': 'hw72mso', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ec30d10c-e2b3-50fb-9c44-10e45cf572ca', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'bmw i4 gran coupe', 'sanitized_make': 'bmw', 'odometer_in_km': 54730} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'ec30d10c-e2b3-50fb-9c44-10e45cf572ca',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'hw72mso',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117140776',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw i4 gran coupe',
     'model': 'i4 gran coupe',
     'odometer': 34008,
     'odometer_in_km': 54730,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-10',
     'sanitized_make': 'bmw',
     'seller_name': 'kinto',
     'title': 'bmw i4 gran coupe 400kw m50 83.9kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '400kw m50 83.9kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'ec30d10c-e2b3-50fb-9c44-10e45cf572ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'HW72MSO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117140776',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': 'I4 GRAN COUPE',
 'odometer': 34008,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': 'Kinto',
 'title': 'BMW I4 GRAN COUPE 400kW M50 83.9kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '400kW M50 83.9kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140776%27 HTTP/1.1" 200 None
2025-12-02 19:10:12 [astonbarclay.gb] INFO: Saving data for 117140776: {'auction_closing_time': 1764842400.0, 'created_time': 1764356598.26956, 'last_price_update_time': 1764702612.605809}
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117140776') HTTP/1.1" 204 0
2025-12-02 19:10:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03b9990>
2025-12-02 19:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252Ffe4fb5bd-8109-4fce-8de5-9c7080c271fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/fe4fb5bd-8109-4fce-8de5-9c7080c271fb_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef
2025-12-02 19:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71KWK/2025-11-26/image/93b18e2f-ec66-4df7-b939-ab58125d28dd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429174?view=catalogue)
2025-12-02 19:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT21YRD/2025-11-26/image/9150b06a-7d7f-4a6e-a524-559f283ff188_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381561?view=catalogue)
2025-12-02 19:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71FGG/2025-11-06/image/1158b840-9028-478a-84f1-61ee0e1f10fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116995130?view=catalogue)
2025-12-02 19:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71YJT/2025-11-28/image/e8f69fbd-0e61-4bbc-968a-14d311ba94fd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117220839?view=catalogue)
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F345d8be4-b289-45f9-8a1f-0159a4fea2e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/345d8be4-b289-45f9-8a1f-0159a4fea2e6_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252Fb65d3236-047b-4e78-a06f-df5b971db80a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/b65d3236-047b-4e78-a06f-df5b971db80a_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F907838d0-b377-4ee2-85dd-5557a8ab829c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/907838d0-b377-4ee2-85dd-5557a8ab829c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf09194d0>
2025-12-02 19:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252F80e5c6b5-b7c6-4cfa-a7f8-7bacfdfe7668_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/80e5c6b5-b7c6-4cfa-a7f8-7bacfdfe7668_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf099b810>
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F320c20b8-2c5b-4794-aa54-d94392c01a65_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/320c20b8-2c5b-4794-aa54-d94392c01a65_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 641d4232-3d98-5933-8db7-3d4c20144670
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0666710>
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFH21ETU%252F2025-12-01%252Fimage%252Fb5a4e6d7-b5af-4d09-9ea9-2496fc8f070f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FH21ETU/2025-12-01/image/b5a4e6d7-b5af-4d09-9ea9-2496fc8f070f_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5
2025-12-02 19:10:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57b37d27-1b6f-5649-815f-6b1a139a8ed5, skipping ID generation
2025-12-02 19:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5 with scrape type 1
2025-12-02 19:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 57b37d27-1b6f-5649-815f-6b1a139a8ed5 from tracking dictionaries
2025-12-02 19:10:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57b37d27-1b6f-5649-815f-6b1a139a8ed5 sending to next pipeline
2025-12-02 19:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 57b37d27-1b6f-5649-815f-6b1a139a8ed5, identifier: 117577591
2025-12-02 19:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71FGG/2025-11-06/image/97fdb768-64b7-4885-8df7-77d5e26a8680_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116995130?view=catalogue)
2025-12-02 19:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71KWK/2025-11-26/image/e163278a-9978-4f4b-a97a-0c355ae43f11_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429174?view=catalogue)
2025-12-02 19:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/9eb115dd-03cf-47fb-8b3a-74fdec7881c9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117383402?view=catalogue)
2025-12-02 19:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT71AYC/2025-11-27/image/ecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536701?view=catalogue)
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252F71158325-2b72-45a9-bc34-438eea0ba676_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/71158325-2b72-45a9-bc34-438eea0ba676_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252Fbb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/bb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Fffa386e6-dbe9-4064-9a18-a419e81cc971_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ffa386e6-dbe9-4064-9a18-a419e81cc971_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 57b37d27-1b6f-5649-815f-6b1a139a8ed5 with identifier: 117577591
2025-12-02 19:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 57b37d27-1b6f-5649-815f-6b1a139a8ed5 with identifier: 117577591
2025-12-02 19:10:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 57b37d27-1b6f-5649-815f-6b1a139a8ed5 with identifier: 117577591 to the API
2025-12-02 19:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FH21ETU/2025-12-01/image/b5a4e6d7-b5af-4d09-9ea9-2496fc8f070f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '57b37d27-1b6f-5649-815f-6b1a139a8ed5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FH21ETU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117577591',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 45330,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31820,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/603a8b43-b975-4877-98c2-830cbdd23aaa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32228,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/1a92524b-0aa3-4ab2-ad6e-096ad8c5170b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29465,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/5659703a-03ef-44d1-9f62-2a8a5d093878_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29713,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/58d6cc17-40f0-4c9f-84ca-83ae647105dc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46445,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0693eca2-1bdb-4b73-b12e-d09f6e47a69b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59737,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/3bf6b552-0272-4736-a9ab-dc4d25c442d8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36839,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/0e7c6f79-bbd7-4812-8fb0-f227fae971ba_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b37d27-1b6f-5649-815f-6b1a139a8ed5/57b37d27-1b6f-5649-815f-6b1a139a8ed5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59332,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FH21ETU/2025-12-01/image/b5a4e6d7-b5af-4d09-9ea9-2496fc8f070f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-08',
 'seller_name': 'Zenith',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 116d SE 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '116d SE 5dr Step Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117577591%27 HTTP/1.1" 200 None
2025-12-02 19:10:14 [astonbarclay.gb] INFO: Saving data for 117577591: {'created_time': 1764702614.109437, 'last_price_update_time': 1764702614.109446, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117577591') HTTP/1.1" 204 0
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06cc090>
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252F521e5277-44cf-4766-8bc1-439027450da2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/521e5277-44cf-4766-8bc1-439027450da2_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06ae950>
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F72983bef-defa-43be-99d6-6031c1a8d242_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/72983bef-defa-43be-99d6-6031c1a8d242_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 641d4232-3d98-5933-8db7-3d4c20144670
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252Fd3fb8524-6130-4d58-b436-52d8d7998648_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/d3fb8524-6130-4d58-b436-52d8d7998648_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252F709d13ed-77df-4852-96e0-102b111e72bf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/709d13ed-77df-4852-96e0-102b111e72bf_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252Fcaca6e59-a38e-4021-bec1-39a0d1593cad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/caca6e59-a38e-4021-bec1-39a0d1593cad_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03e10d0>
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252Ff57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/f57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ef9d0ba-8596-5781-8113-6a23560ff892
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf034be10>
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252F1b331f74-debc-4b69-9e04-e2527b97bc5d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/1b331f74-debc-4b69-9e04-e2527b97bc5d_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c
2025-12-02 19:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536701?view=catalogue)
2025-12-02 19:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/d43d49d0-697b-4039-80d4-1e7b62a9eacc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116305284?view=catalogue)
2025-12-02 19:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT21YRD/2025-11-26/image/a97a20c1-840f-408c-a786-39af0f11c178_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117381561?view=catalogue)
2025-12-02 19:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71YJT/2025-11-28/image/6678538a-e926-4b67-adab-7fbe49361d38_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117220839?view=catalogue)
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252F4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252F0cac893e-fade-44c9-8953-4ddc91b6f397_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/0cac893e-fade-44c9-8953-4ddc91b6f397_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06a20d0>
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252F93b18e2f-ec66-4df7-b939-ab58125d28dd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/93b18e2f-ec66-4df7-b939-ab58125d28dd_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99beba97-1913-5102-8e25-4e317b739c26
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0378710>
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252F9150b06a-7d7f-4a6e-a524-559f283ff188_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/9150b06a-7d7f-4a6e-a524-559f283ff188_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0585410>
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F1158b840-9028-478a-84f1-61ee0e1f10fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/1158b840-9028-478a-84f1-61ee0e1f10fb_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0379c50>
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252Fe8f69fbd-0e61-4bbc-968a-14d311ba94fd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/e8f69fbd-0e61-4bbc-968a-14d311ba94fd_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 641d4232-3d98-5933-8db7-3d4c20144670
2025-12-02 19:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71KWK/2025-11-26/image/99cf92a6-25d9-4441-96e0-4ef790699e89_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429174?view=catalogue)
2025-12-02 19:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71FGG/2025-11-06/image/95a286e6-ff6c-4142-9fd7-a99c072a0f88_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116995130?view=catalogue)
2025-12-02 19:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/b759e5b9-94cd-475d-bde3-9e64465096c4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117383402?view=catalogue)
2025-12-02 19:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71YJT/2025-11-28/image/73fce540-6955-453b-80f6-66b879a2a0a0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117220839?view=catalogue)
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252F5e1b628d-2acb-4fab-920e-087f1e35f2d3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/5e1b628d-2acb-4fab-920e-087f1e35f2d3_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F9ab138e3-e31e-43a6-a3b6-bc91911417b8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/9ab138e3-e31e-43a6-a3b6-bc91911417b8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf098fa50>
2025-12-02 19:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F97fdb768-64b7-4885-8df7-77d5e26a8680_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/97fdb768-64b7-4885-8df7-77d5e26a8680_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0998550>
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252Fe163278a-9978-4f4b-a97a-0c355ae43f11_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/e163278a-9978-4f4b-a97a-0c355ae43f11_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99beba97-1913-5102-8e25-4e317b739c26
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0425650>
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252F9eb115dd-03cf-47fb-8b3a-74fdec7881c9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/9eb115dd-03cf-47fb-8b3a-74fdec7881c9_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1d2bfd0>
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252Fecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/ecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ef9d0ba-8596-5781-8113-6a23560ff892
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252F573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Ff0fae644-d3fc-4db5-a7eb-577caddbd7c1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/f0fae644-d3fc-4db5-a7eb-577caddbd7c1_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/bffda8b0-5b68-44b6-ad84-bd5b2b85f0b7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116305284?view=catalogue)
2025-12-02 19:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71FGG/2025-11-06/image/907838d0-b377-4ee2-85dd-5557a8ab829c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116995130?view=catalogue)
2025-12-02 19:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/c57870b0-1dcc-4699-b957-54989a4bb04c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117383402?view=catalogue)
2025-12-02 19:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT71AYC/2025-11-27/image/756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536701?view=catalogue)
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252Fcf893de7-56c7-4b28-b290-42ba98251a08_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/cf893de7-56c7-4b28-b290-42ba98251a08_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252Fae4eafb6-1fc5-4037-b242-8c690a2929a8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/ae4eafb6-1fc5-4037-b242-8c690a2929a8_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07c23d0>
2025-12-02 19:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252Fa5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ef9d0ba-8596-5781-8113-6a23560ff892
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ec110>
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Fd43d49d0-697b-4039-80d4-1e7b62a9eacc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/d43d49d0-697b-4039-80d4-1e7b62a9eacc_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 283bf0d5-6bad-50db-9564-14c39392202b
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1ef41d0>
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT21YRD%252F2025-11-26%252Fimage%252Fa97a20c1-840f-408c-a786-39af0f11c178_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT21YRD/2025-11-26/image/a97a20c1-840f-408c-a786-39af0f11c178_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef
2025-12-02 19:10:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef, skipping ID generation
2025-12-02 19:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef with scrape type 1
2025-12-02 19:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef from tracking dictionaries
2025-12-02 19:10:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef sending to next pipeline
2025-12-02 19:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef, identifier: 117381561
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0339510>
2025-12-02 19:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F6678538a-e926-4b67-adab-7fbe49361d38_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/6678538a-e926-4b67-adab-7fbe49361d38_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 641d4232-3d98-5933-8db7-3d4c20144670
2025-12-02 19:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71KWK/2025-11-26/image/b65d3236-047b-4e78-a06f-df5b971db80a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429174?view=catalogue)
2025-12-02 19:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT71AYC/2025-11-27/image/bb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536701?view=catalogue)
2025-12-02 19:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ffa386e6-dbe9-4064-9a18-a419e81cc971_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116305284?view=catalogue)
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252Fa30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Fba0f019c-2904-490e-bea0-236564b9b5c5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ba0f019c-2904-490e-bea0-236564b9b5c5_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef with identifier: 117381561
2025-12-02 19:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef with identifier: 117381561
2025-12-02 19:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef with identifier: 117381561 to the API
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BT21YRD/2025-11-26/image/a97a20c1-840f-408c-a786-39af0f11c178_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BT21YRD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117381561',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FORD',
 'model': 'FOCUS DIESEL HATCHBACK',
 'odometer': 70028,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25731,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/3193c2cb-ccd0-4f2e-b52f-389eac7292d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28384,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ad381034-3890-49d1-9148-6a7bd5f1ba3d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24895,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/cf0678df-3a46-4ea0-9c31-910acbe20124_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26774,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/ff90ffb9-bea3-43f0-a5d3-9f64759856d7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43573,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/fe4fb5bd-8109-4fce-8de5-9c7080c271fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42970,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/521e5277-44cf-4766-8bc1-439027450da2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37277,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/9150b06a-7d7f-4a6e-a524-559f283ff188_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef/c33ca9a8-1a9a-5b0b-b0c9-1d09044a4cef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42880,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BT21YRD/2025-11-26/image/a97a20c1-840f-408c-a786-39af0f11c178_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-02',
 'seller_name': 'Zenith',
 'title': 'FORD FOCUS DIESEL HATCHBACK 1.5 EcoBlue 120 Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBlue 120 Zetec 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381561%27 HTTP/1.1" 200 None
2025-12-02 19:10:18 [astonbarclay.gb] INFO: Saving data for 117381561: {'created_time': 1764702618.50092, 'last_price_update_time': 1764702618.50093, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117381561') HTTP/1.1" 204 0
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf06d4550>
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252F99cf92a6-25d9-4441-96e0-4ef790699e89_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/99cf92a6-25d9-4441-96e0-4ef790699e89_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99beba97-1913-5102-8e25-4e317b739c26
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0667610>
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F95a286e6-ff6c-4142-9fd7-a99c072a0f88_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/95a286e6-ff6c-4142-9fd7-a99c072a0f88_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0667010>
2025-12-02 19:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252Fb759e5b9-94cd-475d-bde3-9e64465096c4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/b759e5b9-94cd-475d-bde3-9e64465096c4_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf07ab150>
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F73fce540-6955-453b-80f6-66b879a2a0a0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/73fce540-6955-453b-80f6-66b879a2a0a0_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 641d4232-3d98-5933-8db7-3d4c20144670
2025-12-02 19:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71YJT/2025-11-28/image/345d8be4-b289-45f9-8a1f-0159a4fea2e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117220839?view=catalogue)
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252F2f42f206-49bd-4fe2-829b-1536fb085e4c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/2f42f206-49bd-4fe2-829b-1536fb085e4c_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F19bba388-f361-48ad-b883-7f5d4dcc548e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/19bba388-f361-48ad-b883-7f5d4dcc548e_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/71158325-2b72-45a9-bc34-438eea0ba676_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117383402?view=catalogue)
2025-12-02 19:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71FGG/2025-11-06/image/caca6e59-a38e-4021-bec1-39a0d1593cad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116995130?view=catalogue)
2025-12-02 19:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71KWK/2025-11-26/image/709d13ed-77df-4852-96e0-102b111e72bf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429174?view=catalogue)
2025-12-02 19:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO71YJT/2025-11-28/image/d3fb8524-6130-4d58-b436-52d8d7998648_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117220839?view=catalogue)
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Faa99ccc0-6331-4e88-ac48-97fbdd467c89_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/aa99ccc0-6331-4e88-ac48-97fbdd467c89_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf046bbd0>
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Fbffda8b0-5b68-44b6-ad84-bd5b2b85f0b7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/bffda8b0-5b68-44b6-ad84-bd5b2b85f0b7_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 283bf0d5-6bad-50db-9564-14c39392202b
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0318510>
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F907838d0-b377-4ee2-85dd-5557a8ab829c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/907838d0-b377-4ee2-85dd-5557a8ab829c_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf067e2d0>
2025-12-02 19:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252Fc57870b0-1dcc-4699-b957-54989a4bb04c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/c57870b0-1dcc-4699-b957-54989a4bb04c_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ce250>
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252F756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ef9d0ba-8596-5781-8113-6a23560ff892
2025-12-02 19:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/0cac893e-fade-44c9-8953-4ddc91b6f397_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116305284?view=catalogue)
2025-12-02 19:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT71AYC/2025-11-27/image/4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536701?view=catalogue)
2025-12-02 19:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71FGG/2025-11-06/image/9ab138e3-e31e-43a6-a3b6-bc91911417b8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116995130?view=catalogue)
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252F1979d0e2-f78c-41ea-9ae6-b8bf98e61c04_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-02 19:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/1979d0e2-f78c-41ea-9ae6-b8bf98e61c04_removebg.jpg?w=600 not downloaded yet
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0772910>
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252Fb65d3236-047b-4e78-a06f-df5b971db80a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/b65d3236-047b-4e78-a06f-df5b971db80a_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99beba97-1913-5102-8e25-4e317b739c26
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf02f2d90>
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252Fbb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/bb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ef9d0ba-8596-5781-8113-6a23560ff892
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf038e790>
2025-12-02 19:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Fffa386e6-dbe9-4064-9a18-a419e81cc971_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ffa386e6-dbe9-4064-9a18-a419e81cc971_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 283bf0d5-6bad-50db-9564-14c39392202b
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0395350>
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252F345d8be4-b289-45f9-8a1f-0159a4fea2e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/345d8be4-b289-45f9-8a1f-0159a4fea2e6_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 641d4232-3d98-5933-8db7-3d4c20144670
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0519850>
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO70ZYE%252F2025-11-26%252Fimage%252F71158325-2b72-45a9-bc34-438eea0ba676_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/71158325-2b72-45a9-bc34-438eea0ba676_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c
2025-12-02 19:10:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11e7b736-65b4-565c-a173-ae5c8ad6be2c, skipping ID generation
2025-12-02 19:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c with scrape type 1
2025-12-02 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 11e7b736-65b4-565c-a173-ae5c8ad6be2c from tracking dictionaries
2025-12-02 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11e7b736-65b4-565c-a173-ae5c8ad6be2c sending to next pipeline
2025-12-02 19:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 11e7b736-65b4-565c-a173-ae5c8ad6be2c, identifier: 117383402
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ed810>
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252Fcaca6e59-a38e-4021-bec1-39a0d1593cad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/caca6e59-a38e-4021-bec1-39a0d1593cad_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0a9ea90>
2025-12-02 19:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252F709d13ed-77df-4852-96e0-102b111e72bf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/709d13ed-77df-4852-96e0-102b111e72bf_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99beba97-1913-5102-8e25-4e317b739c26
2025-12-02 19:10:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05ec7d0>
2025-12-02 19:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO71YJT%252F2025-11-28%252Fimage%252Fd3fb8524-6130-4d58-b436-52d8d7998648_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO71YJT/2025-11-28/image/d3fb8524-6130-4d58-b436-52d8d7998648_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 641d4232-3d98-5933-8db7-3d4c20144670
2025-12-02 19:10:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 641d4232-3d98-5933-8db7-3d4c20144670, skipping ID generation
2025-12-02 19:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 641d4232-3d98-5933-8db7-3d4c20144670 with scrape type 1
2025-12-02 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 641d4232-3d98-5933-8db7-3d4c20144670 from tracking dictionaries
2025-12-02 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 641d4232-3d98-5933-8db7-3d4c20144670 sending to next pipeline
2025-12-02 19:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 641d4232-3d98-5933-8db7-3d4c20144670, identifier: 117220839
2025-12-02 19:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/f0fae644-d3fc-4db5-a7eb-577caddbd7c1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116305284?view=catalogue)
2025-12-02 19:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT71AYC/2025-11-27/image/573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536701?view=catalogue)
2025-12-02 19:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71KWK/2025-11-26/image/5e1b628d-2acb-4fab-920e-087f1e35f2d3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429174?view=catalogue)
2025-12-02 19:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71FGG/2025-11-06/image/ae4eafb6-1fc5-4037-b242-8c690a2929a8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116995130?view=catalogue)
2025-12-02 19:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71KWK/2025-11-26/image/cf893de7-56c7-4b28-b290-42ba98251a08_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429174?view=catalogue)
2025-12-02 19:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ba0f019c-2904-490e-bea0-236564b9b5c5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116305284?view=catalogue)
2025-12-02 19:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536701?view=catalogue)
2025-12-02 19:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 11e7b736-65b4-565c-a173-ae5c8ad6be2c with identifier: 117383402
2025-12-02 19:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 11e7b736-65b4-565c-a173-ae5c8ad6be2c with identifier: 117383402
2025-12-02 19:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176316 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176316
2025-12-02 19:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 11e7b736-65b4-565c-a173-ae5c8ad6be2c spider: astonbarclay.gb
2025-12-02 19:10:22 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 11e7b736-65b4-565c-a173-ae5c8ad6be2c due to rule: high_mileage_for_country.json, error: 176316 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176316
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '11e7b736-65b4-565c-a173-ae5c8ad6be2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AO70ZYE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117383402',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 109558,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32715,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/eee1774f-3d90-4af4-a5f2-8e88a70495cc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33663,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/0668e358-91e0-42d6-82cf-07d3251b03d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33343,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/80e5c6b5-b7c6-4cfa-a7f8-7bacfdfe7668_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33279,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/1b331f74-debc-4b69-9e04-e2527b97bc5d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51006,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/9eb115dd-03cf-47fb-8b3a-74fdec7881c9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63819,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/b759e5b9-94cd-475d-bde3-9e64465096c4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 11695,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/c57870b0-1dcc-4699-b957-54989a4bb04c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e7b736-65b4-565c-a173-ae5c8ad6be2c/11e7b736-65b4-565c-a173-ae5c8ad6be2c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62865,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO70ZYE/2025-11-26/image/71158325-2b72-45a9-bc34-438eea0ba676_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seller_name': 'Zenith',
 'title': 'BMW 3 SERIES SALOON 330e SE Pro 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e SE Pro 4dr Step Auto',
 'vin': None,
 'year': 2020}
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117383402%27 HTTP/1.1" 200 None
2025-12-02 19:10:22 [astonbarclay.gb] INFO: Saving data for 117383402: {'created_time': 1764702622.706733, 'last_price_update_time': 1764702622.706743, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117383402') HTTP/1.1" 204 0
2025-12-02 19:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 641d4232-3d98-5933-8db7-3d4c20144670 with identifier: 117220839
2025-12-02 19:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 641d4232-3d98-5933-8db7-3d4c20144670 with identifier: 117220839
2025-12-02 19:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 641d4232-3d98-5933-8db7-3d4c20144670 with identifier: 117220839 to the API
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AO71YJT/2025-11-28/image/d3fb8524-6130-4d58-b436-52d8d7998648_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '641d4232-3d98-5933-8db7-3d4c20144670',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AO71YJT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117220839',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 74476,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32422,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/19128cc3-aaa2-418f-a74a-dc5d3149e49e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31779,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/320c20b8-2c5b-4794-aa54-d94392c01a65_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32327,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/72983bef-defa-43be-99d6-6031c1a8d242_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32132,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/e8f69fbd-0e61-4bbc-968a-14d311ba94fd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47907,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/6678538a-e926-4b67-adab-7fbe49361d38_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60753,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/73fce540-6955-453b-80f6-66b879a2a0a0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42126,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/345d8be4-b289-45f9-8a1f-0159a4fea2e6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641d4232-3d98-5933-8db7-3d4c20144670/641d4232-3d98-5933-8db7-3d4c20144670_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61177,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO71YJT/2025-11-28/image/d3fb8524-6130-4d58-b436-52d8d7998648_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': 'Zenith',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 118d SE 5dr [Live Cockpit '
          'Professional]',
 'transmission': 'manual',
 'trim': '118d SE 5dr [Live Cockpit Professional]',
 'vin': None,
 'year': 2021}
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117220839%27 HTTP/1.1" 200 None
2025-12-02 19:10:23 [astonbarclay.gb] INFO: Saving data for 117220839: {'created_time': 1764702623.050276, 'last_price_update_time': 1764702623.050295, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117220839') HTTP/1.1" 204 0
2025-12-02 19:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71FGG/2025-11-06/image/19bba388-f361-48ad-b883-7f5d4dcc548e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116995130?view=catalogue)
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0425990>
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252F0cac893e-fade-44c9-8953-4ddc91b6f397_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/0cac893e-fade-44c9-8953-4ddc91b6f397_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 283bf0d5-6bad-50db-9564-14c39392202b
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf080d150>
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252F4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ef9d0ba-8596-5781-8113-6a23560ff892
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05cced0>
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F9ab138e3-e31e-43a6-a3b6-bc91911417b8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/9ab138e3-e31e-43a6-a3b6-bc91911417b8_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642
2025-12-02 19:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LD71KWK/2025-11-26/image/2f42f206-49bd-4fe2-829b-1536fb085e4c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117429174?view=catalogue)
2025-12-02 19:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/aa99ccc0-6331-4e88-ac48-97fbdd467c89_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116305284?view=catalogue)
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf05cff90>
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Ff0fae644-d3fc-4db5-a7eb-577caddbd7c1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/f0fae644-d3fc-4db5-a7eb-577caddbd7c1_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 283bf0d5-6bad-50db-9564-14c39392202b
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf069e210>
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252F573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ef9d0ba-8596-5781-8113-6a23560ff892
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf0426a50>
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252F5e1b628d-2acb-4fab-920e-087f1e35f2d3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/5e1b628d-2acb-4fab-920e-087f1e35f2d3_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99beba97-1913-5102-8e25-4e317b739c26
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03f6a10>
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252Fae4eafb6-1fc5-4037-b242-8c690a2929a8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/ae4eafb6-1fc5-4037-b242-8c690a2929a8_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf069d5d0>
2025-12-02 19:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252Fcf893de7-56c7-4b28-b290-42ba98251a08_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/cf893de7-56c7-4b28-b290-42ba98251a08_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99beba97-1913-5102-8e25-4e317b739c26
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf044edd0>
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Fba0f019c-2904-490e-bea0-236564b9b5c5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ba0f019c-2904-490e-bea0-236564b9b5c5_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 283bf0d5-6bad-50db-9564-14c39392202b
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf032d450>
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBT71AYC%252F2025-11-27%252Fimage%252Fa30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ef9d0ba-8596-5781-8113-6a23560ff892
2025-12-02 19:10:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ef9d0ba-8596-5781-8113-6a23560ff892, skipping ID generation
2025-12-02 19:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef9d0ba-8596-5781-8113-6a23560ff892 with scrape type 1
2025-12-02 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3ef9d0ba-8596-5781-8113-6a23560ff892 from tracking dictionaries
2025-12-02 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ef9d0ba-8596-5781-8113-6a23560ff892 sending to next pipeline
2025-12-02 19:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3ef9d0ba-8596-5781-8113-6a23560ff892, identifier: 117536701
2025-12-02 19:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/1979d0e2-f78c-41ea-9ae6-b8bf98e61c04_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116305284?view=catalogue)
2025-12-02 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3ef9d0ba-8596-5781-8113-6a23560ff892 with identifier: 117536701
2025-12-02 19:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3ef9d0ba-8596-5781-8113-6a23560ff892 with identifier: 117536701
2025-12-02 19:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'skoda enyaq iv estate 132kw 60 suite nav 62kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'enyaq iv estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 40618, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-22', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117536701', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '132kw 60 suite nav 62kwh 5dr auto', 'license_plate': 'bt71ayc', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '3ef9d0ba-8596-5781-8113-6a23560ff892', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/f57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32944}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/ecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32833}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30591}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33243}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/bb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52075}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56933}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 63015}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59808}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'skoda enyaq iv estate', 'sanitized_make': 'skoda', 'odometer_in_km': 65368} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '3ef9d0ba-8596-5781-8113-6a23560ff892',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'bt71ayc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117536701',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'skoda',
     'make_model': 'skoda enyaq iv estate',
     'model': 'enyaq iv estate',
     'odometer': 40618,
     'odometer_in_km': 65368,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32944,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/f57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32833,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/ecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30591,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33243,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52075,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/bb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56933,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63015,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59808,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-22',
     'sanitized_make': 'skoda',
     'seller_name': 'zenith',
     'title': 'skoda enyaq iv estate 132kw 60 suite nav 62kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '132kw 60 suite nav 62kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-02 19:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 3ef9d0ba-8596-5781-8113-6a23560ff892 spider: astonbarclay.gb
2025-12-02 19:10:25 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 3ef9d0ba-8596-5781-8113-6a23560ff892 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'skoda enyaq iv estate 132kw 60 suite nav 62kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'enyaq iv estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 40618, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-22', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117536701', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '132kw 60 suite nav 62kwh 5dr auto', 'license_plate': 'bt71ayc', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '3ef9d0ba-8596-5781-8113-6a23560ff892', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/f57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32944}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/ecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32833}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30591}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33243}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/bb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52075}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56933}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 63015}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59808}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'skoda enyaq iv estate', 'sanitized_make': 'skoda', 'odometer_in_km': 65368} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '3ef9d0ba-8596-5781-8113-6a23560ff892',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'bt71ayc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117536701',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'skoda',
     'make_model': 'skoda enyaq iv estate',
     'model': 'enyaq iv estate',
     'odometer': 40618,
     'odometer_in_km': 65368,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32944,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/f57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32833,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/ecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30591,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33243,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52075,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/bb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56933,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63015,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59808,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-22',
     'sanitized_make': 'skoda',
     'seller_name': 'zenith',
     'title': 'skoda enyaq iv estate 132kw 60 suite nav 62kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '132kw 60 suite nav 62kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '3ef9d0ba-8596-5781-8113-6a23560ff892',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BT71AYC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117536701',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SKODA',
 'model': 'ENYAQ IV ESTATE',
 'odometer': 40618,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32944,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/f57b0e18-6819-44ff-be55-ad1cc9f93546_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32833,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/ecd2558e-140f-433d-976a-fbc4fd1a6648_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30591,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a5a0f287-577c-4e32-b3eb-cc06fc5c9192_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33243,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/756bb6e0-4db3-4684-a9b5-99667d610778_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52075,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/bb570f0c-9e0c-4aa5-8f8c-7be61a25d632_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56933,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/4a013d12-e0e6-4724-878e-2e47714bfec9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63015,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/573c0bf5-365f-4297-829d-1ff72cc5faf9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef9d0ba-8596-5781-8113-6a23560ff892/3ef9d0ba-8596-5781-8113-6a23560ff892_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59808,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BT71AYC/2025-11-27/image/a30831fe-5cc5-4c62-80f2-7fd7df0f1772_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seller_name': 'Zenith',
 'title': 'SKODA ENYAQ IV ESTATE 132kW 60 Suite Nav 62kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '132kW 60 Suite Nav 62kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117536701%27 HTTP/1.1" 200 None
2025-12-02 19:10:25 [astonbarclay.gb] INFO: Saving data for 117536701: {'created_time': 1764702625.898483, 'last_price_update_time': 1764702625.898492, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117536701') HTTP/1.1" 204 0
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf032d450>
2025-12-02 19:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 19:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71FGG%252F2025-11-06%252Fimage%252F19bba388-f361-48ad-b883-7f5d4dcc548e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71FGG/2025-11-06/image/19bba388-f361-48ad-b883-7f5d4dcc548e_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642
2025-12-02 19:10:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642, skipping ID generation
2025-12-02 19:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642 with scrape type 1
2025-12-02 19:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642 from tracking dictionaries
2025-12-02 19:10:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642 sending to next pipeline
2025-12-02 19:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642, identifier: 116995130
2025-12-02 19:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642 with identifier: 116995130
2025-12-02 19:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642 with identifier: 116995130
2025-12-02 19:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3a3fdbb5-7de1-5090-bc1e-cfae6eaea642 with identifier: 116995130 to the API
2025-12-02 19:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/OV71FGG/2025-11-06/image/19bba388-f361-48ad-b883-7f5d4dcc548e_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '3a3fdbb5-7de1-5090-bc1e-cfae6eaea642',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OV71FGG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116995130',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SKODA',
 'model': 'OCTAVIA ESTATE',
 'odometer': 83899,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29713,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/1158b840-9028-478a-84f1-61ee0e1f10fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26897,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/97fdb768-64b7-4885-8df7-77d5e26a8680_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30711,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/95a286e6-ff6c-4142-9fd7-a99c072a0f88_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30464,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/907838d0-b377-4ee2-85dd-5557a8ab829c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46390,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/caca6e59-a38e-4021-bec1-39a0d1593cad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37953,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/9ab138e3-e31e-43a6-a3b6-bc91911417b8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59228,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/ae4eafb6-1fc5-4037-b242-8c690a2929a8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a3fdbb5-7de1-5090-bc1e-cfae6eaea642/3a3fdbb5-7de1-5090-bc1e-cfae6eaea642_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50520,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71FGG/2025-11-06/image/19bba388-f361-48ad-b883-7f5d4dcc548e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seller_name': 'Kinto',
 'title': 'SKODA OCTAVIA ESTATE 1.4 TSI iV SE Technology DSG 5dr',
 'transmission': 'automatic',
 'trim': '1.4 TSI iV SE Technology DSG 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116995130%27 HTTP/1.1" 200 None
2025-12-02 19:10:28 [astonbarclay.gb] INFO: Saving data for 116995130: {'created_time': 1764702628.610407, 'last_price_update_time': 1764702628.61042, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116995130') HTTP/1.1" 204 0
2025-12-02 19:10:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf03f5a50>
2025-12-02 19:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLD71KWK%252F2025-11-26%252Fimage%252F2f42f206-49bd-4fe2-829b-1536fb085e4c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LD71KWK/2025-11-26/image/2f42f206-49bd-4fe2-829b-1536fb085e4c_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99beba97-1913-5102-8e25-4e317b739c26
2025-12-02 19:10:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99beba97-1913-5102-8e25-4e317b739c26, skipping ID generation
2025-12-02 19:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99beba97-1913-5102-8e25-4e317b739c26 with scrape type 1
2025-12-02 19:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 99beba97-1913-5102-8e25-4e317b739c26 from tracking dictionaries
2025-12-02 19:10:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99beba97-1913-5102-8e25-4e317b739c26 sending to next pipeline
2025-12-02 19:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 99beba97-1913-5102-8e25-4e317b739c26, identifier: 117429174
2025-12-02 19:10:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf069eb10>
2025-12-02 19:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252Faa99ccc0-6331-4e88-ac48-97fbdd467c89_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/aa99ccc0-6331-4e88-ac48-97fbdd467c89_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 283bf0d5-6bad-50db-9564-14c39392202b
2025-12-02 19:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 99beba97-1913-5102-8e25-4e317b739c26 with identifier: 117429174
2025-12-02 19:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 99beba97-1913-5102-8e25-4e317b739c26 with identifier: 117429174
2025-12-02 19:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 99beba97-1913-5102-8e25-4e317b739c26 with identifier: 117429174 to the API
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LD71KWK/2025-11-26/image/2f42f206-49bd-4fe2-829b-1536fb085e4c_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '99beba97-1913-5102-8e25-4e317b739c26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LD71KWK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117429174',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 61138,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21585,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/93b18e2f-ec66-4df7-b939-ab58125d28dd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22819,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/e163278a-9978-4f4b-a97a-0c355ae43f11_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24649,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/99cf92a6-25d9-4441-96e0-4ef790699e89_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22668,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/b65d3236-047b-4e78-a06f-df5b971db80a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35405,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/709d13ed-77df-4852-96e0-102b111e72bf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34966,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/5e1b628d-2acb-4fab-920e-087f1e35f2d3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41636,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/cf893de7-56c7-4b28-b290-42ba98251a08_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99beba97-1913-5102-8e25-4e317b739c26/99beba97-1913-5102-8e25-4e317b739c26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43077,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LD71KWK/2025-11-26/image/2f42f206-49bd-4fe2-829b-1536fb085e4c_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-24',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2021}
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117429174%27 HTTP/1.1" 200 None
2025-12-02 19:10:29 [astonbarclay.gb] INFO: Saving data for 117429174: {'created_time': 1764702629.696204, 'last_price_update_time': 1764702629.696217, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117429174') HTTP/1.1" 204 0
2025-12-02 19:10:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 19:10:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 19:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 19:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fecf1f6b3d0>
2025-12-02 19:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 19:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV21ZTU%252F2025-11-12%252Fimage%252F1979d0e2-f78c-41ea-9ae6-b8bf98e61c04_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-02 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/1979d0e2-f78c-41ea-9ae6-b8bf98e61c04_removebg.jpg?w=600 saved to cache
2025-12-02 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 283bf0d5-6bad-50db-9564-14c39392202b
2025-12-02 19:10:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 283bf0d5-6bad-50db-9564-14c39392202b, skipping ID generation
2025-12-02 19:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283bf0d5-6bad-50db-9564-14c39392202b with scrape type 1
2025-12-02 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 283bf0d5-6bad-50db-9564-14c39392202b from tracking dictionaries
2025-12-02 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 283bf0d5-6bad-50db-9564-14c39392202b sending to next pipeline
2025-12-02 19:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 283bf0d5-6bad-50db-9564-14c39392202b, identifier: 116305284
2025-12-02 19:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 283bf0d5-6bad-50db-9564-14c39392202b with identifier: 116305284
2025-12-02 19:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 283bf0d5-6bad-50db-9564-14c39392202b with identifier: 116305284
2025-12-02 19:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 283bf0d5-6bad-50db-9564-14c39392202b with identifier: 116305284 to the API
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 19:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/1979d0e2-f78c-41ea-9ae6-b8bf98e61c04_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '283bf0d5-6bad-50db-9564-14c39392202b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'HV21ZTU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116305284',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SEAT',
 'model': 'LEON ESTATE',
 'odometer': 66595,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32712,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/d43d49d0-697b-4039-80d4-1e7b62a9eacc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32897,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/bffda8b0-5b68-44b6-ad84-bd5b2b85f0b7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32775,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ffa386e6-dbe9-4064-9a18-a419e81cc971_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33863,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/0cac893e-fade-44c9-8953-4ddc91b6f397_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51973,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/f0fae644-d3fc-4db5-a7eb-577caddbd7c1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49891,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/ba0f019c-2904-490e-bea0-236564b9b5c5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59106,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/aa99ccc0-6331-4e88-ac48-97fbdd467c89_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283bf0d5-6bad-50db-9564-14c39392202b/283bf0d5-6bad-50db-9564-14c39392202b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57535,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HV21ZTU/2025-11-12/image/1979d0e2-f78c-41ea-9ae6-b8bf98e61c04_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-28',
 'seller_name': 'Kinto',
 'title': 'SEAT LEON ESTATE 1.5 TSI EVO 150 Xcellence 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI EVO 150 Xcellence 5dr',
 'vin': None,
 'year': 2021}
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116305284%27 HTTP/1.1" 200 None
2025-12-02 19:10:30 [astonbarclay.gb] INFO: Saving data for 116305284: {'created_time': 1764702630.570108, 'last_price_update_time': 1764702630.57012, 'auction_closing_time': 1764842400.0}
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116305284') HTTP/1.1" 204 0
2025-12-02 19:10:30 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-02 19:10:30 [astonbarclay.gb] INFO: astonbarclay.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 4, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 3}
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117699534%27 HTTP/1.1" 200 None
2025-12-02 19:10:30 [astonbarclay.gb] INFO: Saving data for 117699534: {'created_time': 1764702630.695127}
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117699534') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20last_price_update_time%20lt%201764270630 HTTP/1.1" 200 None
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116383281') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116695109') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116751964') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116763299') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116809736') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116824054') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116921234') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116933624') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116950171') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116997163') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117019889') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117025680') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117099044') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117112542') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117169329') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117220810') HTTP/1.1" 204 0
2025-12-02 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117260206') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117270782') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117291740') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117320089') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117355965') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117366081') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117372675') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117405738') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117425501') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117490150') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117521004') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117540662') HTTP/1.1" 204 0
2025-12-02 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550254') HTTP/1.1" 204 0
2025-12-02 19:10:31 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (337 items) in: file:///var/lib/scrapyd/items/sourcing_v2/astonbarclay.gb/task_36_2025-12-02T19_00_00.jl
2025-12-02 19:10:31 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1092584,
 'downloader/request_count': 1801,
 'downloader/request_method_count/GET': 1801,
 'downloader/response_bytes': 58651679,
 'downloader/response_count': 1801,
 'downloader/response_status_count/200': 1801,
 'elapsed_time_seconds': 625.333369,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 2, 19, 10, 31, 116272, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 128,
 'item_dropped_reasons_count/DropItem': 128,
 'item_scraped_count': 337,
 'log_count/DEBUG': 19567,
 'log_count/ERROR': 118,
 'log_count/INFO': 19213,
 'memusage/max': 181264384,
 'memusage/startup': 127180800,
 'photo_download_count': 1333,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 78,
 'playwright/request_count/aborted': 42,
 'playwright/request_count/method/GET': 55,
 'playwright/request_count/method/HEAD': 12,
 'playwright/request_count/method/POST': 11,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 22,
 'playwright/request_count/resource_type/font': 2,
 'playwright/request_count/resource_type/image': 30,
 'playwright/request_count/resource_type/script': 7,
 'playwright/request_count/resource_type/stylesheet': 2,
 'playwright/request_count/resource_type/xhr': 13,
 'playwright/response_count': 36,
 'playwright/response_count/method/GET': 25,
 'playwright/response_count/method/POST': 11,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 10,
 'playwright/response_count/resource_type/font': 2,
 'playwright/response_count/resource_type/script': 7,
 'playwright/response_count/resource_type/stylesheet': 2,
 'playwright/response_count/resource_type/xhr': 13,
 'request_depth_max': 3,
 'response_received_count': 468,
 'scheduler/dequeued': 1801,
 'scheduler/dequeued/memory': 1801,
 'scheduler/enqueued': 1801,
 'scheduler/enqueued/memory': 1801,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 467,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 7.053609072432429,
 'scrapy-zyte-api/mean_response_seconds': 7.054501900128816,
 'scrapy-zyte-api/processed': 467,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 467,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 466,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 467,
 'scrapy-zyte-api/request_args/httpResponseBody': 467,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 467,
 'scrapy-zyte-api/request_args/url': 467,
 'scrapy-zyte-api/status_codes/200': 467,
 'scrapy-zyte-api/success': 467,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2025, 12, 2, 19, 0, 5, 782903, tzinfo=datetime.timezone.utc)}
2025-12-02 19:10:31 [scrapy.core.engine] INFO: Spider closed (finished)